-- Logs begin at Thu 2022-10-20 12:57:25 UTC, end at Thu 2022-10-20 13:52:58 UTC. -- Oct 20 13:21:54.281724 dv-cinder-862136-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 20 13:21:54.290253 dv-cinder-862136-1-smb devstack@keystone.service[81414]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 20 13:21:54.292288 dv-cinder-862136-1-smb devstack@keystone.service[81414]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 20 13:21:54 2022] *** Oct 20 13:21:54.292288 dv-cinder-862136-1-smb devstack@keystone.service[81414]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 20 13:21:54.292288 dv-cinder-862136-1-smb devstack@keystone.service[81414]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 20 13:21:54.292288 dv-cinder-862136-1-smb devstack@keystone.service[81414]: nodename: dv-cinder-862136-1-smb Oct 20 13:21:54.292288 dv-cinder-862136-1-smb devstack@keystone.service[81414]: machine: x86_64 Oct 20 13:21:54.292288 dv-cinder-862136-1-smb devstack@keystone.service[81414]: clock source: unix Oct 20 13:21:54.292288 dv-cinder-862136-1-smb devstack@keystone.service[81414]: pcre jit disabled Oct 20 13:21:54.292288 dv-cinder-862136-1-smb devstack@keystone.service[81414]: detected number of CPU cores: 4 Oct 20 13:21:54.292288 dv-cinder-862136-1-smb devstack@keystone.service[81414]: current working directory: / Oct 20 13:21:54.292288 dv-cinder-862136-1-smb devstack@keystone.service[81414]: detected binary path: /usr/bin/uwsgi-core Oct 20 13:21:54.292288 dv-cinder-862136-1-smb devstack@keystone.service[81414]: your processes number limit is 47680 Oct 20 13:21:54.293123 dv-cinder-862136-1-smb devstack@keystone.service[81414]: your memory page size is 4096 bytes Oct 20 13:21:54.293123 dv-cinder-862136-1-smb devstack@keystone.service[81414]: detected max file descriptor number: 2048 Oct 20 13:21:54.293123 dv-cinder-862136-1-smb devstack@keystone.service[81414]: lock engine: pthread robust mutexes Oct 20 13:21:54.293123 dv-cinder-862136-1-smb devstack@keystone.service[81414]: thunder lock: enabled Oct 20 13:21:54.293123 dv-cinder-862136-1-smb devstack@keystone.service[81414]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 20 13:21:54.293123 dv-cinder-862136-1-smb devstack@keystone.service[81414]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 20 13:21:54.332106 dv-cinder-862136-1-smb devstack@keystone.service[81414]: Python main interpreter initialized at 0x5655107cb9c0 Oct 20 13:21:54.332106 dv-cinder-862136-1-smb devstack@keystone.service[81414]: python threads support enabled Oct 20 13:21:54.332106 dv-cinder-862136-1-smb devstack@keystone.service[81414]: your server socket listen backlog is limited to 100 connections Oct 20 13:21:54.332106 dv-cinder-862136-1-smb devstack@keystone.service[81414]: your mercy for graceful operations on workers is 90 seconds Oct 20 13:21:54.332470 dv-cinder-862136-1-smb devstack@keystone.service[81414]: mapped 403077 bytes (393 KB) for 2 cores Oct 20 13:21:54.332552 dv-cinder-862136-1-smb devstack@keystone.service[81414]: *** Operational MODE: preforking *** Oct 20 13:21:54.332792 dv-cinder-862136-1-smb devstack@keystone.service[81414]: *** uWSGI is running in multiple interpreter mode *** Oct 20 13:21:54.332792 dv-cinder-862136-1-smb devstack@keystone.service[81414]: spawned uWSGI master process (pid: 81414) Oct 20 13:21:54.332992 dv-cinder-862136-1-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 20 13:21:54.333582 dv-cinder-862136-1-smb devstack@keystone.service[81414]: spawned uWSGI worker 1 (pid: 81426, cores: 1) Oct 20 13:21:54.333865 dv-cinder-862136-1-smb devstack@keystone.service[81414]: spawned uWSGI worker 2 (pid: 81427, cores: 1) Oct 20 13:21:54.334013 dv-cinder-862136-1-smb devstack@keystone.service[81414]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 20 13:21:58.614567 dv-cinder-862136-1-smb devstack@keystone.service[81427]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 13:21:58.614567 dv-cinder-862136-1-smb devstack@keystone.service[81427]: from cryptography.utils import int_from_bytes Oct 20 13:21:58.615399 dv-cinder-862136-1-smb devstack@keystone.service[81427]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 13:21:58.615399 dv-cinder-862136-1-smb devstack@keystone.service[81427]: from cryptography.utils import int_from_bytes Oct 20 13:21:58.616273 dv-cinder-862136-1-smb devstack@keystone.service[81426]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 13:21:58.616273 dv-cinder-862136-1-smb devstack@keystone.service[81426]: from cryptography.utils import int_from_bytes Oct 20 13:21:58.616732 dv-cinder-862136-1-smb devstack@keystone.service[81426]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 13:21:58.616732 dv-cinder-862136-1-smb devstack@keystone.service[81426]: from cryptography.utils import int_from_bytes Oct 20 13:21:58.665399 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 13:21:58.665572 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 13:21:58.665756 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] command line args: [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 13:21:58.666021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 13:21:58.666195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ================================================================================ {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 13:21:58.666444 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] admin_token = **** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.666687 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] config_dir = [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.666845 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 13:21:58.666932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.667064 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] config_source = [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.667153 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 13:21:58.667229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] debug = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.667311 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] command line args: [] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 13:21:58.667432 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.667934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 13:21:58.667934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ================================================================================ {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 13:21:58.668049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.668187 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] admin_token = **** {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.668287 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.668421 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] config_dir = [] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.668531 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.668634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.668730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.668836 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] config_source = [] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.668938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] list_limit = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.669033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] debug = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.669145 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] log_config_append = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.669246 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.669380 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.669484 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.669586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] log_dir = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.669686 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.669781 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] log_file = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.669781 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.669968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.670093 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.670168 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.670282 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.670356 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] list_limit = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.670476 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] log_config_append = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.670561 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.670642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.670757 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.670839 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] log_dir = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.670915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.671086 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] log_file = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.671163 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.671285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.671365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.671482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.671562 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.671641 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.671756 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.671843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.671918 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.672019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.672111 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.672192 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.672351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.672471 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.672595 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.672678 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.672868 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.672957 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.673107 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.673343 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.673421 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.673521 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] publish_errors = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.673607 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.673751 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.673828 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.673980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.674065 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.674194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.674304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.674382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.674603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.674794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.674885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] standard_threads = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.674983 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] publish_errors = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.675058 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.675227 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.675317 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.675459 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.675542 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.675620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] use_journal = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.675695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.675775 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] use_json = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.675872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.675950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] use_stderr = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.676109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.676186 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] use_syslog = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.676335 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.676459 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] standard_threads = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.676567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.676656 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.676809 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.676885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.676985 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.677069 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.677164 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] use_journal = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.677288 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.677367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] use_json = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.677505 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] use_stderr = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.677581 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.677682 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] use_syslog = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.677760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.677914 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 13:21:58.677990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.678170 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.678253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.678408 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.678493 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.678667 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.678749 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.678907 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.679012 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.679172 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.679341 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.679970 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.680116 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.680244 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.680386 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.680528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.680629 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.680702 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.680779 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.680887 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.680974 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.681139 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.681224 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.681379 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.681456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.681618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.681693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.681852 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.681932 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.682099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.682176 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.682352 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.682428 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.682595 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.682682 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.682836 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.682919 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.683087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.683179 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.683316 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.683400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.683544 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.683626 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.683777 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.683862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.684021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.684098 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.684263 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.684346 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.684490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.684575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.684717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.684800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.684958 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.685036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.685195 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.685279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.685425 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.685502 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.685666 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.685742 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.685894 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.685980 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.686126 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.686202 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.686355 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.686430 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.686579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.686667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.686805 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.686882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.687053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.687133 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.687282 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.687374 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.687520 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.687603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.687762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.687839 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.687990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.688140 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.688214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.688284 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.688436 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.688514 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.688667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.688751 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.688896 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.688977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.689133 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.689216 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.689358 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.689444 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.689591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.689674 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.689822 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.689889 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.690052 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.690136 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.690281 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.690358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.690512 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.690589 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.690738 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.690822 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.690995 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.691118 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.691289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.691403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.691510 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.691607 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.691703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.691810 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.691914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.692017 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.692121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.692214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.692351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.692473 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.692586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.692664 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.692819 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.692898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.693060 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.693142 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.693296 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.693424 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.693537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.693621 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.693781 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.693859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.694013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.694092 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.694248 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.694372 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.694482 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.694561 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.694726 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.694803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.695006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.695153 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.695301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.695438 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.695528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.695600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.695692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.695816 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.695936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.696060 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.696170 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.696302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.696386 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.696558 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.696644 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.696802 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.696880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.697044 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.697121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.697294 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.697380 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.697535 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.697619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.697778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.697856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.698015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.698104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.698249 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.698332 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.698482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.698558 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.698713 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.698798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.698957 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.699036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.699198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.699279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.699425 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.699578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.699654 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.699725 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.699865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.699944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.700098 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.700185 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.700325 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.700404 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.700563 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.700640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.700795 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.700872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.701037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.701116 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.701271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.701349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.701506 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.701583 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.701739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.701819 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.701978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.702062 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.702202 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] auth.external = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.702284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.702431 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.702510 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.702665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.702743 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.702915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.703058 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.703176 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] auth.password = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.703266 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.703405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] auth.token = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.703485 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.703653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.703747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.703875 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.703962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.704117 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.704197 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] auth.external = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.704346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.704424 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.704598 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.704697 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.704836 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.704917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.705064 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.705142 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] auth.password = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.705298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] auth.token = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.705378 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] credential.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.705538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.705627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.705775 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.705892 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.706016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.706097 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.706248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.706334 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.706486 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.706564 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.706718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.706798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.706972 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.707054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.707217 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] credential.caching = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.707295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.707455 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.707532 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.707707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.707787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.707959 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.708039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.708205 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.708283 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.708454 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.708541 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.708690 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.708771 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.708935 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.709012 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.709167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] federation.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.709247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.709401 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.709479 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.709641 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.709728 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.709883 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.709964 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.710110 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.710189 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.710353 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.710432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.710610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.710744 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.710872 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.711036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.711166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.711248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] federation.caching = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.711338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.711415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.711561 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.711662 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.711805 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.711915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.712039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.712152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.712283 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.712404 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.712527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.712646 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.712760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.712905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.712983 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.713146 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.713230 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.713405 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.713486 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.713647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.713726 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.713890 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.713967 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.714126 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] identity.caching = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.714205 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.714354 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.714432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.714585 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.714664 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.714814 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.714894 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.715076 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.715158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.715321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.715399 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.715557 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.715641 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.715781 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.715860 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.716032 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.716110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.716283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.716363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.716519 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.716597 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.716752 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.716830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.716977 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.717057 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.717211 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.717290 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.717444 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.717523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.717680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.717761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.717918 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.717996 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.718153 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.718232 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.718425 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.718505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.718668 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.718747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.718909 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.719007 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.719171 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.719253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.719412 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.719491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.719647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.719726 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.719888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.719968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.720114 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.720191 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.720350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.720428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.720579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.720714 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.720816 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.720954 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.721054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.721209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.721296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.721469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.721548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.721713 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.721792 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.721966 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.722046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.722209 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.722292 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.722441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.722519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.722670 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.722750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.722900 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.722995 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.723170 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.723249 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.723406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.723486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.723642 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.723720 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.723877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.723956 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.724104 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.724185 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.724341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.724422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.724592 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.724670 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.724820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.724900 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.725051 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.725129 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.725295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.725372 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.725537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.725618 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.725769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.725848 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.725996 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.726074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.726739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.727043 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.727247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.727342 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.727504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.727584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.727739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.727822 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.727991 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.728072 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.728242 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.728321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.728493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.728574 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.728733 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.728812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.728967 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.729047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.729207 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.729288 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.729434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.729511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.729672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.729750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.729905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.729992 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.730141 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.730220 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.730378 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.730456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.730612 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.730693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.730857 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.730935 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.731126 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.731205 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.731361 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.731441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.731612 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.731690 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.731840 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.731918 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.732081 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.732160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.732312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.732389 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.732546 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.732624 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.732781 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.732862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.733026 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.733105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.733264 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.733346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.733491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.733570 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.733726 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.733804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.733965 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] resource.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.734043 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.734201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.734280 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.734439 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.734518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.734671 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.734748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.734917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.735042 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.735184 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.735263 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.735416 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.735494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.735656 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.735738 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.735888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.735965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] resource.caching = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.736125 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.736203 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.736359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] role.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.736440 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.736599 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.736677 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] role.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.736824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.736901 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.737070 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.737152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.737315 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.737394 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.737559 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.737645 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.737797 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.737874 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.738040 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.738118 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.738280 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.738365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] role.caching = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.738525 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.738604 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] role.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.738756 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.738833 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.739006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.739099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.739256 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.739335 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.739501 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.739581 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.739747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.739834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.739992 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.740070 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.740243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.740382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.740495 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.740626 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.740744 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.740860 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.740969 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.741111 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.741220 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.741361 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.741471 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.741611 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.741722 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.742447 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.743137 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.743265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.743265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.743490 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.743576 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.743719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.743798 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.743976 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.744056 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.744211 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.744290 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.744463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.744555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.744720 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.744798 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.744964 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.745043 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.745200 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.745286 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.745438 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.745517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.745670 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.745748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.745907 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] token.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.745993 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.746143 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.746220 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.746382 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.746460 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.746615 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.746700 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.746870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.746975 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.747139 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.747218 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.747375 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.747470 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.747618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.747696 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.747852 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.747930 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.748095 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] token.caching = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.748181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.748328 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.748406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.748565 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.748643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.748800 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.748887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.749045 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.749124 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.749294 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.749371 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.749530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.749620 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.749772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.749852 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.750017 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.750096 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.750269 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.750348 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.connection = **** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.750506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.750586 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.750746 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.750824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.751009 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.751093 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.751250 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.751330 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.751482 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.751561 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.751716 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.751794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.751949 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.752038 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.752182 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.752263 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.752423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.752502 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.connection = **** {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.752656 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.752735 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.752898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.752978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.753133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.753212 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.753377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.753456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.753610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.753689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.753850 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.753928 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.754076 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.754155 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.754313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.754393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.754543 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.754621 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.754711 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 13:21:58.754790 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.755043 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.755289 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.755542 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.755785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.756035 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.756269 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.756513 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.756754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 13:21:58.756933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 13:21:58.783816 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:58.784045 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:58.784270 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:58.784933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:58.785173 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:58.785408 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:58.793419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:58.794665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:58.822032 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:58.822259 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:58.823134 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:58.823376 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:58.875908 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:58.876454 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:58.924641 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:58.924871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:58.925421 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:58.925663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.080567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.080794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.081025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.081110 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.081252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.081338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.081475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.081559 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.081696 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.081788 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.081911 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.082124 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.105791 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.106031 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.106217 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.106323 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.106448 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.106529 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.106669 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.106750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.106888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.106991 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.107128 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.107209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.107343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.107557 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.118378 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.118731 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.131063 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.131231 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.131316 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.131463 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.131547 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.131696 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.131779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.131923 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.132014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.132142 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.132223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.132378 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.132460 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81426) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.132597 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81427) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 20 13:21:59.150101 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.150206 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.150311 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 20 13:21:59.150396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 20 13:21:59.150656 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.150749 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.150852 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 20 13:21:59.150933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 20 13:21:59.151151 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.151233 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.151412 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.151497 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.151671 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.151753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.151926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.152006 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.161497 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.161619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.161766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.161904 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.162038 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.162184 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.162321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.162474 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.170044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.170451 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.172934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.173220 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.173377 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.173504 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.173667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.173789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.173957 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.174074 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.174250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.174332 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.174542 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.174633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.174812 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.174894 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.175117 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.175202 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.175388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.175472 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.175656 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.175738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.175932 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.176206 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.198774 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.199277 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.200271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.200555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.200750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.201043 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.205179 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.205464 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.205700 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.205784 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.205991 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.206281 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.212177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.212465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.212734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.213027 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.217994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.218290 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.218580 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.218663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.218867 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.218994 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.219174 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.219259 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.219454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.219538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.219735 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.219821 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.220009 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.220091 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.220295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.220574 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.237831 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.238120 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.239824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.240115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.242609 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.244559 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.245832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.247299 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.249162 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.249162 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.251240 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.252331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.254436 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.255489 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.257707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.258178 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.258476 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.258709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.258793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.259032 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.259135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.259319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.259403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.259602 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.259881 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.260169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.275145 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.275436 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.275713 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.275796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.275984 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.276082 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.276324 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.276585 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.282777 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.283338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.284368 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.284881 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.285895 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.286179 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.286385 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.286659 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.289546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.289826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.289982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.290127 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.290274 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.290440 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.290583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.290705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.290806 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.291152 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.302162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.302446 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.302531 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.302734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.302816 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.303043 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.303129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.303326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.303435 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.303709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.303814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.303998 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.304079 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.304831 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.320070 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.320454 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.322942 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.323387 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.325813 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.326268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.327303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.327743 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.328754 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.329035 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.329213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.329437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.329533 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.329899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.335754 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.336313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.337333 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.337775 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.340203 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.340596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.340679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.340885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.341048 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.341166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.341346 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.341630 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.348902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.349196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.349476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.349567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.349773 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.350061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.356907 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81427) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.357193 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.357486 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.357603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81426) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 20 13:21:59.357764 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.357855 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.358048 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.358152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.358319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.358410 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.358591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.358682 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.358864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.358994 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.359158 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.359249 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.359445 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.359536 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.359744 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.359832 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.360032 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.360123 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.360351 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.360441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.360636 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81427) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.360724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.360952 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.361251 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81426) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 20 13:21:59.395739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5655107cb9c0 pid: 81426 (default app) Oct 20 13:21:59.398240 dv-cinder-862136-1-smb devstack@keystone.service[81427]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5655107cb9c0 pid: 81427 (default app) Oct 20 13:21:59.399175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bce7c4-4151-4d41-b472-a44b95e48a37 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:21:59.399470 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bce7c4-4151-4d41-b472-a44b95e48a37 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:21:59.399750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bce7c4-4151-4d41-b472-a44b95e48a37 None None] PATH_INFO: `/v3` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:21:59.403885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Thu Oct 20 13:21:59 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:06.168017 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e64e7-a1f9-487f-b656-c5c485a19cb7 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:06.168510 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e64e7-a1f9-487f-b656-c5c485a19cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:06.168510 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e64e7-a1f9-487f-b656-c5c485a19cb7 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:06.172704 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:22:06.177854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e5b53-debc-4531-807f-08613d757cb7 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:06.178297 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e5b53-debc-4531-807f-08613d757cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:06.178434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e5b53-debc-4531-807f-08613d757cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:06.250794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: INFO dbcounter [None req-392e5b53-debc-4531-807f-08613d757cb7 None None] Registered counter for database keystone Oct 20 13:22:06.269719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG oslo_db.sqlalchemy.engines [None req-392e5b53-debc-4531-807f-08613d757cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:22:06.276113 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writer thread running {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:22:06.460056 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG passlib.handlers.bcrypt [None req-392e5b53-debc-4531-807f-08613d757cb7 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81426) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 20 13:22:06.460595 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG passlib.handlers.bcrypt [None req-392e5b53-debc-4531-807f-08613d757cb7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81426) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 20 13:22:06.520981 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-392e5b53-debc-4531-807f-08613d757cb7 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:06.522618 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-392e5b53-debc-4531-807f-08613d757cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:06.650128 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 13:22:07.078905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e64e7-a1f9-487f-b656-c5c485a19cb7 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:07.148577 dv-cinder-862136-1-smb devstack@keystone.service[81427]: INFO dbcounter [None req-578e64e7-a1f9-487f-b656-c5c485a19cb7 None None] Registered counter for database keystone Oct 20 13:22:07.170450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG oslo_db.sqlalchemy.engines [None req-578e64e7-a1f9-487f-b656-c5c485a19cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81427) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 13:22:07.176726 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writer thread running {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 13:22:07.294386 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e64e7-a1f9-487f-b656-c5c485a19cb7 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:07.298507 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5fe27-10cc-4b92-be54-4a58f8e1fc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:07.299172 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5fe27-10cc-4b92-be54-4a58f8e1fc5b admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:07.299451 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5fe27-10cc-4b92-be54-4a58f8e1fc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:07.299723 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5fe27-10cc-4b92-be54-4a58f8e1fc5b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:07.307848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5fe27-10cc-4b92-be54-4a58f8e1fc5b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:07.358820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: WARNING keystone.common.rbac_enforcer.enforcer [None req-51a5fe27-10cc-4b92-be54-4a58f8e1fc5b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 20 13:22:07.359201 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a5fe27-10cc-4b92-be54-4a58f8e1fc5b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:07.368936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Oct 20 13:22:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 20 13:22:07.375198 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e5b53-debc-4531-807f-08613d757cb7 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:07.392734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e5b53-debc-4531-807f-08613d757cb7 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:07.397177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c9fb5-b6fd-4c65-831b-59413693c2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:07.398467 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c9fb5-b6fd-4c65-831b-59413693c2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:07.398796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c9fb5-b6fd-4c65-831b-59413693c2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:07.399062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c9fb5-b6fd-4c65-831b-59413693c2d9 admin admin] PATH_INFO: `/v3/projects/fb60201a6517430aaa26188ed8565651` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:07.400665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c9fb5-b6fd-4c65-831b-59413693c2d9 admin admin] RBAC: Authorizing `identity:get_project(project_id=fb60201a6517430aaa26188ed8565651)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:07.454876 dv-cinder-862136-1-smb devstack@keystone.service[81426]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ff1c9fb5-b6fd-4c65-831b-59413693c2d9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 20 13:22:07.455254 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c9fb5-b6fd-4c65-831b-59413693c2d9 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:07.459806 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Oct 20 13:22:07 2022] GET /identity/v3/projects/fb60201a6517430aaa26188ed8565651 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:09.582302 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2b7fb-c8ad-4576-aea2-3c80f0655a9e None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:09.582815 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2b7fb-c8ad-4576-aea2-3c80f0655a9e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:09.582900 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2b7fb-c8ad-4576-aea2-3c80f0655a9e None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:09.587465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:09.592796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e6f07-4673-4dcf-af1c-8a2f418010f0 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:09.593161 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e6f07-4673-4dcf-af1c-8a2f418010f0 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:09.593362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e6f07-4673-4dcf-af1c-8a2f418010f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:09.613995 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-d88e6f07-4673-4dcf-af1c-8a2f418010f0 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:09.615574 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d88e6f07-4673-4dcf-af1c-8a2f418010f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:09.623492 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 13:22:09.893459 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2b7fb-c8ad-4576-aea2-3c80f0655a9e None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:09.905805 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2b7fb-c8ad-4576-aea2-3c80f0655a9e None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:09.910033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c20cf7-69ca-41d7-8bf9-4bcd8ea03ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:09.910642 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c20cf7-69ca-41d7-8bf9-4bcd8ea03ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:09.910926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c20cf7-69ca-41d7-8bf9-4bcd8ea03ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:09.911234 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c20cf7-69ca-41d7-8bf9-4bcd8ea03ba0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:09.919550 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c20cf7-69ca-41d7-8bf9-4bcd8ea03ba0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:09.921319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c20cf7-69ca-41d7-8bf9-4bcd8ea03ba0 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:09.930856 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Thu Oct 20 13:22:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 13:22:09.936093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e6f07-4673-4dcf-af1c-8a2f418010f0 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:09.945250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e6f07-4673-4dcf-af1c-8a2f418010f0 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:09.949592 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3072aa-1d9c-44ff-8687-d39f1ce1551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:09.950216 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3072aa-1d9c-44ff-8687-d39f1ce1551f admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:09.950499 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3072aa-1d9c-44ff-8687-d39f1ce1551f admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:09.950771 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3072aa-1d9c-44ff-8687-d39f1ce1551f admin admin] PATH_INFO: `/v3/users/7f166e0661794d2b8c2ad033390437ec` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:09.952149 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3072aa-1d9c-44ff-8687-d39f1ce1551f admin admin] RBAC: Authorizing `identity:get_user(user_id=7f166e0661794d2b8c2ad033390437ec)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:09.953982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3072aa-1d9c-44ff-8687-d39f1ce1551f admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:09.955551 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Thu Oct 20 13:22:09 2022] GET /identity/v3/users/7f166e0661794d2b8c2ad033390437ec => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:12.182292 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ee7f0-bff1-430d-9250-3e59acead871 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:12.182820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ee7f0-bff1-430d-9250-3e59acead871 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:12.182820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ee7f0-bff1-430d-9250-3e59acead871 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:12.184119 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:12.189157 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d4050-5555-49e7-80da-18720917ea8e None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:12.189584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d4050-5555-49e7-80da-18720917ea8e None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:12.189715 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d4050-5555-49e7-80da-18720917ea8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:12.207806 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-e02d4050-5555-49e7-80da-18720917ea8e None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:12.209018 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e02d4050-5555-49e7-80da-18720917ea8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:12.246584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb510e-ad90-412f-930c-90034b4456e4 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:12.246870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb510e-ad90-412f-930c-90034b4456e4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:12.247205 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb510e-ad90-412f-930c-90034b4456e4 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:12.248559 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:22:12.253631 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b75e3-b169-405e-9a96-daabe4dcd803 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:12.253915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b75e3-b169-405e-9a96-daabe4dcd803 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:12.254195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b75e3-b169-405e-9a96-daabe4dcd803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:12.291988 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:12.296906 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG passlib.handlers.bcrypt [None req-369b75e3-b169-405e-9a96-daabe4dcd803 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81427) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 20 13:22:12.297297 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG passlib.handlers.bcrypt [None req-369b75e3-b169-405e-9a96-daabe4dcd803 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81427) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 20 13:22:12.347946 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-369b75e3-b169-405e-9a96-daabe4dcd803 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:12.349542 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-369b75e3-b169-405e-9a96-daabe4dcd803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:12.449389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:12.557814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d4050-5555-49e7-80da-18720917ea8e None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:12.582554 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:12.660711 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d4050-5555-49e7-80da-18720917ea8e None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:12.694113 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b855f16-9364-4918-b14e-d87eeee49f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:12.694732 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b855f16-9364-4918-b14e-d87eeee49f11 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:12.695042 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b855f16-9364-4918-b14e-d87eeee49f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:12.695317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b855f16-9364-4918-b14e-d87eeee49f11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:12.705990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b855f16-9364-4918-b14e-d87eeee49f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:12.714965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-0b855f16-9364-4918-b14e-d87eeee49f11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:22:12.714965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:12.714965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:12.714965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:12.714965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:12.714965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:12.714965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:12.714965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:12.714965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:12.714965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:12.714965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:12.714965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:12.714965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:12.714965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:12.714965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:12.714965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:12.716041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:12.716041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:12.716041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:12.716041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:12.716041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:12.716041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:12.716041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:12.716041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:12.716041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:12.716041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:12.716041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:12.716041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:12.716041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:12.716041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:12.716041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:12.716041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:12.716882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:12.716882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:12.716882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:12.716882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:12.716882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:12.716882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:12.716882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:12.716882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:12.716882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:12.716882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:12.716882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:22:12.716882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:22:12.716882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:22:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:12.719696 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b75e3-b169-405e-9a96-daabe4dcd803 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:12.721500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b855f16-9364-4918-b14e-d87eeee49f11 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:12.803054 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:12.820387 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b75e3-b169-405e-9a96-daabe4dcd803 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:12.821941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b855f16-9364-4918-b14e-d87eeee49f11 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:12.822598 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:12.857250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df55b9d-d025-4a8a-99b3-2511bcd8b907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:12.857962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df55b9d-d025-4a8a-99b3-2511bcd8b907 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:12.858244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df55b9d-d025-4a8a-99b3-2511bcd8b907 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:12.858511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df55b9d-d025-4a8a-99b3-2511bcd8b907 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:12.858655 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677d906-a80b-4115-aadf-32a2d1ec0a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:12.859205 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df55b9d-d025-4a8a-99b3-2511bcd8b907 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:12.859508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df55b9d-d025-4a8a-99b3-2511bcd8b907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:12.859604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677d906-a80b-4115-aadf-32a2d1ec0a4f None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:12.859821 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677d906-a80b-4115-aadf-32a2d1ec0a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:12.860120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677d906-a80b-4115-aadf-32a2d1ec0a4f None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:12.860884 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df55b9d-d025-4a8a-99b3-2511bcd8b907 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:12.861073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677d906-a80b-4115-aadf-32a2d1ec0a4f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:12.862474 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677d906-a80b-4115-aadf-32a2d1ec0a4f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:12.873170 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:12.875419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.sql.core [None req-f677d906-a80b-4115-aadf-32a2d1ec0a4f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 13:22:12.875419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 13:22:12.875419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [parameters: {'id': '4e71051451474c76b28f269948163b18', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 20 13:22:12.875419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81427) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 13:22:12.879032 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df55b9d-d025-4a8a-99b3-2511bcd8b907 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:12.894374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f677d906-a80b-4115-aadf-32a2d1ec0a4f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 20 13:22:12.894374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:12.894374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 13:22:12.894374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 13:22:12.894374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 13:22:12.894374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 13:22:12.894374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 13:22:12.894374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 13:22:12.894374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 13:22:12.894374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application conn.query(q) Oct 20 13:22:12.894374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 13:22:12.894374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 13:22:12.894374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 13:22:12.894374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application result.read() Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 20 13:22:12.895312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 13:22:12.896878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application next(self.gen) Oct 20 13:22:12.896878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 20 13:22:12.896878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application yield resource Oct 20 13:22:12.896878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 13:22:12.896878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application next(self.gen) Oct 20 13:22:12.896878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 20 13:22:12.896878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 13:22:12.896878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 13:22:12.896878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 13:22:12.896878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 13:22:12.896878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise self.value Oct 20 13:22:12.896878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 20 13:22:12.896878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 13:22:12.896878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 20 13:22:12.896878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application session.commit() Oct 20 13:22:12.896878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 13:22:12.896878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 13:22:12.898339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 13:22:12.898339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 13:22:12.898339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 13:22:12.898339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.session.flush() Oct 20 13:22:12.898339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 13:22:12.898339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 13:22:12.898339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 13:22:12.898339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 13:22:12.898339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 13:22:12.898339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application compat.raise_( Oct 20 13:22:12.898339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 13:22:12.898339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception Oct 20 13:22:12.898339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 13:22:12.898339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 13:22:12.898339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 13:22:12.898339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 13:22:12.898339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 13:22:12.899267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 13:22:12.899267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 13:22:12.899267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 13:22:12.899267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 20 13:22:12.899267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 20 13:22:12.899267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 13:22:12.899267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 13:22:12.899267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 13:22:12.899267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 13:22:12.899267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 13:22:12.899267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 13:22:12.899267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 13:22:12.899267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 13:22:12.899267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 13:22:12.899267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 13:22:12.899989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 13:22:12.899989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception Oct 20 13:22:12.899989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 13:22:12.899989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 13:22:12.899989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 13:22:12.899989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 13:22:12.899989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 13:22:12.899989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 13:22:12.899989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 13:22:12.899989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application conn.query(q) Oct 20 13:22:12.899989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 13:22:12.899989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 13:22:12.899989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 13:22:12.899989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application result.read() Oct 20 13:22:12.899989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 13:22:12.899989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 13:22:12.899989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 13:22:12.900799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 13:22:12.900799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 13:22:12.900799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 13:22:12.900799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 13:22:12.900799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 13:22:12.900799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 13:22:12.900799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 13:22:12.900799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [parameters: {'id': '4e71051451474c76b28f269948163b18', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 20 13:22:12.900799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 13:22:12.900799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:12.900799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:22:12.900799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:12.900799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:12.900799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 20 13:22:12.900799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 20 13:22:12.901505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 13:22:12.901505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 13:22:12.901505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 20 13:22:12.901505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:12.901505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:22:12.901505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:12.901505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:12.901505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:12.901505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:12.901505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:12.901505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:12.901505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:12.901505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:12.901505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:12.901505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:12.901505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:12.901505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:12.902393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 20 13:22:12.902393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 20 13:22:12.902393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:12.902393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:12.902393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 20 13:22:12.902393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 20 13:22:12.902393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:12.902393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:12.902393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 20 13:22:12.902393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 20 13:22:12.902393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 20 13:22:12.902393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:12.902393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 8/16] 10.222.0.36 () {60 vars in 1137 bytes} [Thu Oct 20 13:22:12 2022] POST /identity/v3/domains => generated 190 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:12.902393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677d906-a80b-4115-aadf-32a2d1ec0a4f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:12.979578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df55b9d-d025-4a8a-99b3-2511bcd8b907 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:13.004561 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677d906-a80b-4115-aadf-32a2d1ec0a4f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:13.012629 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da24a3-cc7c-406a-b787-afb99a1767e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:13.013278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da24a3-cc7c-406a-b787-afb99a1767e1 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:13.013559 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da24a3-cc7c-406a-b787-afb99a1767e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:13.013837 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da24a3-cc7c-406a-b787-afb99a1767e1 None admin] PATH_INFO: `/v3/users/7f166e0661794d2b8c2ad033390437ec` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:13.015010 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da24a3-cc7c-406a-b787-afb99a1767e1 None admin] RBAC: Authorizing `identity:get_user(user_id=7f166e0661794d2b8c2ad033390437ec)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:13.016482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da24a3-cc7c-406a-b787-afb99a1767e1 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:13.018058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:12 2022] GET /identity/v3/users/7f166e0661794d2b8c2ad033390437ec => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:13.023465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da24a3-cc7c-406a-b787-afb99a1767e1 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:13.037284 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27318c-bc81-4988-b390-21d78300bff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:13.038893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27318c-bc81-4988-b390-21d78300bff2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:13.039199 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27318c-bc81-4988-b390-21d78300bff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:13.039476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27318c-bc81-4988-b390-21d78300bff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:13.039851 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:13.058794 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27318c-bc81-4988-b390-21d78300bff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:13.060301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb27318c-bc81-4988-b390-21d78300bff2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:13.076177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-eb27318c-bc81-4988-b390-21d78300bff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:22:13.076177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:13.076177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:13.076177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:13.076177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:13.076177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:13.076177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:13.076177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:13.076177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:13.076177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:13.076177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:13.076177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:13.076177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:22:13.076177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:22:13.076177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:22:13.076177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:22:13.077100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:13.077100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:13.077100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:13.077100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:13.077100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:13.077100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:13.077100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:13.077100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:13.077100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:13.077100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:13.077100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:13.077100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:13.077100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:13.077100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:13.077100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:13.077100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:13.077100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:22:13.077912 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:22:13.077912 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:22:13.077912 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:13.077912 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 9/18] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:22:13.082919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27318c-bc81-4988-b390-21d78300bff2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:13.105262 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:13.125825 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da24a3-cc7c-406a-b787-afb99a1767e1 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:13.159377 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf4eae-90d1-465e-96da-583db02eb30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:13.160005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf4eae-90d1-465e-96da-583db02eb30d None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:13.160283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf4eae-90d1-465e-96da-583db02eb30d None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:13.160552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf4eae-90d1-465e-96da-583db02eb30d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:13.161659 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf4eae-90d1-465e-96da-583db02eb30d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:13.163264 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf4eae-90d1-465e-96da-583db02eb30d None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:13.164815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 10/19] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:22:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:13.170612 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf4eae-90d1-465e-96da-583db02eb30d None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:13.188717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27318c-bc81-4988-b390-21d78300bff2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:13.222466 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b2847-66cd-496b-82bf-2f311a46a3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:13.223089 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2847-66cd-496b-82bf-2f311a46a3e7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:13.223366 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2847-66cd-496b-82bf-2f311a46a3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:13.223631 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b2847-66cd-496b-82bf-2f311a46a3e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:13.224262 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b2847-66cd-496b-82bf-2f311a46a3e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:13.224561 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b2847-66cd-496b-82bf-2f311a46a3e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:13.225926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b2847-66cd-496b-82bf-2f311a46a3e7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:13.242888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 10/20] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:22:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:13.249402 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:13.271114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf4eae-90d1-465e-96da-583db02eb30d None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:13.308914 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da728585-701c-4e50-bee1-8da6ee08d5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:13.309601 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da728585-701c-4e50-bee1-8da6ee08d5b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:13.309892 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da728585-701c-4e50-bee1-8da6ee08d5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:13.310175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da728585-701c-4e50-bee1-8da6ee08d5b9 None admin] PATH_INFO: `/v3/domains/default/users/7f166e0661794d2b8c2ad033390437ec/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:13.312562 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da728585-701c-4e50-bee1-8da6ee08d5b9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7f166e0661794d2b8c2ad033390437ec, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:13.314051 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da728585-701c-4e50-bee1-8da6ee08d5b9 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:13.432956 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 11/21] 10.222.0.36 () {58 vars in 1361 bytes} [Thu Oct 20 13:22:13 2022] PUT /identity/v3/domains/default/users/7f166e0661794d2b8c2ad033390437ec/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:22:15.909525 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8de4-f4ad-414d-ada2-f2ebf0bd65b8 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:15.910044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8de4-f4ad-414d-ada2-f2ebf0bd65b8 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:15.910044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b8de4-f4ad-414d-ada2-f2ebf0bd65b8 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:15.911730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 11/22] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:15.917997 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567744c-36d9-4a36-a48e-99cc3544a66d None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:15.918430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567744c-36d9-4a36-a48e-99cc3544a66d None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:15.918598 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a567744c-36d9-4a36-a48e-99cc3544a66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:15.940035 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-a567744c-36d9-4a36-a48e-99cc3544a66d None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:15.941586 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a567744c-36d9-4a36-a48e-99cc3544a66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:15.954097 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bc992-eefa-4908-b5e4-661560ec1386 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:15.954386 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bc992-eefa-4908-b5e4-661560ec1386 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:15.954656 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669bc992-eefa-4908-b5e4-661560ec1386 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:15.956304 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 12/23] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:22:15.961559 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa708560-53e4-4a47-8fe4-fefebb259913 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:15.961852 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa708560-53e4-4a47-8fe4-fefebb259913 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:15.962126 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa708560-53e4-4a47-8fe4-fefebb259913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:15.996353 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-fa708560-53e4-4a47-8fe4-fefebb259913 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:15.997679 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-fa708560-53e4-4a47-8fe4-fefebb259913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:16.111826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 12/24] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:16.141638 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 13/25] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:16.156035 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38e6ea-cf6b-4e2c-8f68-f6dbc039ca36 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:16.156325 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38e6ea-cf6b-4e2c-8f68-f6dbc039ca36 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:16.156612 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38e6ea-cf6b-4e2c-8f68-f6dbc039ca36 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:16.160806 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 13/26] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:16.166714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c43450-8b99-4876-b459-6b1bfa3625b1 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:16.167035 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c43450-8b99-4876-b459-6b1bfa3625b1 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:16.167584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c43450-8b99-4876-b459-6b1bfa3625b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:16.195657 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c3c43450-8b99-4876-b459-6b1bfa3625b1 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:16.196941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c3c43450-8b99-4876-b459-6b1bfa3625b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:16.204267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:16.299038 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 14/27] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:16.326628 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf09481-2c18-4a4f-9b22-536973fff452 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:16.327283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf09481-2c18-4a4f-9b22-536973fff452 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:16.327798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf09481-2c18-4a4f-9b22-536973fff452 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:16.329382 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 14/28] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:16.335621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b5a20-e647-4008-99b3-0212b5e6cf0e None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:16.335905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b5a20-e647-4008-99b3-0212b5e6cf0e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:16.336186 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b5a20-e647-4008-99b3-0212b5e6cf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:16.359919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ae4b5a20-e647-4008-99b3-0212b5e6cf0e None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:16.361103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ae4b5a20-e647-4008-99b3-0212b5e6cf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:16.427913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf09481-2c18-4a4f-9b22-536973fff452 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:16.469225 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 15/29] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:16.551021 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:16.603342 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf09481-2c18-4a4f-9b22-536973fff452 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:16.609807 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b5a20-e647-4008-99b3-0212b5e6cf0e None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:16.667773 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e2fe3-6038-4bfa-8e11-daf177cb9d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:16.668451 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e2fe3-6038-4bfa-8e11-daf177cb9d8b None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:16.668738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e2fe3-6038-4bfa-8e11-daf177cb9d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:16.669016 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e2fe3-6038-4bfa-8e11-daf177cb9d8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:16.684091 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32e2fe3-6038-4bfa-8e11-daf177cb9d8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:16.689427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-e32e2fe3-6038-4bfa-8e11-daf177cb9d8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:22:16.689427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:16.689427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:16.689427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:16.689427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:16.689427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:16.689427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:16.689427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:16.689427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:16.689427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:16.689427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:16.689427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:16.689427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:16.689427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:16.689427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:16.689427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:16.690237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:16.690237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:16.690237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:16.690237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:16.690237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:16.690237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:16.690237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:16.690237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:16.690237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:16.690237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:16.690237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:16.690237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:16.690237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:16.690237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:16.690237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:16.690237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:16.691020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:16.691020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:16.691020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:16.691020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:16.691020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:16.691020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:16.691020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:16.691020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:16.691020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:16.691020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:16.691020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:22:16.691020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:22:16.693246 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 15/30] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:22:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:22:16.694836 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e2fe3-6038-4bfa-8e11-daf177cb9d8b None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:16.760166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:16.814195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b5a20-e647-4008-99b3-0212b5e6cf0e None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:16.875353 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e2fe3-6038-4bfa-8e11-daf177cb9d8b None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:16.879961 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d31c4-afea-47cc-baf6-358c36abe0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:16.880452 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d31c4-afea-47cc-baf6-358c36abe0d6 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:16.880737 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d31c4-afea-47cc-baf6-358c36abe0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:16.881016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d31c4-afea-47cc-baf6-358c36abe0d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:16.882998 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d31c4-afea-47cc-baf6-358c36abe0d6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:16.884402 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d31c4-afea-47cc-baf6-358c36abe0d6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:16.913512 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:16.920663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a48f0-80db-4e9d-a3aa-1378a90a81f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:16.921993 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a48f0-80db-4e9d-a3aa-1378a90a81f7 None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:16.922473 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a48f0-80db-4e9d-a3aa-1378a90a81f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:16.923004 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a48f0-80db-4e9d-a3aa-1378a90a81f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:16.923926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a48f0-80db-4e9d-a3aa-1378a90a81f7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:16.925690 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a48f0-80db-4e9d-a3aa-1378a90a81f7 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:16.945935 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 16/31] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Oct 20 13:22:16 2022] POST /identity/v3/roles => generated 225 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:22:16.947324 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a48f0-80db-4e9d-a3aa-1378a90a81f7 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:17.062693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 16/32] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Oct 20 13:22:16 2022] POST /identity/v3/roles => generated 219 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:22:17.065101 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d31c4-afea-47cc-baf6-358c36abe0d6 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:17.198902 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a48f0-80db-4e9d-a3aa-1378a90a81f7 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:17.247687 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d31c4-afea-47cc-baf6-358c36abe0d6 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:17.251279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f99781-5929-4d81-b676-0723a35f1f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:17.252233 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f99781-5929-4d81-b676-0723a35f1f0e None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:17.252786 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f99781-5929-4d81-b676-0723a35f1f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:17.253306 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f99781-5929-4d81-b676-0723a35f1f0e None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:17.254420 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f99781-5929-4d81-b676-0723a35f1f0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:17.255793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f99781-5929-4d81-b676-0723a35f1f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:17.258512 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f99781-5929-4d81-b676-0723a35f1f0e None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:17.276631 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 17/33] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:17.283243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f99781-5929-4d81-b676-0723a35f1f0e None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:17.313205 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:17.332904 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698f859-2ae4-444d-a563-8ebd52139a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:17.333097 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698f859-2ae4-444d-a563-8ebd52139a81 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:17.333384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698f859-2ae4-444d-a563-8ebd52139a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:17.333645 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698f859-2ae4-444d-a563-8ebd52139a81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:17.354329 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:17.360243 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698f859-2ae4-444d-a563-8ebd52139a81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:17.361887 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698f859-2ae4-444d-a563-8ebd52139a81 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:17.392765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f698f859-2ae4-444d-a563-8ebd52139a81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:22:17.392765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:17.392765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:17.392765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:17.392765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:17.392765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:17.392765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:17.392765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:17.392765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:17.392765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:17.392765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:17.392765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:17.392765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:22:17.392765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:22:17.392765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:22:17.392765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:22:17.393665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:17.393665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:17.393665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:17.393665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:17.393665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:17.393665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:17.393665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:17.393665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:17.393665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:17.393665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:17.393665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:17.393665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:17.393665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:17.393665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:17.393665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:17.393665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:17.393665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:22:17.394450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:22:17.394450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:22:17.394450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:17.396882 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 17/34] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:22:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:17.403117 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698f859-2ae4-444d-a563-8ebd52139a81 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:17.432661 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f99781-5929-4d81-b676-0723a35f1f0e None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:17.489298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c2cbb-8fbf-411e-a5eb-5d8b697f7bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:17.490028 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c2cbb-8fbf-411e-a5eb-5d8b697f7bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:17.490322 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c2cbb-8fbf-411e-a5eb-5d8b697f7bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:17.490723 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c2cbb-8fbf-411e-a5eb-5d8b697f7bf0 None admin] PATH_INFO: `/v3/users/7f166e0661794d2b8c2ad033390437ec` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:17.495688 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c2cbb-8fbf-411e-a5eb-5d8b697f7bf0 None admin] RBAC: Authorizing `identity:get_user(user_id=7f166e0661794d2b8c2ad033390437ec)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:17.497714 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c2cbb-8fbf-411e-a5eb-5d8b697f7bf0 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:17.499522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 18/35] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:17 2022] GET /identity/v3/users/7f166e0661794d2b8c2ad033390437ec => generated 247 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:17.507331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c2cbb-8fbf-411e-a5eb-5d8b697f7bf0 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:17.566692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698f859-2ae4-444d-a563-8ebd52139a81 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:17.611882 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5b3b0-eb8b-4017-ba83-23d916fcfd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:17.612942 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5b3b0-eb8b-4017-ba83-23d916fcfd17 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:17.613250 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5b3b0-eb8b-4017-ba83-23d916fcfd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:17.613530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5b3b0-eb8b-4017-ba83-23d916fcfd17 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:17.614184 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5b3b0-eb8b-4017-ba83-23d916fcfd17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:17.614853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5b3b0-eb8b-4017-ba83-23d916fcfd17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:17.617197 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5b3b0-eb8b-4017-ba83-23d916fcfd17 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:17.629437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 18/36] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:17.631213 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5830dd9-0086-4b19-baf7-d186c06a2749 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:17.631540 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5830dd9-0086-4b19-baf7-d186c06a2749 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:17.632066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5830dd9-0086-4b19-baf7-d186c06a2749 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:17.633276 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 19/37] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:17.635425 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5830dd9-0086-4b19-baf7-d186c06a2749 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:17.641107 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c2cbb-8fbf-411e-a5eb-5d8b697f7bf0 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:17.662013 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:17.677896 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e20cb7-c9a3-45c6-8415-ff376e208163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:17.679142 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e20cb7-c9a3-45c6-8415-ff376e208163 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:17.679430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e20cb7-c9a3-45c6-8415-ff376e208163 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:17.679712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e20cb7-c9a3-45c6-8415-ff376e208163 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:17.680853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e20cb7-c9a3-45c6-8415-ff376e208163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:17.682348 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e20cb7-c9a3-45c6-8415-ff376e208163 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:17.684056 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 19/38] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:22:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:17.685245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86cd9f-7055-4616-85c6-1c01b89021ec None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:17.685535 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86cd9f-7055-4616-85c6-1c01b89021ec None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:17.685811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86cd9f-7055-4616-85c6-1c01b89021ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:17.691439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:17.712597 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-9d86cd9f-7055-4616-85c6-1c01b89021ec None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:17.713828 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9d86cd9f-7055-4616-85c6-1c01b89021ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:17.756077 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5830dd9-0086-4b19-baf7-d186c06a2749 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:17.785332 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 20/39] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:17.785953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86cd9f-7055-4616-85c6-1c01b89021ec None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:17.799577 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e07680-d81a-4766-bdc6-2ccdbcdccda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:17.800190 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07680-d81a-4766-bdc6-2ccdbcdccda2 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:17.800467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07680-d81a-4766-bdc6-2ccdbcdccda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:17.800740 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e07680-d81a-4766-bdc6-2ccdbcdccda2 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:17.801405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e07680-d81a-4766-bdc6-2ccdbcdccda2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:17.802827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e07680-d81a-4766-bdc6-2ccdbcdccda2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:17.832198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 20/40] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Oct 20 13:22:17 2022] POST /identity/v3/projects => generated 301 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:22:17.833420 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ed5e8-c8f0-400b-9416-444a2fac4926 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:17.833711 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ed5e8-c8f0-400b-9416-444a2fac4926 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:17.833984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ed5e8-c8f0-400b-9416-444a2fac4926 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:17.835904 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 21/41] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:17.841539 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4114c-f485-4714-9fb7-4e11d769a40d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:17.841865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4114c-f485-4714-9fb7-4e11d769a40d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:17.842085 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4114c-f485-4714-9fb7-4e11d769a40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:17.863051 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-35f4114c-f485-4714-9fb7-4e11d769a40d None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:17.864761 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-35f4114c-f485-4714-9fb7-4e11d769a40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:17.924541 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86cd9f-7055-4616-85c6-1c01b89021ec None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:17.946073 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:17.951729 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 22/42] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:17.966407 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09291f43-fd56-4807-9894-e55851188562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:17.967083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09291f43-fd56-4807-9894-e55851188562 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:17.967371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09291f43-fd56-4807-9894-e55851188562 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:17.967647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09291f43-fd56-4807-9894-e55851188562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:17.968405 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09291f43-fd56-4807-9894-e55851188562 None admin] RBAC: Adding query filter params (role.id=9c0f227afc2e4a0aa404780de229488c, scope.domain.id=default, user.id=7f166e0661794d2b8c2ad033390437ec) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:17.968771 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09291f43-fd56-4807-9894-e55851188562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:17.970267 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09291f43-fd56-4807-9894-e55851188562 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:17.979936 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1322 bytes} [Thu Oct 20 13:22:17 2022] GET /identity/v3/role_assignments?user.id=7f166e0661794d2b8c2ad033390437ec&scope.domain.id=default&role.id=9c0f227afc2e4a0aa404780de229488c => generated 530 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:18.082228 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4114c-f485-4714-9fb7-4e11d769a40d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:18.110417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:18.196022 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4114c-f485-4714-9fb7-4e11d769a40d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:18.230723 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09291f43-fd56-4807-9894-e55851188562 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:18.230930 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598bcbd-8d22-4a7c-8be7-ddff3420e09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:18.231568 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598bcbd-8d22-4a7c-8be7-ddff3420e09d None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:18.231908 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598bcbd-8d22-4a7c-8be7-ddff3420e09d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:18.232190 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598bcbd-8d22-4a7c-8be7-ddff3420e09d None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:18.232863 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598bcbd-8d22-4a7c-8be7-ddff3420e09d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:18.235299 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598bcbd-8d22-4a7c-8be7-ddff3420e09d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:18.251194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Oct 20 13:22:18 2022] POST /identity/v3/roles => generated 223 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:22:18.446152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09291f43-fd56-4807-9894-e55851188562 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:18.481750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b00f2-5e3f-4e74-8dc0-6f8ade1dffea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:18.482388 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b00f2-5e3f-4e74-8dc0-6f8ade1dffea None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:18.482672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b00f2-5e3f-4e74-8dc0-6f8ade1dffea None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:18.483010 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b00f2-5e3f-4e74-8dc0-6f8ade1dffea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:18.484102 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b00f2-5e3f-4e74-8dc0-6f8ade1dffea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:18.485615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b00f2-5e3f-4e74-8dc0-6f8ade1dffea None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:18.487235 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 22/45] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:22:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:18.493104 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598bcbd-8d22-4a7c-8be7-ddff3420e09d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:18.575342 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:18.592094 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598bcbd-8d22-4a7c-8be7-ddff3420e09d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:18.625047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7cc12-eee0-4a19-a084-876373143777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:18.625649 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7cc12-eee0-4a19-a084-876373143777 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:18.625933 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7cc12-eee0-4a19-a084-876373143777 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:18.626208 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7cc12-eee0-4a19-a084-876373143777 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:18.626850 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7cc12-eee0-4a19-a084-876373143777 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:18.628328 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7cc12-eee0-4a19-a084-876373143777 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:18.654041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Oct 20 13:22:18 2022] POST /identity/v3/projects => generated 312 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:22:20.781111 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b399739-1fc7-4258-8b61-483af56cf991 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:20.781628 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b399739-1fc7-4258-8b61-483af56cf991 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:20.781710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b399739-1fc7-4258-8b61-483af56cf991 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:20.783034 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 23/47] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:20.788184 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b25efe-a58e-4314-a3f7-b249d0c4e971 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:20.788622 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b25efe-a58e-4314-a3f7-b249d0c4e971 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:20.788856 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b25efe-a58e-4314-a3f7-b249d0c4e971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:20.807801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-55b25efe-a58e-4314-a3f7-b249d0c4e971 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:20.808986 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-55b25efe-a58e-4314-a3f7-b249d0c4e971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:20.874875 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 25/48] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:21.147128 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b399739-1fc7-4258-8b61-483af56cf991 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:21.197819 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:21.247966 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b399739-1fc7-4258-8b61-483af56cf991 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:21.280283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79a51f-f303-441c-aa0a-12966a55bb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:21.280906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79a51f-f303-441c-aa0a-12966a55bb4e None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:21.281189 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79a51f-f303-441c-aa0a-12966a55bb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:21.281465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79a51f-f303-441c-aa0a-12966a55bb4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:21.282578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79a51f-f303-441c-aa0a-12966a55bb4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:21.284054 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79a51f-f303-441c-aa0a-12966a55bb4e None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:21.285611 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 24/49] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:22:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:21.291735 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b25efe-a58e-4314-a3f7-b249d0c4e971 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:21.458493 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:21.493205 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b25efe-a58e-4314-a3f7-b249d0c4e971 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:21.526490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec6d72-4dde-4882-bc9d-c40f746c21c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:21.527139 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec6d72-4dde-4882-bc9d-c40f746c21c6 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:21.527421 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec6d72-4dde-4882-bc9d-c40f746c21c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:21.527697 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec6d72-4dde-4882-bc9d-c40f746c21c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:21.528337 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec6d72-4dde-4882-bc9d-c40f746c21c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:21.529758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec6d72-4dde-4882-bc9d-c40f746c21c6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:21.555502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1140 bytes} [Thu Oct 20 13:22:21 2022] POST /identity/v3/projects => generated 298 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:22:23.672148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c521fc8-ac9b-49bb-9ae0-2db467f2b5dc None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:23.672666 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c521fc8-ac9b-49bb-9ae0-2db467f2b5dc None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:23.672749 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c521fc8-ac9b-49bb-9ae0-2db467f2b5dc None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:23.674035 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 25/51] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:23.679147 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb9c55-b959-44c5-8fbf-c65e91b00de7 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:23.679518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb9c55-b959-44c5-8fbf-c65e91b00de7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:23.679695 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb9c55-b959-44c5-8fbf-c65e91b00de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:23.697123 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-efbb9c55-b959-44c5-8fbf-c65e91b00de7 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:23.698295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-efbb9c55-b959-44c5-8fbf-c65e91b00de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:23.761099 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 27/52] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:24.031404 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c521fc8-ac9b-49bb-9ae0-2db467f2b5dc None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:24.131568 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c521fc8-ac9b-49bb-9ae0-2db467f2b5dc None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:24.149334 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:24.165955 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f166d06-290c-47d6-89e9-d4c9293e641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:24.166585 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f166d06-290c-47d6-89e9-d4c9293e641a None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:24.166865 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f166d06-290c-47d6-89e9-d4c9293e641a None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:24.167431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f166d06-290c-47d6-89e9-d4c9293e641a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:24.168542 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f166d06-290c-47d6-89e9-d4c9293e641a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:24.169979 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f166d06-290c-47d6-89e9-d4c9293e641a None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:24.171568 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:22:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:24.177003 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb9c55-b959-44c5-8fbf-c65e91b00de7 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:24.225302 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:24.274841 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb9c55-b959-44c5-8fbf-c65e91b00de7 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:24.307412 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1c5e8-1c69-4fc3-b792-1040c436bda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:24.307955 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1c5e8-1c69-4fc3-b792-1040c436bda6 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:24.308233 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1c5e8-1c69-4fc3-b792-1040c436bda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:24.308505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1c5e8-1c69-4fc3-b792-1040c436bda6 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:24.309146 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1c5e8-1c69-4fc3-b792-1040c436bda6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:24.310573 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1c5e8-1c69-4fc3-b792-1040c436bda6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:24.337321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 28/54] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:22:24 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:22:27.636901 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8163f7-75f2-4594-ad62-f152564b4104 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:27.637937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8163f7-75f2-4594-ad62-f152564b4104 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:27.638420 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8163f7-75f2-4594-ad62-f152564b4104 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:27.640013 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 27/55] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:27.645458 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b6530-6a28-429e-9d12-3602a672368b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:27.646299 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b6530-6a28-429e-9d12-3602a672368b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:27.646801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b6530-6a28-429e-9d12-3602a672368b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:27.659465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2baa38-e831-46b9-918b-80d13d2237bf None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:27.660059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2baa38-e831-46b9-918b-80d13d2237bf None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:27.660529 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2baa38-e831-46b9-918b-80d13d2237bf None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:27.662584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 28/56] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:22:27.668913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988142ce-8f62-46e6-b046-1d0102ec4925 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:27.669458 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988142ce-8f62-46e6-b046-1d0102ec4925 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:27.669928 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988142ce-8f62-46e6-b046-1d0102ec4925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:27.672461 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-3d5b6530-6a28-429e-9d12-3602a672368b None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:27.673660 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3d5b6530-6a28-429e-9d12-3602a672368b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:27.701895 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-988142ce-8f62-46e6-b046-1d0102ec4925 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:27.703744 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-988142ce-8f62-46e6-b046-1d0102ec4925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:27.768309 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 29/57] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:27.769890 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbb910-2257-4fc3-99ce-a326eaddc2c5 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:27.770346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbb910-2257-4fc3-99ce-a326eaddc2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:27.770803 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbb910-2257-4fc3-99ce-a326eaddc2c5 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:27.772315 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 30/58] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:27.782463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8d614-63dc-4747-b793-de3c7d64ad25 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:27.783040 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8d614-63dc-4747-b793-de3c7d64ad25 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:27.783519 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8d614-63dc-4747-b793-de3c7d64ad25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:27.812287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 29/59] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:27.813731 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-f5a8d614-63dc-4747-b793-de3c7d64ad25 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:27.815213 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f5a8d614-63dc-4747-b793-de3c7d64ad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:27.867370 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:27.920907 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 31/60] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:28.075953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988142ce-8f62-46e6-b046-1d0102ec4925 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:28.093289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8d614-63dc-4747-b793-de3c7d64ad25 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:28.217507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988142ce-8f62-46e6-b046-1d0102ec4925 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:28.232544 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8d614-63dc-4747-b793-de3c7d64ad25 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:28.236637 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:28.254836 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd1471-8b9a-45c4-9b82-590b7da94a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:28.255860 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd1471-8b9a-45c4-9b82-590b7da94a57 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:28.256175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd1471-8b9a-45c4-9b82-590b7da94a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:28.256528 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd1471-8b9a-45c4-9b82-590b7da94a57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:28.267411 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd1471-8b9a-45c4-9b82-590b7da94a57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:28.273078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-2fdd1471-8b9a-45c4-9b82-590b7da94a57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:28.273078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:28.273078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:28.273078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:28.273078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:28.273078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:28.273078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:28.273078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:28.273078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:28.273078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:28.273078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:28.273078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:28.273078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:28.273078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:28.273078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:28.273078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:28.273908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:28.273908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:28.273908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:28.273908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:28.273908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:28.273908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:28.273908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:28.273908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:28.273908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:28.273908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:28.273908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:28.273908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:28.273908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:28.273908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:28.273908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:28.273908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:28.274672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:28.274672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:28.274672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:28.274672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:28.274672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:28.274672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:28.274672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:28.274672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:28.274672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:28.274672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:28.274672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:28.274672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:22:28.274672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:28.276648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de2928-3ec7-4be3-a625-18e7fd10e16d None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:28.276648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de2928-3ec7-4be3-a625-18e7fd10e16d None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:28.276986 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de2928-3ec7-4be3-a625-18e7fd10e16d None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:28.278285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 31/62] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:28.280417 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de2928-3ec7-4be3-a625-18e7fd10e16d None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:28.283092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488918b5-21f2-4ce4-af9f-beece39c3055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:28.283848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488918b5-21f2-4ce4-af9f-beece39c3055 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:28.284137 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488918b5-21f2-4ce4-af9f-beece39c3055 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:28.284416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488918b5-21f2-4ce4-af9f-beece39c3055 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:28.301783 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488918b5-21f2-4ce4-af9f-beece39c3055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:28.310620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-488918b5-21f2-4ce4-af9f-beece39c3055 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:22:28.310620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:28.310620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:28.310620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:28.310620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:28.310620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:28.310620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:28.310620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:28.310620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:28.310620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:28.310620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:28.310620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:28.310620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:28.310620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:28.310620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:28.310620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:28.313037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:28.313037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:28.313037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:28.313037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:28.313037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:28.313037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:28.313037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:28.313037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:28.313037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:28.313037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:28.313037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:28.313037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:28.313037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:28.313037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:28.313037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:28.313037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:28.314417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:28.314417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:28.314417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:28.314417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:28.314417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:28.314417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:28.314417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:28.314417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:28.314417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:28.314417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:28.314417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:22:28.314417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:28.314417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 32/63] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Oct 20 13:22:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:22:28.314417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd0712-0822-47aa-bd66-cab77ce2f9e6 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:28.315388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd0712-0822-47aa-bd66-cab77ce2f9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:28.315388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd0712-0822-47aa-bd66-cab77ce2f9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:28.343152 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-6bcd0712-0822-47aa-bd66-cab77ce2f9e6 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:28.344630 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6bcd0712-0822-47aa-bd66-cab77ce2f9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:28.362303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:28.397168 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de2928-3ec7-4be3-a625-18e7fd10e16d None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:28.430984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 33/64] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:28.430984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd0712-0822-47aa-bd66-cab77ce2f9e6 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:28.448378 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfff4b-50e8-40f5-b7de-4443734177b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:28.449234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfff4b-50e8-40f5-b7de-4443734177b2 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:28.449595 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfff4b-50e8-40f5-b7de-4443734177b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:28.449974 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfff4b-50e8-40f5-b7de-4443734177b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:28.450797 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfff4b-50e8-40f5-b7de-4443734177b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:28.451215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfff4b-50e8-40f5-b7de-4443734177b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:28.452778 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfff4b-50e8-40f5-b7de-4443734177b2 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:28.462626 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 32/65] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:22:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:28.463581 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfff4b-50e8-40f5-b7de-4443734177b2 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:28.507916 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:28.550690 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd0712-0822-47aa-bd66-cab77ce2f9e6 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:28.575708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfff4b-50e8-40f5-b7de-4443734177b2 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:28.592689 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2c323-72e0-4b2f-92c1-1b7112110a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:28.593847 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c323-72e0-4b2f-92c1-1b7112110a33 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:28.594739 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c323-72e0-4b2f-92c1-1b7112110a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:28.595243 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da2c323-72e0-4b2f-92c1-1b7112110a33 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:28.596108 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2c323-72e0-4b2f-92c1-1b7112110a33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:28.596610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2c323-72e0-4b2f-92c1-1b7112110a33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:28.598995 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da2c323-72e0-4b2f-92c1-1b7112110a33 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:28.611260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d90813-a1dc-4280-904b-f6b65e909c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:28.611920 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d90813-a1dc-4280-904b-f6b65e909c47 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:28.612293 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d90813-a1dc-4280-904b-f6b65e909c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:28.612551 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d90813-a1dc-4280-904b-f6b65e909c47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:28.614975 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 34/66] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:22:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:28.616472 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2c323-72e0-4b2f-92c1-1b7112110a33 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:28.624917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d90813-a1dc-4280-904b-f6b65e909c47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:28.630279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-66d90813-a1dc-4280-904b-f6b65e909c47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:22:28.630279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:28.630279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:28.630279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:28.630279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:28.630279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:28.630279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:28.630279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:28.630279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:28.630279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:28.630279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:28.630279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:28.630279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:28.630279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:28.630279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:28.630279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:28.631705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:28.631705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:28.631705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:28.631705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:28.631705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:28.631705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:28.631705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:28.631705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:28.631705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:28.631705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:28.631705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:28.631705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:28.631705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:28.631705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:28.631705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:28.631705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:28.632508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:28.632508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:28.632508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:28.632508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:28.632508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:28.632508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:28.632508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:28.632508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:28.632508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:28.632508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:28.632508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:22:28.632508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:22:28.632508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 33/67] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:22:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:28.633140 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59748bb9-cf8e-4654-82d8-3f1327768db4 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:28.638826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59748bb9-cf8e-4654-82d8-3f1327768db4 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:28.638826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59748bb9-cf8e-4654-82d8-3f1327768db4 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:28.638826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 34/68] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:28.638826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59748bb9-cf8e-4654-82d8-3f1327768db4 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:28.645401 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:28.731424 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da2c323-72e0-4b2f-92c1-1b7112110a33 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:28.739022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:28.744819 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59748bb9-cf8e-4654-82d8-3f1327768db4 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:28.765350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86502a4-d307-4fb5-a4b4-5320cd2bb4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:28.765912 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86502a4-d307-4fb5-a4b4-5320cd2bb4db None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:28.766194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86502a4-d307-4fb5-a4b4-5320cd2bb4db None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:28.766473 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86502a4-d307-4fb5-a4b4-5320cd2bb4db None admin] PATH_INFO: `/v3/users/50d1e52d676e4e008bf20b30460feb3a` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:28.777963 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2118d-8e9f-4241-99c6-03930d5dd3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:28.778601 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2118d-8e9f-4241-99c6-03930d5dd3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:28.778884 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2118d-8e9f-4241-99c6-03930d5dd3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:28.779190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2118d-8e9f-4241-99c6-03930d5dd3b0 None admin] PATH_INFO: `/v3/users/50d1e52d676e4e008bf20b30460feb3a` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:28.781319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86502a4-d307-4fb5-a4b4-5320cd2bb4db None admin] RBAC: Authorizing `identity:get_user(user_id=50d1e52d676e4e008bf20b30460feb3a)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:28.782779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86502a4-d307-4fb5-a4b4-5320cd2bb4db None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:28.784603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 35/69] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:28 2022] GET /identity/v3/users/50d1e52d676e4e008bf20b30460feb3a => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:28.785183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86502a4-d307-4fb5-a4b4-5320cd2bb4db None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:28.795535 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2118d-8e9f-4241-99c6-03930d5dd3b0 None admin] RBAC: Authorizing `identity:get_user(user_id=50d1e52d676e4e008bf20b30460feb3a)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:28.796984 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e2118d-8e9f-4241-99c6-03930d5dd3b0 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:28.798633 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 35/70] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:28 2022] GET /identity/v3/users/50d1e52d676e4e008bf20b30460feb3a => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:28.799813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e701e3-5c9d-45da-94ca-724d5d0c1851 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:28.800098 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e701e3-5c9d-45da-94ca-724d5d0c1851 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:28.800377 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e701e3-5c9d-45da-94ca-724d5d0c1851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:28.819081 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-12e701e3-5c9d-45da-94ca-724d5d0c1851 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:28.820284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-12e701e3-5c9d-45da-94ca-724d5d0c1851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:28.863827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:28.888908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 36/71] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:28.890054 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e701e3-5c9d-45da-94ca-724d5d0c1851 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:28.890264 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86502a4-d307-4fb5-a4b4-5320cd2bb4db None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:28.928776 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94148a35-99ef-4cd1-a424-b626f3cc8c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:28.929545 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94148a35-99ef-4cd1-a424-b626f3cc8c1f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:28.929830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94148a35-99ef-4cd1-a424-b626f3cc8c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:28.930107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94148a35-99ef-4cd1-a424-b626f3cc8c1f None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:28.930767 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94148a35-99ef-4cd1-a424-b626f3cc8c1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:28.931100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94148a35-99ef-4cd1-a424-b626f3cc8c1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:28.932479 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94148a35-99ef-4cd1-a424-b626f3cc8c1f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:28.940474 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 36/72] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:28.945671 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94148a35-99ef-4cd1-a424-b626f3cc8c1f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:28.992047 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:29.010005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e701e3-5c9d-45da-94ca-724d5d0c1851 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:29.045203 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29fde2-5772-4662-b88d-21e281ea6e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:29.045926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29fde2-5772-4662-b88d-21e281ea6e0c None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:29.046214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29fde2-5772-4662-b88d-21e281ea6e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:29.046490 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29fde2-5772-4662-b88d-21e281ea6e0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:29.051564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94148a35-99ef-4cd1-a424-b626f3cc8c1f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:29.057642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29fde2-5772-4662-b88d-21e281ea6e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:29.062491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-4f29fde2-5772-4662-b88d-21e281ea6e0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:29.062491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:29.062491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:29.062491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:29.062491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:29.062491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:29.062491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:29.062491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:29.062491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:29.062491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:29.062491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:29.062491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:29.062491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:29.062491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:29.062491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:29.062491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:29.063321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:29.063321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:29.063321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:29.063321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:29.063321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:29.063321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:29.063321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:29.063321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:29.063321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:29.063321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:29.063321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:29.063321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:29.063321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:29.063321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:29.063321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:29.063321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:29.064105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:29.064105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:29.064105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:29.064105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:29.064105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:29.064105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:29.064105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:29.064105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:29.064105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:29.064105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:29.064105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:29.064105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:22:29.064105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 37/73] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:29.065496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29fde2-5772-4662-b88d-21e281ea6e0c None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:29.096130 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf0109-5613-46eb-a3aa-b7cf110e1126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:29.096971 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf0109-5613-46eb-a3aa-b7cf110e1126 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:29.097399 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf0109-5613-46eb-a3aa-b7cf110e1126 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:29.097676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf0109-5613-46eb-a3aa-b7cf110e1126 None admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:29.098831 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf0109-5613-46eb-a3aa-b7cf110e1126 None admin] RBAC: Authorizing `identity:get_project(project_id=25e961400d214cb99f377dbe63b7b8f7)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:29.100527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf0109-5613-46eb-a3aa-b7cf110e1126 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:29.106681 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 37/74] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:28 2022] GET /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:29.106681 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf0109-5613-46eb-a3aa-b7cf110e1126 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:29.111586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:29.171874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29fde2-5772-4662-b88d-21e281ea6e0c None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:29.206115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4f3c3-7c8e-47fb-8beb-b8fdfce6ee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:29.206765 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4f3c3-7c8e-47fb-8beb-b8fdfce6ee01 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:29.207088 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4f3c3-7c8e-47fb-8beb-b8fdfce6ee01 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:29.207365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4f3c3-7c8e-47fb-8beb-b8fdfce6ee01 None admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:29.208490 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4f3c3-7c8e-47fb-8beb-b8fdfce6ee01 None admin] RBAC: Authorizing `identity:get_project(project_id=25e961400d214cb99f377dbe63b7b8f7)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:29.210098 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4f3c3-7c8e-47fb-8beb-b8fdfce6ee01 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:29.210743 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf0109-5613-46eb-a3aa-b7cf110e1126 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:29.211800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 38/75] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:29 2022] GET /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:29.212557 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4f3c3-7c8e-47fb-8beb-b8fdfce6ee01 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:29.231246 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:29.244791 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc882f8-e538-46ec-9dbc-81c12358da0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:29.245419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc882f8-e538-46ec-9dbc-81c12358da0c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:29.245698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc882f8-e538-46ec-9dbc-81c12358da0c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:29.245971 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc882f8-e538-46ec-9dbc-81c12358da0c None admin] PATH_INFO: `/v3/users/7f166e0661794d2b8c2ad033390437ec` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:29.247121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc882f8-e538-46ec-9dbc-81c12358da0c None admin] RBAC: Authorizing `identity:get_user(user_id=7f166e0661794d2b8c2ad033390437ec)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:29.248565 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc882f8-e538-46ec-9dbc-81c12358da0c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:29.250127 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 38/76] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:29 2022] GET /identity/v3/users/7f166e0661794d2b8c2ad033390437ec => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:29.250858 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc882f8-e538-46ec-9dbc-81c12358da0c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:29.319233 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:29.320195 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4f3c3-7c8e-47fb-8beb-b8fdfce6ee01 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:29.349334 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc882f8-e538-46ec-9dbc-81c12358da0c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:29.353688 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a329fb6-eb4c-40a7-89cc-9900260802e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:29.354300 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a329fb6-eb4c-40a7-89cc-9900260802e7 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:29.354584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a329fb6-eb4c-40a7-89cc-9900260802e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:29.354861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a329fb6-eb4c-40a7-89cc-9900260802e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:29.355552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a329fb6-eb4c-40a7-89cc-9900260802e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:29.355856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a329fb6-eb4c-40a7-89cc-9900260802e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:29.357264 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a329fb6-eb4c-40a7-89cc-9900260802e7 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:29.365627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 39/77] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:22:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:29.366430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a329fb6-eb4c-40a7-89cc-9900260802e7 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:29.384076 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83966879-f2c6-423e-90fd-ad3c192f67aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:29.384732 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83966879-f2c6-423e-90fd-ad3c192f67aa None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:29.385011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83966879-f2c6-423e-90fd-ad3c192f67aa None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:29.385283 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83966879-f2c6-423e-90fd-ad3c192f67aa None admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7/users/50d1e52d676e4e008bf20b30460feb3a/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:29.387246 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83966879-f2c6-423e-90fd-ad3c192f67aa None admin] RBAC: Authorizing `identity:create_grant(project_id=25e961400d214cb99f377dbe63b7b8f7, user_id=50d1e52d676e4e008bf20b30460feb3a, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:29.388696 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83966879-f2c6-423e-90fd-ad3c192f67aa None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:29.402783 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 39/78] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:22:29 2022] PUT /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7/users/50d1e52d676e4e008bf20b30460feb3a/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:22:29.403579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83966879-f2c6-423e-90fd-ad3c192f67aa None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:29.465177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:29.492888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a329fb6-eb4c-40a7-89cc-9900260802e7 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:29.529974 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83966879-f2c6-423e-90fd-ad3c192f67aa None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:29.532472 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0c78e-85f8-4ae8-b21a-c2493b9e5842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:29.533149 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0c78e-85f8-4ae8-b21a-c2493b9e5842 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:29.533436 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0c78e-85f8-4ae8-b21a-c2493b9e5842 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:29.533719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0c78e-85f8-4ae8-b21a-c2493b9e5842 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:29.534923 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0c78e-85f8-4ae8-b21a-c2493b9e5842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:29.536445 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0c78e-85f8-4ae8-b21a-c2493b9e5842 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:29.543762 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 40/79] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:22:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:29.543762 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0c78e-85f8-4ae8-b21a-c2493b9e5842 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:29.569937 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:29.576285 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fea33-3de2-4def-948a-bf76f89694b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:29.576992 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fea33-3de2-4def-948a-bf76f89694b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:29.578222 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fea33-3de2-4def-948a-bf76f89694b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:29.578502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3fea33-3de2-4def-948a-bf76f89694b6 None admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7/users/50d1e52d676e4e008bf20b30460feb3a/roles/c63cd01b72aa49d5932f4b4f762fdf5c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:29.581299 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fea33-3de2-4def-948a-bf76f89694b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=25e961400d214cb99f377dbe63b7b8f7, user_id=50d1e52d676e4e008bf20b30460feb3a, role_id=c63cd01b72aa49d5932f4b4f762fdf5c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:29.582751 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3fea33-3de2-4def-948a-bf76f89694b6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:29.597700 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 40/80] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:22:29 2022] PUT /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7/users/50d1e52d676e4e008bf20b30460feb3a/roles/c63cd01b72aa49d5932f4b4f762fdf5c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:22:29.598539 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fea33-3de2-4def-948a-bf76f89694b6 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:29.677017 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0c78e-85f8-4ae8-b21a-c2493b9e5842 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:29.728754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d238e-ac0b-4bc5-ac40-5d51f75ed64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:29.729412 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d238e-ac0b-4bc5-ac40-5d51f75ed64f None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:29.729952 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d238e-ac0b-4bc5-ac40-5d51f75ed64f None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:29.730238 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d238e-ac0b-4bc5-ac40-5d51f75ed64f None admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:29.731924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d238e-ac0b-4bc5-ac40-5d51f75ed64f None admin] RBAC: Authorizing `identity:get_project(project_id=25e961400d214cb99f377dbe63b7b8f7)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:29.733799 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d238e-ac0b-4bc5-ac40-5d51f75ed64f None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:29.734648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3fea33-3de2-4def-948a-bf76f89694b6 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:29.735647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 41/81] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:29 2022] GET /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:29.736442 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d238e-ac0b-4bc5-ac40-5d51f75ed64f None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:29.760958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:29.785284 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392faac-83a6-4a56-87d2-0de4c4cbcb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:29.785950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392faac-83a6-4a56-87d2-0de4c4cbcb4f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:29.786581 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392faac-83a6-4a56-87d2-0de4c4cbcb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:29.786938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392faac-83a6-4a56-87d2-0de4c4cbcb4f None admin] PATH_INFO: `/v3/users/50d1e52d676e4e008bf20b30460feb3a` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:29.788431 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392faac-83a6-4a56-87d2-0de4c4cbcb4f None admin] RBAC: Authorizing `identity:get_user(user_id=50d1e52d676e4e008bf20b30460feb3a)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:29.789904 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392faac-83a6-4a56-87d2-0de4c4cbcb4f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:29.791731 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 41/82] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:29 2022] GET /identity/v3/users/50d1e52d676e4e008bf20b30460feb3a => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:29.792648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392faac-83a6-4a56-87d2-0de4c4cbcb4f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:29.864063 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:29.870371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d238e-ac0b-4bc5-ac40-5d51f75ed64f None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:29.907611 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392faac-83a6-4a56-87d2-0de4c4cbcb4f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:29.912446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274db34c-8299-4a5b-ad0b-26b8c5910cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:29.913074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274db34c-8299-4a5b-ad0b-26b8c5910cef None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:29.913448 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274db34c-8299-4a5b-ad0b-26b8c5910cef None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:29.913639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274db34c-8299-4a5b-ad0b-26b8c5910cef None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:29.914325 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274db34c-8299-4a5b-ad0b-26b8c5910cef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:29.915824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274db34c-8299-4a5b-ad0b-26b8c5910cef None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:29.945343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609e708-160b-4b25-ae8a-226499b30e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:29.946059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609e708-160b-4b25-ae8a-226499b30e78 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:29.946346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609e708-160b-4b25-ae8a-226499b30e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:29.946622 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609e708-160b-4b25-ae8a-226499b30e78 None admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7/users/7f166e0661794d2b8c2ad033390437ec/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:29.948205 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 42/83] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:22:29 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:22:29.948661 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609e708-160b-4b25-ae8a-226499b30e78 None admin] RBAC: Authorizing `identity:create_grant(project_id=25e961400d214cb99f377dbe63b7b8f7, user_id=7f166e0661794d2b8c2ad033390437ec, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:29.950229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609e708-160b-4b25-ae8a-226499b30e78 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:29.955692 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274db34c-8299-4a5b-ad0b-26b8c5910cef None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:29.976087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 42/84] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:22:29 2022] PUT /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7/users/7f166e0661794d2b8c2ad033390437ec/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:22:30.053971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:30.102659 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274db34c-8299-4a5b-ad0b-26b8c5910cef None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:30.152219 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8d974-e70a-4d88-be37-ee47e8ec8ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:30.153211 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8d974-e70a-4d88-be37-ee47e8ec8ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:30.153687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8d974-e70a-4d88-be37-ee47e8ec8ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:30.154174 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8d974-e70a-4d88-be37-ee47e8ec8ba7 None admin] PATH_INFO: `/v3/projects/d170f4763b244bde849ef79fb7b6b028` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:30.159952 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8d974-e70a-4d88-be37-ee47e8ec8ba7 None admin] RBAC: Authorizing `identity:get_project(project_id=d170f4763b244bde849ef79fb7b6b028)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:30.162345 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8d974-e70a-4d88-be37-ee47e8ec8ba7 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:30.164605 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 43/85] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:29 2022] GET /identity/v3/projects/d170f4763b244bde849ef79fb7b6b028 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:30.176250 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609e708-160b-4b25-ae8a-226499b30e78 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:30.305905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609e708-160b-4b25-ae8a-226499b30e78 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:30.327311 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:30.343988 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889c580-6bde-4622-ba63-78510c052db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:30.344709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889c580-6bde-4622-ba63-78510c052db6 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:30.344993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889c580-6bde-4622-ba63-78510c052db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:30.345262 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889c580-6bde-4622-ba63-78510c052db6 None admin] PATH_INFO: `/v3/projects/d170f4763b244bde849ef79fb7b6b028/users/50d1e52d676e4e008bf20b30460feb3a/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:30.347314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889c580-6bde-4622-ba63-78510c052db6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d170f4763b244bde849ef79fb7b6b028, user_id=50d1e52d676e4e008bf20b30460feb3a, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:30.348814 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889c580-6bde-4622-ba63-78510c052db6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:30.369331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 43/86] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:22:30 2022] PUT /identity/v3/projects/d170f4763b244bde849ef79fb7b6b028/users/50d1e52d676e4e008bf20b30460feb3a/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:22:32.363964 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57e0a7-6cc9-47c0-99c9-492e5df130de None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:32.364517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57e0a7-6cc9-47c0-99c9-492e5df130de None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:32.364517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57e0a7-6cc9-47c0-99c9-492e5df130de None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:32.368555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 44/87] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:32.389498 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeced687-e16b-4360-bbe8-389b06a796c4 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:32.389997 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeced687-e16b-4360-bbe8-389b06a796c4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:32.390068 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeced687-e16b-4360-bbe8-389b06a796c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:32.424346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-eeced687-e16b-4360-bbe8-389b06a796c4 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:32.425565 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-eeced687-e16b-4360-bbe8-389b06a796c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:32.558876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 44/88] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:32.619702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9731f-08bc-442b-a46d-75e400016da2 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:32.619981 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9731f-08bc-442b-a46d-75e400016da2 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:32.620185 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9731f-08bc-442b-a46d-75e400016da2 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:32.621664 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 45/89] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:32.627209 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e495c33-49ba-4eab-b1e3-c9c5fa5945be None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:32.627503 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e495c33-49ba-4eab-b1e3-c9c5fa5945be None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:32.627784 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e495c33-49ba-4eab-b1e3-c9c5fa5945be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:32.656325 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-6e495c33-49ba-4eab-b1e3-c9c5fa5945be None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:32.657525 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6e495c33-49ba-4eab-b1e3-c9c5fa5945be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:32.741637 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 45/90] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:32.991899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9731f-08bc-442b-a46d-75e400016da2 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:33.106107 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9731f-08bc-442b-a46d-75e400016da2 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:33.114339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b697a-2c4d-4070-8be2-b755bcb0c186 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:33.114678 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b697a-2c4d-4070-8be2-b755bcb0c186 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:33.115481 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701b697a-2c4d-4070-8be2-b755bcb0c186 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:33.117362 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 46/91] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:33.128241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373d7af-8049-4ac9-9f81-c84ba2899ea6 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:33.128793 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373d7af-8049-4ac9-9f81-c84ba2899ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:33.129262 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373d7af-8049-4ac9-9f81-c84ba2899ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:33.142332 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf653a-4b3a-49a4-9aef-a831fb542c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:33.142987 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf653a-4b3a-49a4-9aef-a831fb542c8d None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:33.143287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf653a-4b3a-49a4-9aef-a831fb542c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:33.143546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf653a-4b3a-49a4-9aef-a831fb542c8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:33.147033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:33.155819 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf653a-4b3a-49a4-9aef-a831fb542c8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:33.161152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-5bbf653a-4b3a-49a4-9aef-a831fb542c8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:22:33.161152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:33.161152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:33.161152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:33.161152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:33.161152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:33.161152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:33.161152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:33.161152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:33.161152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:33.161152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:33.161152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:33.161152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:33.161152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:33.161152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:33.161152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:33.162555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:33.162555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:33.162555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:33.162555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:33.162555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:33.162555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:33.162555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:33.162555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:33.162555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:33.162555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:33.162555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:33.162555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:33.162555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:33.162555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:33.162555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:33.162555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:33.163319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:33.163319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:33.163319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:33.163319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:33.163319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:33.163319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:33.163319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:33.163319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:33.163319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:33.163319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:33.163319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:22:33.163319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:22:33.163319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 46/92] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Oct 20 13:22:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:33.170365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf653a-4b3a-49a4-9aef-a831fb542c8d None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:33.171574 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-2373d7af-8049-4ac9-9f81-c84ba2899ea6 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:33.172983 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2373d7af-8049-4ac9-9f81-c84ba2899ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:33.263316 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:33.333136 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 47/93] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:33.334104 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373d7af-8049-4ac9-9f81-c84ba2899ea6 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:33.346640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf653a-4b3a-49a4-9aef-a831fb542c8d None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:33.409784 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064f1e5-5e4a-4055-86d6-60ee126d12ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:33.410382 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064f1e5-5e4a-4055-86d6-60ee126d12ad None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:33.410590 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064f1e5-5e4a-4055-86d6-60ee126d12ad None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:33.411061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064f1e5-5e4a-4055-86d6-60ee126d12ad None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:33.411914 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064f1e5-5e4a-4055-86d6-60ee126d12ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:33.412370 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064f1e5-5e4a-4055-86d6-60ee126d12ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:33.413903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064f1e5-5e4a-4055-86d6-60ee126d12ad None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:33.433821 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 47/94] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:22:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:33.441369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064f1e5-5e4a-4055-86d6-60ee126d12ad None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:33.524496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373d7af-8049-4ac9-9f81-c84ba2899ea6 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:33.548825 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:33.573950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ccd16-d423-4644-9120-957e18afd68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:33.575022 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ccd16-d423-4644-9120-957e18afd68c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:33.575550 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ccd16-d423-4644-9120-957e18afd68c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:33.577281 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ccd16-d423-4644-9120-957e18afd68c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:33.591608 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ccd16-d423-4644-9120-957e18afd68c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:33.597820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-422ccd16-d423-4644-9120-957e18afd68c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:33.597820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:33.597820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:33.597820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:33.597820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:33.597820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:33.597820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:33.597820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:33.597820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:33.597820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:33.597820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:33.597820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:33.597820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:33.597820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:33.597820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:33.597820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:33.598710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:33.598710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:33.598710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:33.598710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:33.598710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:33.598710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:33.598710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:33.598710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:33.598710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:33.598710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:33.598710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:33.598710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:33.598710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:33.598710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:33.598710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:33.598710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:33.600509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:33.600509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:33.600509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:33.600509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:33.600509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:33.600509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:33.600509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:33.600509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:33.600509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:33.600509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:33.600509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:33.600509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:33.602996 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 48/95] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:33.609608 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79126c63-051b-4b6c-88db-025c53178177 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:33.610243 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79126c63-051b-4b6c-88db-025c53178177 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:33.610733 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79126c63-051b-4b6c-88db-025c53178177 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:33.612269 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 49/96] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:33.613321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79126c63-051b-4b6c-88db-025c53178177 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:33.639718 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064f1e5-5e4a-4055-86d6-60ee126d12ad None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:33.676742 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:33.695596 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36abaf-e9b2-4f3e-8982-7222e7e4c404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:33.696245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36abaf-e9b2-4f3e-8982-7222e7e4c404 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:33.696978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36abaf-e9b2-4f3e-8982-7222e7e4c404 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:33.697255 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36abaf-e9b2-4f3e-8982-7222e7e4c404 None admin] PATH_INFO: `/v3/users/50d1e52d676e4e008bf20b30460feb3a` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:33.698864 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36abaf-e9b2-4f3e-8982-7222e7e4c404 None admin] RBAC: Authorizing `identity:get_user(user_id=50d1e52d676e4e008bf20b30460feb3a)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:33.700892 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36abaf-e9b2-4f3e-8982-7222e7e4c404 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:33.703247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 48/97] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:33 2022] GET /identity/v3/users/50d1e52d676e4e008bf20b30460feb3a => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:33.704682 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8e013-db47-43c1-89bf-b386e9d9ae7d None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:33.704964 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8e013-db47-43c1-89bf-b386e9d9ae7d None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:33.705293 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8e013-db47-43c1-89bf-b386e9d9ae7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:33.727949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-a3f8e013-db47-43c1-89bf-b386e9d9ae7d None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:33.729734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a3f8e013-db47-43c1-89bf-b386e9d9ae7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:33.764424 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79126c63-051b-4b6c-88db-025c53178177 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:33.802040 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 49/98] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:33.803436 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33667541-b526-4e4e-b38c-7fb3391c6168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:33.804072 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153f6bf-a20a-4c36-acb0-86f526d7472e None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:33.804428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153f6bf-a20a-4c36-acb0-86f526d7472e None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:33.804772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153f6bf-a20a-4c36-acb0-86f526d7472e None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:33.804936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33667541-b526-4e4e-b38c-7fb3391c6168 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:33.805371 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33667541-b526-4e4e-b38c-7fb3391c6168 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:33.805807 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33667541-b526-4e4e-b38c-7fb3391c6168 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:33.806300 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 50/99] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:33.806819 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33667541-b526-4e4e-b38c-7fb3391c6168 None admin] RBAC: Adding query filter params (name=member) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:33.807306 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33667541-b526-4e4e-b38c-7fb3391c6168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:33.808824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33667541-b526-4e4e-b38c-7fb3391c6168 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:33.811239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153f6bf-a20a-4c36-acb0-86f526d7472e None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:33.819695 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 50/100] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:22:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:33.821408 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33667541-b526-4e4e-b38c-7fb3391c6168 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:33.872824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:33.935545 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:33.939767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153f6bf-a20a-4c36-acb0-86f526d7472e None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:33.949488 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33667541-b526-4e4e-b38c-7fb3391c6168 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:33.987762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e4a59-addb-4f27-a27d-856aeb8bac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:33.988391 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e4a59-addb-4f27-a27d-856aeb8bac60 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:33.988671 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e4a59-addb-4f27-a27d-856aeb8bac60 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:33.988944 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e4a59-addb-4f27-a27d-856aeb8bac60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:33.993261 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3389033-e1fb-45ed-ba11-c9b8466cfced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:33.994401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3389033-e1fb-45ed-ba11-c9b8466cfced None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:33.994875 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3389033-e1fb-45ed-ba11-c9b8466cfced None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:33.995363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3389033-e1fb-45ed-ba11-c9b8466cfced None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:33.999804 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e4a59-addb-4f27-a27d-856aeb8bac60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:34.006165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-c73e4a59-addb-4f27-a27d-856aeb8bac60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:34.006165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:34.006165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:34.006165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:34.006165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:34.006165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:34.006165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:34.006165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:34.006165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:34.006165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:34.006165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:34.006165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:34.006165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:34.006165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:34.006165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:34.006165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:34.007053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:34.007053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:34.007053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:34.007053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:34.007053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:34.007053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:34.007053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:34.007053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:34.007053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:34.007053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:34.007053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:34.007053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:34.007053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:34.007053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:34.007053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:34.007053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:34.007806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:34.007806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:34.007806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:34.007806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:34.007806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:34.007806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:34.007806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:34.007806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:34.007806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:34.007806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:34.007806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:34.007806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:34.007806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 51/101] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:34.008879 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636871da-a198-4954-90b3-ba2a732f905a None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:34.008879 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636871da-a198-4954-90b3-ba2a732f905a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:34.009095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636871da-a198-4954-90b3-ba2a732f905a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:34.027495 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-636871da-a198-4954-90b3-ba2a732f905a None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:34.028729 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-636871da-a198-4954-90b3-ba2a732f905a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:34.078435 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3389033-e1fb-45ed-ba11-c9b8466cfced None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:34.080434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3389033-e1fb-45ed-ba11-c9b8466cfced None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:34.098135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 52/102] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:34.098903 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636871da-a198-4954-90b3-ba2a732f905a None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:34.141773 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:34.193990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 51/103] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:22:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 13:22:34.193990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3389033-e1fb-45ed-ba11-c9b8466cfced None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:34.200331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:34.220520 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636871da-a198-4954-90b3-ba2a732f905a None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:34.257315 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69886ce2-442c-4de3-8524-82b59f7a323b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:34.257956 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886ce2-442c-4de3-8524-82b59f7a323b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:34.258240 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886ce2-442c-4de3-8524-82b59f7a323b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:34.258524 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886ce2-442c-4de3-8524-82b59f7a323b None admin] PATH_INFO: `/v3/users/50d1e52d676e4e008bf20b30460feb3a` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:34.259683 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69886ce2-442c-4de3-8524-82b59f7a323b None admin] RBAC: Authorizing `identity:get_user(user_id=50d1e52d676e4e008bf20b30460feb3a)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:34.261152 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69886ce2-442c-4de3-8524-82b59f7a323b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:34.262898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 53/104] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:34 2022] GET /identity/v3/users/50d1e52d676e4e008bf20b30460feb3a => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:34.263890 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da985f-9923-4650-a266-ff448c0d896e None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:34.264178 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da985f-9923-4650-a266-ff448c0d896e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:34.264454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da985f-9923-4650-a266-ff448c0d896e None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:34.267435 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 54/105] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:34.267435 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da985f-9923-4650-a266-ff448c0d896e None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:34.301266 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3389033-e1fb-45ed-ba11-c9b8466cfced None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:34.338277 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39009e4-8dae-4bff-b4a1-5ffacea14222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:34.338726 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39009e4-8dae-4bff-b4a1-5ffacea14222 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:34.339030 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39009e4-8dae-4bff-b4a1-5ffacea14222 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:34.339302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39009e4-8dae-4bff-b4a1-5ffacea14222 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:34.339953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39009e4-8dae-4bff-b4a1-5ffacea14222 None admin] RBAC: Adding query filter params (name=member) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:34.340256 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39009e4-8dae-4bff-b4a1-5ffacea14222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:34.341615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39009e4-8dae-4bff-b4a1-5ffacea14222 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:34.355382 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 52/106] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:22:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:34.355382 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39009e4-8dae-4bff-b4a1-5ffacea14222 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:34.375083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:34.382867 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da985f-9923-4650-a266-ff448c0d896e None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:34.417952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0750f-ae94-4229-b184-5ff50e09212e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:34.418588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0750f-ae94-4229-b184-5ff50e09212e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:34.418871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0750f-ae94-4229-b184-5ff50e09212e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:34.419177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0750f-ae94-4229-b184-5ff50e09212e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:34.429323 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0750f-ae94-4229-b184-5ff50e09212e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:34.434075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-84f0750f-ae94-4229-b184-5ff50e09212e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:22:34.434075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:34.434075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:34.434075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:34.434075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:34.434075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:34.434075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:34.434075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:34.434075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:34.434075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:34.434075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:34.434075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:34.434075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:34.434075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:34.434075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:34.434075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:34.435021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:34.435021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:34.435021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:34.435021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:34.435021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:34.435021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:34.435021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:34.435021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:34.435021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:34.435021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:34.435021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:34.435021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:34.435021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:34.435021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:34.435021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:34.435021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:34.435768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:34.435768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:34.435768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:34.435768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:34.435768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:34.435768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:34.435768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:34.435768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:34.435768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:34.435768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:34.435768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:22:34.435768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:34.435768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 55/107] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:22:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:34.436383 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0750f-ae94-4229-b184-5ff50e09212e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:34.449428 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:34.462884 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39009e4-8dae-4bff-b4a1-5ffacea14222 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:34.498028 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b370e9-6e3d-41be-88e8-0a1ad26fd6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:34.498668 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b370e9-6e3d-41be-88e8-0a1ad26fd6fd None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:34.498977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b370e9-6e3d-41be-88e8-0a1ad26fd6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:34.499274 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b370e9-6e3d-41be-88e8-0a1ad26fd6fd None admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:34.500415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b370e9-6e3d-41be-88e8-0a1ad26fd6fd None admin] RBAC: Authorizing `identity:get_project(project_id=25e961400d214cb99f377dbe63b7b8f7)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:34.501865 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b370e9-6e3d-41be-88e8-0a1ad26fd6fd None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:34.503547 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 53/108] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:34 2022] GET /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:34.504654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d98e38-9281-4f1f-ad5c-a1bfa831c426 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:34.504940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d98e38-9281-4f1f-ad5c-a1bfa831c426 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:34.505810 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d98e38-9281-4f1f-ad5c-a1bfa831c426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:34.523907 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-c9d98e38-9281-4f1f-ad5c-a1bfa831c426 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:34.525104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-c9d98e38-9281-4f1f-ad5c-a1bfa831c426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:34.540554 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0750f-ae94-4229-b184-5ff50e09212e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:34.574687 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080d1ef-ce01-4757-8bf5-e8127168763d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:34.575321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080d1ef-ce01-4757-8bf5-e8127168763d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:34.575602 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080d1ef-ce01-4757-8bf5-e8127168763d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:34.575877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080d1ef-ce01-4757-8bf5-e8127168763d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:34.590522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 54/109] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:34.591395 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d98e38-9281-4f1f-ad5c-a1bfa831c426 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:34.609277 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:34.648274 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080d1ef-ce01-4757-8bf5-e8127168763d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:34.649753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080d1ef-ce01-4757-8bf5-e8127168763d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:34.660715 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:34.699316 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d98e38-9281-4f1f-ad5c-a1bfa831c426 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:34.736199 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0b444-8414-4edf-974d-dfff3dabcacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:34.736756 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b444-8414-4edf-974d-dfff3dabcacf None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:34.737041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b444-8414-4edf-974d-dfff3dabcacf None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:34.737318 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0b444-8414-4edf-974d-dfff3dabcacf None admin] PATH_INFO: `/v3/users/50d1e52d676e4e008bf20b30460feb3a` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:34.738496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0b444-8414-4edf-974d-dfff3dabcacf None admin] RBAC: Authorizing `identity:get_user(user_id=50d1e52d676e4e008bf20b30460feb3a)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:34.740735 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc0b444-8414-4edf-974d-dfff3dabcacf None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:34.742472 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 55/110] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:34 2022] GET /identity/v3/users/50d1e52d676e4e008bf20b30460feb3a => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:34.743177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0b444-8414-4edf-974d-dfff3dabcacf None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:34.756817 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 56/111] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:22:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 13:22:34.757710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080d1ef-ce01-4757-8bf5-e8127168763d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:34.834124 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:34.851730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc0b444-8414-4edf-974d-dfff3dabcacf None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:34.861478 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080d1ef-ce01-4757-8bf5-e8127168763d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:34.874509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:34.889358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300aa2b-ce9d-4cf0-aa6c-f3958cef963e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:34.889999 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300aa2b-ce9d-4cf0-aa6c-f3958cef963e None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:34.890339 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300aa2b-ce9d-4cf0-aa6c-f3958cef963e None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:34.890618 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300aa2b-ce9d-4cf0-aa6c-f3958cef963e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:34.891773 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300aa2b-ce9d-4cf0-aa6c-f3958cef963e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:34.893243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300aa2b-ce9d-4cf0-aa6c-f3958cef963e None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:34.895000 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 56/112] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:22:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:34.895614 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300aa2b-ce9d-4cf0-aa6c-f3958cef963e None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:34.903820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28ba64-e7e0-4644-84ac-5b0b7992239f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:34.904837 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28ba64-e7e0-4644-84ac-5b0b7992239f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:34.905129 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28ba64-e7e0-4644-84ac-5b0b7992239f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:34.905411 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28ba64-e7e0-4644-84ac-5b0b7992239f None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:34.906084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28ba64-e7e0-4644-84ac-5b0b7992239f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:34.906760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28ba64-e7e0-4644-84ac-5b0b7992239f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:34.908507 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28ba64-e7e0-4644-84ac-5b0b7992239f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:34.917678 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 57/113] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:34.919814 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28ba64-e7e0-4644-84ac-5b0b7992239f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:34.993231 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300aa2b-ce9d-4cf0-aa6c-f3958cef963e None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:35.017641 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28ba64-e7e0-4644-84ac-5b0b7992239f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:35.025934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d57535-8828-48aa-bfc4-f50d11932f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:35.026538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d57535-8828-48aa-bfc4-f50d11932f03 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:35.026817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d57535-8828-48aa-bfc4-f50d11932f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:35.027119 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d57535-8828-48aa-bfc4-f50d11932f03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:35.027843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d57535-8828-48aa-bfc4-f50d11932f03 None admin] RBAC: Adding query filter params (role.id=c63cd01b72aa49d5932f4b4f762fdf5c, scope.project.id=25e961400d214cb99f377dbe63b7b8f7, user.id=50d1e52d676e4e008bf20b30460feb3a) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:35.028149 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d57535-8828-48aa-bfc4-f50d11932f03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:35.029571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d57535-8828-48aa-bfc4-f50d11932f03 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:35.035094 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 57/114] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:22:34 2022] GET /identity/v3/role_assignments?user.id=50d1e52d676e4e008bf20b30460feb3a&scope.project.id=25e961400d214cb99f377dbe63b7b8f7&role.id=c63cd01b72aa49d5932f4b4f762fdf5c => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:35.035870 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d57535-8828-48aa-bfc4-f50d11932f03 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:35.052656 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad68ab8-148c-4985-aafc-59402f42541c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:35.053349 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad68ab8-148c-4985-aafc-59402f42541c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:35.053642 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad68ab8-148c-4985-aafc-59402f42541c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:35.053929 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad68ab8-148c-4985-aafc-59402f42541c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:35.057132 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:35.102321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:35.135987 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad68ab8-148c-4985-aafc-59402f42541c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:35.137469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad68ab8-148c-4985-aafc-59402f42541c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:35.157553 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d57535-8828-48aa-bfc4-f50d11932f03 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:35.196250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f47f7d-1dc9-4e51-ac03-f602da8a651a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:35.197259 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47f7d-1dc9-4e51-ac03-f602da8a651a None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:35.197752 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47f7d-1dc9-4e51-ac03-f602da8a651a None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:35.198036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f47f7d-1dc9-4e51-ac03-f602da8a651a None admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:35.199267 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f47f7d-1dc9-4e51-ac03-f602da8a651a None admin] RBAC: Authorizing `identity:get_project(project_id=25e961400d214cb99f377dbe63b7b8f7)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:35.200729 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f47f7d-1dc9-4e51-ac03-f602da8a651a None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:35.202393 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 58/115] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:35 2022] GET /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:35.205432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f47f7d-1dc9-4e51-ac03-f602da8a651a None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:35.253897 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 58/116] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:22:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 13:22:35.254557 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad68ab8-148c-4985-aafc-59402f42541c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:35.300568 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:35.316205 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f47f7d-1dc9-4e51-ac03-f602da8a651a None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:35.330923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:35.353824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e042e-b314-496f-bcc2-02b4566eea3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:35.354450 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e042e-b314-496f-bcc2-02b4566eea3d None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:35.354731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e042e-b314-496f-bcc2-02b4566eea3d None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:35.355030 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e042e-b314-496f-bcc2-02b4566eea3d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:35.361554 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad68ab8-148c-4985-aafc-59402f42541c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:35.364865 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707e042e-b314-496f-bcc2-02b4566eea3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:35.370039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-707e042e-b314-496f-bcc2-02b4566eea3d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 13:22:35.370039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:35.370039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:35.370039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:35.370039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:35.370039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:35.370039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:35.370039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:35.370039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:35.370039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:35.370039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:35.370039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:35.370039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:35.370039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:35.370039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:35.370039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:35.371108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:35.371108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:35.371108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:35.371108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:35.371108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:35.371108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:35.371108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:35.371108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:35.371108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:35.371108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:35.371108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:35.371108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:35.371108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:35.371108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:35.371108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:35.371108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:35.371899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:35.371899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:35.371899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:35.371899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:35.371899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:35.371899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:35.371899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:35.371899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:35.371899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:35.371899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:35.371899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 13:22:35.371899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:22:35.371899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 59/117] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:35.372509 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e042e-b314-496f-bcc2-02b4566eea3d None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:35.397667 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170de4f8-1971-4b96-86df-797ffefa5485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:35.398281 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170de4f8-1971-4b96-86df-797ffefa5485 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:35.398564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170de4f8-1971-4b96-86df-797ffefa5485 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:35.398843 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170de4f8-1971-4b96-86df-797ffefa5485 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:35.399526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170de4f8-1971-4b96-86df-797ffefa5485 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:35.400968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170de4f8-1971-4b96-86df-797ffefa5485 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:35.427793 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 59/118] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Oct 20 13:22:35 2022] POST /identity/v3/projects => generated 302 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:22:35.428640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170de4f8-1971-4b96-86df-797ffefa5485 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:35.480622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e042e-b314-496f-bcc2-02b4566eea3d None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:35.520107 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176fdd4-5a94-41db-a26a-226c0593539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:35.520768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176fdd4-5a94-41db-a26a-226c0593539b None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:35.521229 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176fdd4-5a94-41db-a26a-226c0593539b None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:35.521564 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176fdd4-5a94-41db-a26a-226c0593539b None admin] PATH_INFO: `/v3/users/7f166e0661794d2b8c2ad033390437ec` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:35.522809 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176fdd4-5a94-41db-a26a-226c0593539b None admin] RBAC: Authorizing `identity:get_user(user_id=7f166e0661794d2b8c2ad033390437ec)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:35.524345 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176fdd4-5a94-41db-a26a-226c0593539b None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:35.530822 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 60/119] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:35 2022] GET /identity/v3/users/7f166e0661794d2b8c2ad033390437ec => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:35.530822 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176fdd4-5a94-41db-a26a-226c0593539b None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:35.548127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:35.559446 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170de4f8-1971-4b96-86df-797ffefa5485 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:35.586230 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:35.604444 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b92ed-0edd-4861-9d1e-459afa1f558f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:35.605098 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b92ed-0edd-4861-9d1e-459afa1f558f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:35.605387 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b92ed-0edd-4861-9d1e-459afa1f558f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:35.605668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b92ed-0edd-4861-9d1e-459afa1f558f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:35.606583 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b92ed-0edd-4861-9d1e-459afa1f558f None admin] RBAC: Adding query filter params (role.id=233938f0e7e84b5098019470ad8cfb4e, scope.project.id=25e961400d214cb99f377dbe63b7b8f7, user.id=50d1e52d676e4e008bf20b30460feb3a) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:35.606724 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b92ed-0edd-4861-9d1e-459afa1f558f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:35.608227 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b92ed-0edd-4861-9d1e-459afa1f558f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:35.616909 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 60/120] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:22:35 2022] GET /identity/v3/role_assignments?user.id=50d1e52d676e4e008bf20b30460feb3a&scope.project.id=25e961400d214cb99f377dbe63b7b8f7&role.id=233938f0e7e84b5098019470ad8cfb4e => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:35.618011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b92ed-0edd-4861-9d1e-459afa1f558f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:35.660584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176fdd4-5a94-41db-a26a-226c0593539b None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:35.702894 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54444b-16b1-4761-b418-69512232f6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:35.704093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54444b-16b1-4761-b418-69512232f6e8 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:35.704605 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54444b-16b1-4761-b418-69512232f6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:35.705082 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54444b-16b1-4761-b418-69512232f6e8 None admin] PATH_INFO: `/v3/projects/d170f4763b244bde849ef79fb7b6b028` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:35.706514 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54444b-16b1-4761-b418-69512232f6e8 None admin] RBAC: Authorizing `identity:get_project(project_id=d170f4763b244bde849ef79fb7b6b028)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:35.708283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54444b-16b1-4761-b418-69512232f6e8 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:35.710536 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 61/121] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:35 2022] GET /identity/v3/projects/d170f4763b244bde849ef79fb7b6b028 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:35.711636 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54444b-16b1-4761-b418-69512232f6e8 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:35.762198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b92ed-0edd-4861-9d1e-459afa1f558f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:35.814889 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f7f6e-f437-43e4-b07c-c88510711561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:35.815133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f7f6e-f437-43e4-b07c-c88510711561 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:35.815365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f7f6e-f437-43e4-b07c-c88510711561 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:35.815648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f7f6e-f437-43e4-b07c-c88510711561 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:35.816333 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f7f6e-f437-43e4-b07c-c88510711561 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:35.816666 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f7f6e-f437-43e4-b07c-c88510711561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:35.818250 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f7f6e-f437-43e4-b07c-c88510711561 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:35.828205 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 61/122] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:22:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:35.828858 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f7f6e-f437-43e4-b07c-c88510711561 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:35.837872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:35.867019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54444b-16b1-4761-b418-69512232f6e8 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:35.888887 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:35.918454 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee2aae-af13-47fc-81bb-2d29ba26a807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:35.920262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee2aae-af13-47fc-81bb-2d29ba26a807 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:35.920702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee2aae-af13-47fc-81bb-2d29ba26a807 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:35.921128 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee2aae-af13-47fc-81bb-2d29ba26a807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:35.950782 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f7f6e-f437-43e4-b07c-c88510711561 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:35.988435 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd56ab-9e3e-419d-b98a-e223b3a71a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:35.989045 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd56ab-9e3e-419d-b98a-e223b3a71a96 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:35.989434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd56ab-9e3e-419d-b98a-e223b3a71a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:35.990419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd56ab-9e3e-419d-b98a-e223b3a71a96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:35.990917 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd56ab-9e3e-419d-b98a-e223b3a71a96 None admin] RBAC: Adding query filter params (role.id=233938f0e7e84b5098019470ad8cfb4e, scope.project.id=d170f4763b244bde849ef79fb7b6b028, user.id=50d1e52d676e4e008bf20b30460feb3a) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:35.991351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd56ab-9e3e-419d-b98a-e223b3a71a96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:35.992682 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd56ab-9e3e-419d-b98a-e223b3a71a96 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:35.997224 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee2aae-af13-47fc-81bb-2d29ba26a807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:35.998689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee2aae-af13-47fc-81bb-2d29ba26a807 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:35.998931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 62/123] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:22:35 2022] GET /identity/v3/role_assignments?user.id=50d1e52d676e4e008bf20b30460feb3a&scope.project.id=d170f4763b244bde849ef79fb7b6b028&role.id=233938f0e7e84b5098019470ad8cfb4e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:35.999836 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd56ab-9e3e-419d-b98a-e223b3a71a96 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:36.118472 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:36.137938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd56ab-9e3e-419d-b98a-e223b3a71a96 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:36.143363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 62/124] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:22:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 13:22:36.151090 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee2aae-af13-47fc-81bb-2d29ba26a807 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:36.157913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:36.189028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c7f16-9558-4149-bdb0-98efddc7cf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:36.190170 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c7f16-9558-4149-bdb0-98efddc7cf73 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:36.190703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c7f16-9558-4149-bdb0-98efddc7cf73 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:36.191146 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c7f16-9558-4149-bdb0-98efddc7cf73 None admin] PATH_INFO: `/v3/users/edb428dd9df34ff595bf47811ced497e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:36.208502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c7f16-9558-4149-bdb0-98efddc7cf73 None admin] RBAC: Authorizing `identity:get_user(user_id=edb428dd9df34ff595bf47811ced497e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:36.210445 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c7f16-9558-4149-bdb0-98efddc7cf73 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:36.213896 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 63/125] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:35 2022] GET /identity/v3/users/edb428dd9df34ff595bf47811ced497e => generated 289 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:36.220649 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c7f16-9558-4149-bdb0-98efddc7cf73 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:36.280569 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee2aae-af13-47fc-81bb-2d29ba26a807 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:36.319292 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b16f3-e145-4d4c-a56a-0ac1877de2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:36.319933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b16f3-e145-4d4c-a56a-0ac1877de2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:36.320214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b16f3-e145-4d4c-a56a-0ac1877de2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:36.320499 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b16f3-e145-4d4c-a56a-0ac1877de2a6 None admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:36.321630 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b16f3-e145-4d4c-a56a-0ac1877de2a6 None admin] RBAC: Authorizing `identity:get_project(project_id=25e961400d214cb99f377dbe63b7b8f7)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:36.323109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b16f3-e145-4d4c-a56a-0ac1877de2a6 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:36.325021 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 63/126] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:36 2022] GET /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:36.330468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b16f3-e145-4d4c-a56a-0ac1877de2a6 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:36.340539 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c7f16-9558-4149-bdb0-98efddc7cf73 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:36.378042 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebbb21-2c5c-420b-bc2f-4b2218c1fd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:36.378885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebbb21-2c5c-420b-bc2f-4b2218c1fd79 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:36.379199 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebbb21-2c5c-420b-bc2f-4b2218c1fd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:36.379477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cebbb21-2c5c-420b-bc2f-4b2218c1fd79 None admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:36.380799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebbb21-2c5c-420b-bc2f-4b2218c1fd79 None admin] RBAC: Authorizing `identity:get_project(project_id=25e961400d214cb99f377dbe63b7b8f7)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:36.382234 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cebbb21-2c5c-420b-bc2f-4b2218c1fd79 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:36.384227 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 64/127] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:36 2022] GET /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:36.391623 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebbb21-2c5c-420b-bc2f-4b2218c1fd79 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:36.394595 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:36.440113 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:36.451569 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b16f3-e145-4d4c-a56a-0ac1877de2a6 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:36.486902 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf4464-4476-4ac7-bbd2-789254032335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:36.487562 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf4464-4476-4ac7-bbd2-789254032335 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:36.488133 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf4464-4476-4ac7-bbd2-789254032335 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:36.488415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf4464-4476-4ac7-bbd2-789254032335 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:36.489136 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf4464-4476-4ac7-bbd2-789254032335 None admin] RBAC: Adding query filter params (role.id=9c0f227afc2e4a0aa404780de229488c, scope.project.id=25e961400d214cb99f377dbe63b7b8f7, user.id=7f166e0661794d2b8c2ad033390437ec) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:36.489970 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf4464-4476-4ac7-bbd2-789254032335 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:36.491613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf4464-4476-4ac7-bbd2-789254032335 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:36.497572 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 64/128] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:22:36 2022] GET /identity/v3/role_assignments?user.id=7f166e0661794d2b8c2ad033390437ec&scope.project.id=25e961400d214cb99f377dbe63b7b8f7&role.id=9c0f227afc2e4a0aa404780de229488c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:36.504619 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cebbb21-2c5c-420b-bc2f-4b2218c1fd79 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:36.543908 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f59e34-ac1a-47c1-8dae-552316939eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:36.544647 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59e34-ac1a-47c1-8dae-552316939eed None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:36.544935 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59e34-ac1a-47c1-8dae-552316939eed None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:36.545214 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59e34-ac1a-47c1-8dae-552316939eed None admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7/users/edb428dd9df34ff595bf47811ced497e/roles/5c7df19d9a1a45cabf65945ba964abe8` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:36.547219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f59e34-ac1a-47c1-8dae-552316939eed None admin] RBAC: Authorizing `identity:create_grant(project_id=25e961400d214cb99f377dbe63b7b8f7, user_id=edb428dd9df34ff595bf47811ced497e, role_id=5c7df19d9a1a45cabf65945ba964abe8)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:36.548712 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f59e34-ac1a-47c1-8dae-552316939eed None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:36.564096 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 65/129] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:22:36 2022] PUT /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7/users/edb428dd9df34ff595bf47811ced497e/roles/5c7df19d9a1a45cabf65945ba964abe8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:22:37.689905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10dacc-3a47-4752-92eb-4ab446838696 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:37.690419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10dacc-3a47-4752-92eb-4ab446838696 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:37.690500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10dacc-3a47-4752-92eb-4ab446838696 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:37.691870 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 65/130] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:37.697378 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682de40c-aaf7-4239-b313-5645f0774d22 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:37.697795 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682de40c-aaf7-4239-b313-5645f0774d22 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:37.697926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682de40c-aaf7-4239-b313-5645f0774d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:37.715833 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-682de40c-aaf7-4239-b313-5645f0774d22 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:37.717012 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-682de40c-aaf7-4239-b313-5645f0774d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:37.781454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 66/131] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:38.046918 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10dacc-3a47-4752-92eb-4ab446838696 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:38.147096 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa10dacc-3a47-4752-92eb-4ab446838696 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:38.159448 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:38.181158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75112b25-ba1b-4db8-a2a3-21676027d6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:38.181792 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75112b25-ba1b-4db8-a2a3-21676027d6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:38.182075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75112b25-ba1b-4db8-a2a3-21676027d6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:38.182351 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75112b25-ba1b-4db8-a2a3-21676027d6c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:38.183511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75112b25-ba1b-4db8-a2a3-21676027d6c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:38.184970 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75112b25-ba1b-4db8-a2a3-21676027d6c4 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:38.186554 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 66/132] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:22:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:38.191974 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682de40c-aaf7-4239-b313-5645f0774d22 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:38.220341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:38.288795 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682de40c-aaf7-4239-b313-5645f0774d22 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:38.322782 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06156a-e246-4749-af48-1cacba6b0f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:38.323340 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06156a-e246-4749-af48-1cacba6b0f8e None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:38.323621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06156a-e246-4749-af48-1cacba6b0f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:38.323894 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06156a-e246-4749-af48-1cacba6b0f8e None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:38.324579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06156a-e246-4749-af48-1cacba6b0f8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:38.326006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06156a-e246-4749-af48-1cacba6b0f8e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:38.345753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 67/133] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:22:38 2022] POST /identity/v3/users => generated 283 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:22:38.721433 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca44802-c701-460d-9ed2-60798720d2ff None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:38.721898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca44802-c701-460d-9ed2-60798720d2ff None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:38.721898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca44802-c701-460d-9ed2-60798720d2ff None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:38.723475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 67/134] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:38.729223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4dad2-7962-4582-b0f8-617d8bcc8b29 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:38.729678 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4dad2-7962-4582-b0f8-617d8bcc8b29 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:38.729753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4dad2-7962-4582-b0f8-617d8bcc8b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:38.751981 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d1f4dad2-7962-4582-b0f8-617d8bcc8b29 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:38.753228 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d1f4dad2-7962-4582-b0f8-617d8bcc8b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:38.825838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 68/135] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:39.097776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca44802-c701-460d-9ed2-60798720d2ff None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:39.210100 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca44802-c701-460d-9ed2-60798720d2ff None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:39.245231 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11790db0-9963-426a-b5df-81a066553d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:39.245867 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11790db0-9963-426a-b5df-81a066553d32 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:39.246146 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11790db0-9963-426a-b5df-81a066553d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:39.246418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11790db0-9963-426a-b5df-81a066553d32 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:39.257735 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11790db0-9963-426a-b5df-81a066553d32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:39.262941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-11790db0-9963-426a-b5df-81a066553d32 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 13:22:39.262941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:39.262941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:39.262941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:39.262941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:39.262941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:39.262941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:39.262941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:39.262941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:39.262941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:39.262941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:39.262941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:39.262941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:39.262941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:39.262941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:39.262941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:39.263789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:39.263789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:39.263789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:39.263789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:39.263789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:39.263789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:39.263789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:39.263789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:39.263789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:39.263789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:39.263789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:39.263789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:39.263789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:39.263789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:39.263789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:39.263789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:39.264625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:39.264625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:39.264625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:39.264625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:39.264625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:39.264625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:39.264625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:39.264625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:39.264625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:39.264625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:39.264625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 13:22:39.264625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:22:39.264625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 68/136] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:39.271253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4dad2-7962-4582-b0f8-617d8bcc8b29 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:39.289749 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:39.379368 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4dad2-7962-4582-b0f8-617d8bcc8b29 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:39.414931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702baa6-87c8-4720-b344-ea6d9cd46deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:39.415565 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702baa6-87c8-4720-b344-ea6d9cd46deb None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:39.415842 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702baa6-87c8-4720-b344-ea6d9cd46deb None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:39.416115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1702baa6-87c8-4720-b344-ea6d9cd46deb None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:39.417029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702baa6-87c8-4720-b344-ea6d9cd46deb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:39.417334 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702baa6-87c8-4720-b344-ea6d9cd46deb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:39.418711 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1702baa6-87c8-4720-b344-ea6d9cd46deb None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:39.427681 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 69/137] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:22:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:39.433372 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11790db0-9963-426a-b5df-81a066553d32 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:39.477375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:39.542274 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11790db0-9963-426a-b5df-81a066553d32 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:39.579357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c99293-33a6-4d40-81e6-b0c268bd8e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:39.579994 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c99293-33a6-4d40-81e6-b0c268bd8e60 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:39.580274 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c99293-33a6-4d40-81e6-b0c268bd8e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:39.580549 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c99293-33a6-4d40-81e6-b0c268bd8e60 None admin] PATH_INFO: `/v3/users/edb428dd9df34ff595bf47811ced497e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:39.581677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c99293-33a6-4d40-81e6-b0c268bd8e60 None admin] RBAC: Authorizing `identity:get_user(user_id=edb428dd9df34ff595bf47811ced497e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:39.583371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c99293-33a6-4d40-81e6-b0c268bd8e60 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:39.585212 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 69/138] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:39 2022] GET /identity/v3/users/edb428dd9df34ff595bf47811ced497e => generated 289 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:39.590722 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702baa6-87c8-4720-b344-ea6d9cd46deb None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:39.672808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:39.695803 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1702baa6-87c8-4720-b344-ea6d9cd46deb None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:39.729437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12fcf1-99ec-4b0b-b466-48d2bfdb5c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:39.730031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12fcf1-99ec-4b0b-b466-48d2bfdb5c93 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:39.730306 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12fcf1-99ec-4b0b-b466-48d2bfdb5c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:39.730584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12fcf1-99ec-4b0b-b466-48d2bfdb5c93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:39.799718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12fcf1-99ec-4b0b-b466-48d2bfdb5c93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:39.801179 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12fcf1-99ec-4b0b-b466-48d2bfdb5c93 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:39.888231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:39.901380 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 70/139] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:22:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 13:22:39.906977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c99293-33a6-4d40-81e6-b0c268bd8e60 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:40.012940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c99293-33a6-4d40-81e6-b0c268bd8e60 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:40.022341 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:40.048710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21cd48-eec1-4c9e-baef-ed743524be63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:40.049659 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21cd48-eec1-4c9e-baef-ed743524be63 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:40.050136 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21cd48-eec1-4c9e-baef-ed743524be63 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:40.050603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21cd48-eec1-4c9e-baef-ed743524be63 None admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:40.052245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21cd48-eec1-4c9e-baef-ed743524be63 None admin] RBAC: Authorizing `identity:get_project(project_id=25e961400d214cb99f377dbe63b7b8f7)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:40.053893 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21cd48-eec1-4c9e-baef-ed743524be63 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:40.055754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 70/140] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:39 2022] GET /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:40.063460 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12fcf1-99ec-4b0b-b466-48d2bfdb5c93 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:40.161727 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12fcf1-99ec-4b0b-b466-48d2bfdb5c93 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:40.196798 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12c460-4600-4aef-b6e7-d662dc7db7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:40.197421 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12c460-4600-4aef-b6e7-d662dc7db7ea None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:40.197704 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12c460-4600-4aef-b6e7-d662dc7db7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:40.197983 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12c460-4600-4aef-b6e7-d662dc7db7ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:40.198720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12c460-4600-4aef-b6e7-d662dc7db7ea None admin] RBAC: Adding query filter params (role.id=5c7df19d9a1a45cabf65945ba964abe8, scope.project.id=25e961400d214cb99f377dbe63b7b8f7, user.id=edb428dd9df34ff595bf47811ced497e) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:40.199060 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12c460-4600-4aef-b6e7-d662dc7db7ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:40.200510 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12c460-4600-4aef-b6e7-d662dc7db7ea None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:40.206712 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 71/141] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:22:40 2022] GET /identity/v3/role_assignments?user.id=edb428dd9df34ff595bf47811ced497e&scope.project.id=25e961400d214cb99f377dbe63b7b8f7&role.id=5c7df19d9a1a45cabf65945ba964abe8 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:40.617900 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed830e-7687-4d14-9d91-bb4d924ace20 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:40.618265 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed830e-7687-4d14-9d91-bb4d924ace20 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:40.618462 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed830e-7687-4d14-9d91-bb4d924ace20 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:40.619862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 71/142] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:40.625008 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30801db7-0a85-4783-93c8-4cbd3ace23c7 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:40.625306 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30801db7-0a85-4783-93c8-4cbd3ace23c7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:40.625591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30801db7-0a85-4783-93c8-4cbd3ace23c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:40.644880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-30801db7-0a85-4783-93c8-4cbd3ace23c7 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:40.646747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-30801db7-0a85-4783-93c8-4cbd3ace23c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:40.683290 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:40.717783 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 72/143] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:40.865998 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60741e94-a5d4-49c9-91af-bca6d474de17 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:40.866291 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60741e94-a5d4-49c9-91af-bca6d474de17 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:40.866736 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60741e94-a5d4-49c9-91af-bca6d474de17 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:40.870192 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 72/144] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:40.875684 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea134369-b552-40dc-ad97-84a29e80b1ce None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:40.876070 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fe6aa-6bd4-4d51-abf1-ad5c20fbcd83 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:40.876143 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea134369-b552-40dc-ad97-84a29e80b1ce None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:40.876208 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fe6aa-6bd4-4d51-abf1-ad5c20fbcd83 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:40.876289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea134369-b552-40dc-ad97-84a29e80b1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:40.876364 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fe6aa-6bd4-4d51-abf1-ad5c20fbcd83 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:40.877600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 73/145] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:40.886254 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf206f-17fb-4736-a732-36edac7225f0 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:40.886658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf206f-17fb-4736-a732-36edac7225f0 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:40.887044 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf206f-17fb-4736-a732-36edac7225f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:40.895468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ea134369-b552-40dc-ad97-84a29e80b1ce None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:40.896756 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ea134369-b552-40dc-ad97-84a29e80b1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:40.904962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-84bf206f-17fb-4736-a732-36edac7225f0 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:40.906188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-84bf206f-17fb-4736-a732-36edac7225f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:40.968295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 73/146] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:40.980124 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 74/147] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:40.986593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea134369-b552-40dc-ad97-84a29e80b1ce None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:41.086049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea134369-b552-40dc-ad97-84a29e80b1ce None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:41.087557 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:41.121139 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3da1-d1a4-442c-8e27-109b616483a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:41.121699 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3da1-d1a4-442c-8e27-109b616483a6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:41.121980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3da1-d1a4-442c-8e27-109b616483a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:41.122252 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee3da1-d1a4-442c-8e27-109b616483a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:41.132760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee3da1-d1a4-442c-8e27-109b616483a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:41.137604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-e4ee3da1-d1a4-442c-8e27-109b616483a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:22:41.137604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:41.137604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:41.137604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:41.137604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:41.137604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:41.137604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:41.137604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:41.137604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:41.137604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:41.137604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:41.137604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:41.137604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:41.137604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:41.137604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:41.137604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:41.138406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:41.138406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:41.138406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:41.138406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:41.138406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:41.138406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:41.138406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:41.138406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:41.138406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:41.138406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:41.138406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:41.138406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:41.138406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:41.138406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:41.138406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:41.138406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:41.139938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:41.139938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:41.139938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:41.139938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:41.139938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:41.139938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:41.139938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:41.139938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:41.139938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:41.139938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:41.139938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:22:41.139938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:41.139938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 74/148] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:22:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:41.144463 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf206f-17fb-4736-a732-36edac7225f0 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:41.244888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf206f-17fb-4736-a732-36edac7225f0 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:41.247303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3da1-d1a4-442c-8e27-109b616483a6 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:41.253384 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:41.280810 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31199f-3c70-4fe3-9ec6-0b42190ccd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:41.281428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31199f-3c70-4fe3-9ec6-0b42190ccd58 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:41.281708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31199f-3c70-4fe3-9ec6-0b42190ccd58 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:41.281980 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31199f-3c70-4fe3-9ec6-0b42190ccd58 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:41.282642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31199f-3c70-4fe3-9ec6-0b42190ccd58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:41.282966 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31199f-3c70-4fe3-9ec6-0b42190ccd58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:41.284335 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31199f-3c70-4fe3-9ec6-0b42190ccd58 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:41.294696 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 75/149] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:41.295370 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31199f-3c70-4fe3-9ec6-0b42190ccd58 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:41.349129 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee3da1-d1a4-442c-8e27-109b616483a6 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:41.382234 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7556b4-a6ac-47c3-9225-ee1d34894f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:41.382784 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7556b4-a6ac-47c3-9225-ee1d34894f74 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:41.383100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7556b4-a6ac-47c3-9225-ee1d34894f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:41.383377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7556b4-a6ac-47c3-9225-ee1d34894f74 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:41.384543 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7556b4-a6ac-47c3-9225-ee1d34894f74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:41.386035 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7556b4-a6ac-47c3-9225-ee1d34894f74 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:41.387634 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 75/150] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:22:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:41.388393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7556b4-a6ac-47c3-9225-ee1d34894f74 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:41.399109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31199f-3c70-4fe3-9ec6-0b42190ccd58 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:41.418485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:41.433198 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e85eef-59e9-43e9-af93-47e4faa15171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:41.433829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e85eef-59e9-43e9-af93-47e4faa15171 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:41.434110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e85eef-59e9-43e9-af93-47e4faa15171 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:41.434390 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e85eef-59e9-43e9-af93-47e4faa15171 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:41.444326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e85eef-59e9-43e9-af93-47e4faa15171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:41.449567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-48e85eef-59e9-43e9-af93-47e4faa15171 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:22:41.449567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:41.449567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:41.449567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:41.449567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:41.449567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:41.449567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:41.449567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:41.449567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:41.449567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:41.449567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:41.449567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:41.449567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:41.449567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:41.449567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:41.449567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:41.450650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:41.450650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:41.450650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:41.450650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:41.450650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:41.450650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:41.450650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:41.450650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:41.450650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:41.450650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:41.450650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:41.450650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:41.450650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:41.450650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:41.450650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:41.450650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:41.451761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:41.451761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:41.451761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:41.451761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:41.451761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:41.451761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:41.451761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:41.451761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:41.451761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:41.451761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:41.451761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:22:41.451761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:22:41.451761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 76/151] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Oct 20 13:22:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:41.451761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e85eef-59e9-43e9-af93-47e4faa15171 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:41.479558 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:41.490813 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7556b4-a6ac-47c3-9225-ee1d34894f74 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:41.525629 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17339d5a-31d7-452f-8a12-687135640a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:41.526263 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17339d5a-31d7-452f-8a12-687135640a97 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:41.526544 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17339d5a-31d7-452f-8a12-687135640a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:41.526823 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17339d5a-31d7-452f-8a12-687135640a97 None admin] PATH_INFO: `/v3/users/e32d0f0f686f487a9b949c6cb49dcef8` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:41.540692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17339d5a-31d7-452f-8a12-687135640a97 None admin] RBAC: Authorizing `identity:get_user(user_id=e32d0f0f686f487a9b949c6cb49dcef8)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:41.542414 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17339d5a-31d7-452f-8a12-687135640a97 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:41.544054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 76/152] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:41 2022] GET /identity/v3/users/e32d0f0f686f487a9b949c6cb49dcef8 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:41.544825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17339d5a-31d7-452f-8a12-687135640a97 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:41.553452 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e85eef-59e9-43e9-af93-47e4faa15171 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:41.586774 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549bd43-294d-4f02-b9cc-b73f5dad1b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:41.587450 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549bd43-294d-4f02-b9cc-b73f5dad1b14 None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:41.587745 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549bd43-294d-4f02-b9cc-b73f5dad1b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:41.588022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8549bd43-294d-4f02-b9cc-b73f5dad1b14 None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:41.588681 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549bd43-294d-4f02-b9cc-b73f5dad1b14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:41.590144 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8549bd43-294d-4f02-b9cc-b73f5dad1b14 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:41.611652 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 77/153] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:22:41 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:22:41.612544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549bd43-294d-4f02-b9cc-b73f5dad1b14 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:41.649687 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:41.663806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17339d5a-31d7-452f-8a12-687135640a97 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:41.703089 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128d3e6-434d-4983-bf1e-eb1159c162b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:41.703842 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128d3e6-434d-4983-bf1e-eb1159c162b2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:41.704124 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128d3e6-434d-4983-bf1e-eb1159c162b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:41.704395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128d3e6-434d-4983-bf1e-eb1159c162b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:41.705095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128d3e6-434d-4983-bf1e-eb1159c162b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:41.705483 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128d3e6-434d-4983-bf1e-eb1159c162b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:41.706929 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128d3e6-434d-4983-bf1e-eb1159c162b2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:41.715580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:41.722229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 77/154] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:22:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:41.724056 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128d3e6-434d-4983-bf1e-eb1159c162b2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:41.741197 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8549bd43-294d-4f02-b9cc-b73f5dad1b14 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:41.789980 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2fe48-cc99-430c-a1a4-4489cb97a1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:41.790637 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2fe48-cc99-430c-a1a4-4489cb97a1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:41.790926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2fe48-cc99-430c-a1a4-4489cb97a1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:41.791233 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2fe48-cc99-430c-a1a4-4489cb97a1b0 None admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:41.792626 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2fe48-cc99-430c-a1a4-4489cb97a1b0 None admin] RBAC: Authorizing `identity:get_project(project_id=1bf5e097ed8d4a1381b8224dd5a11e27)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:41.794181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2fe48-cc99-430c-a1a4-4489cb97a1b0 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:41.795951 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 78/155] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:41 2022] GET /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:41.801348 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2fe48-cc99-430c-a1a4-4489cb97a1b0 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:41.838632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128d3e6-434d-4983-bf1e-eb1159c162b2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:41.881989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e3968-f0bd-4e74-b217-ccaaa5dd5c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:41.882683 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e3968-f0bd-4e74-b217-ccaaa5dd5c0f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:41.882915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e3968-f0bd-4e74-b217-ccaaa5dd5c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:41.883231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e3968-f0bd-4e74-b217-ccaaa5dd5c0f None admin] PATH_INFO: `/v3/users/e32d0f0f686f487a9b949c6cb49dcef8` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:41.885208 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e3968-f0bd-4e74-b217-ccaaa5dd5c0f None admin] RBAC: Authorizing `identity:get_user(user_id=e32d0f0f686f487a9b949c6cb49dcef8)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:41.886675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e3968-f0bd-4e74-b217-ccaaa5dd5c0f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:41.888301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 78/156] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:41 2022] GET /identity/v3/users/e32d0f0f686f487a9b949c6cb49dcef8 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:41.897728 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e3968-f0bd-4e74-b217-ccaaa5dd5c0f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:41.922611 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:41.932030 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2fe48-cc99-430c-a1a4-4489cb97a1b0 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:41.974338 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85ea86-93af-43dc-980e-d3f5951261b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:41.975064 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85ea86-93af-43dc-980e-d3f5951261b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:41.976450 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85ea86-93af-43dc-980e-d3f5951261b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:41.976450 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85ea86-93af-43dc-980e-d3f5951261b3 None admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27/users/e32d0f0f686f487a9b949c6cb49dcef8/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:41.977629 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85ea86-93af-43dc-980e-d3f5951261b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1bf5e097ed8d4a1381b8224dd5a11e27, user_id=e32d0f0f686f487a9b949c6cb49dcef8, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:41.979136 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85ea86-93af-43dc-980e-d3f5951261b3 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:41.996007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 79/157] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:22:41 2022] PUT /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27/users/e32d0f0f686f487a9b949c6cb49dcef8/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:22:42.039024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e3968-f0bd-4e74-b217-ccaaa5dd5c0f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:42.080976 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40dbac-dbc1-48c7-a07d-f34c4a481be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:42.081689 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40dbac-dbc1-48c7-a07d-f34c4a481be9 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:42.081967 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40dbac-dbc1-48c7-a07d-f34c4a481be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:42.082241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40dbac-dbc1-48c7-a07d-f34c4a481be9 None admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:42.084514 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40dbac-dbc1-48c7-a07d-f34c4a481be9 None admin] RBAC: Authorizing `identity:get_project(project_id=1bf5e097ed8d4a1381b8224dd5a11e27)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:42.086042 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40dbac-dbc1-48c7-a07d-f34c4a481be9 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:42.087853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 79/158] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:41 2022] GET /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:42.093771 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85ea86-93af-43dc-980e-d3f5951261b3 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:42.111302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:42.215154 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85ea86-93af-43dc-980e-d3f5951261b3 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:42.251480 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c813301-d0c9-4354-959b-19fb2d2ec496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:42.252518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c813301-d0c9-4354-959b-19fb2d2ec496 None admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:42.253004 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c813301-d0c9-4354-959b-19fb2d2ec496 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:42.253508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c813301-d0c9-4354-959b-19fb2d2ec496 None admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27/users/e32d0f0f686f487a9b949c6cb49dcef8/roles/c63cd01b72aa49d5932f4b4f762fdf5c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:42.256479 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c813301-d0c9-4354-959b-19fb2d2ec496 None admin] RBAC: Authorizing `identity:create_grant(project_id=1bf5e097ed8d4a1381b8224dd5a11e27, user_id=e32d0f0f686f487a9b949c6cb49dcef8, role_id=c63cd01b72aa49d5932f4b4f762fdf5c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:42.258165 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c813301-d0c9-4354-959b-19fb2d2ec496 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:42.274592 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 80/159] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:22:42 2022] PUT /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27/users/e32d0f0f686f487a9b949c6cb49dcef8/roles/c63cd01b72aa49d5932f4b4f762fdf5c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:22:43.925962 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea2f07-ad7b-4a64-956c-ad6177500942 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:43.927052 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea2f07-ad7b-4a64-956c-ad6177500942 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:43.927052 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea2f07-ad7b-4a64-956c-ad6177500942 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:43.928467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 80/160] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:43.933803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca4226-6d11-46d1-a46e-2c1b3cb1c89e None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:43.934204 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca4226-6d11-46d1-a46e-2c1b3cb1c89e None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:43.934372 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca4226-6d11-46d1-a46e-2c1b3cb1c89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:43.952916 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-aeca4226-6d11-46d1-a46e-2c1b3cb1c89e None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:43.954080 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-aeca4226-6d11-46d1-a46e-2c1b3cb1c89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:43.988409 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576f82d-6e0d-435a-8199-cfe24a8da136 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:43.988726 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576f82d-6e0d-435a-8199-cfe24a8da136 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:43.989485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576f82d-6e0d-435a-8199-cfe24a8da136 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:43.991040 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 81/161] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:22:43.996195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c7eeb-1a6a-4718-921d-1355a58cb42e None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:43.996482 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c7eeb-1a6a-4718-921d-1355a58cb42e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:43.996761 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c7eeb-1a6a-4718-921d-1355a58cb42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:44.015787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-110c7eeb-1a6a-4718-921d-1355a58cb42e None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:44.017027 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-110c7eeb-1a6a-4718-921d-1355a58cb42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:44.036235 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 81/162] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:44.089021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 82/163] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:44.243512 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9d36f-e2fd-451f-b1b2-19e1f6114a8a None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:44.243798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9d36f-e2fd-451f-b1b2-19e1f6114a8a None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:44.243987 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9d36f-e2fd-451f-b1b2-19e1f6114a8a None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:44.245400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 82/164] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:44.250679 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c6dcb-d86d-489d-8dca-fe84d0273219 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:44.250991 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c6dcb-d86d-489d-8dca-fe84d0273219 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:44.251276 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c6dcb-d86d-489d-8dca-fe84d0273219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:44.270188 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-124c6dcb-d86d-489d-8dca-fe84d0273219 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:44.271537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-124c6dcb-d86d-489d-8dca-fe84d0273219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:44.282675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:44.306816 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9d36f-e2fd-451f-b1b2-19e1f6114a8a None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:44.309767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:44.341105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 83/165] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:44.362747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c6dcb-d86d-489d-8dca-fe84d0273219 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:44.434520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9d36f-e2fd-451f-b1b2-19e1f6114a8a None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:44.471017 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbe063-68df-4150-897b-2dd99cccb2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:44.471883 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbe063-68df-4150-897b-2dd99cccb2b8 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:44.472300 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbe063-68df-4150-897b-2dd99cccb2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:44.472834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbe063-68df-4150-897b-2dd99cccb2b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:44.485326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbe063-68df-4150-897b-2dd99cccb2b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:44.486618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c6dcb-d86d-489d-8dca-fe84d0273219 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:44.492869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-75fbe063-68df-4150-897b-2dd99cccb2b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:44.492869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:44.492869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:44.492869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:44.492869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:44.492869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:44.492869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:44.492869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:44.492869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:44.492869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:44.492869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:44.492869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:44.492869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:44.492869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:44.492869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:44.492869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:44.493968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:44.493968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:44.493968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:44.493968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:44.493968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:44.493968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:44.493968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:44.493968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:44.493968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:44.493968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:44.493968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:44.493968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:44.493968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:44.493968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:44.493968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:44.493968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:44.494973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:44.494973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:44.494973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:44.494973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:44.494973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:44.494973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:44.494973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:44.494973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:44.494973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:44.494973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:44.494973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:44.494973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:22:44.496226 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 83/166] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:44.498406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311ab07-0939-4dbc-97b1-45f0e8422aab None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:44.498901 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311ab07-0939-4dbc-97b1-45f0e8422aab None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:44.499433 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311ab07-0939-4dbc-97b1-45f0e8422aab None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:44.502583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 84/167] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:22:44.504175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311ab07-0939-4dbc-97b1-45f0e8422aab None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:44.527417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb35b5-6b8f-4c6b-8e06-3807f265a5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:44.528052 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb35b5-6b8f-4c6b-8e06-3807f265a5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:44.528330 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb35b5-6b8f-4c6b-8e06-3807f265a5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:44.528601 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb35b5-6b8f-4c6b-8e06-3807f265a5f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:44.529718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb35b5-6b8f-4c6b-8e06-3807f265a5f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:44.531232 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb35b5-6b8f-4c6b-8e06-3807f265a5f9 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:44.532805 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 84/168] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:22:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:44.537310 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd708661-4030-4a6b-bfae-3f7bef0ee44c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:44.537310 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd708661-4030-4a6b-bfae-3f7bef0ee44c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:44.537310 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd708661-4030-4a6b-bfae-3f7bef0ee44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:44.553655 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-dd708661-4030-4a6b-bfae-3f7bef0ee44c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:44.554840 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-dd708661-4030-4a6b-bfae-3f7bef0ee44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:44.564387 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:44.587186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:44.622848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 85/169] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:44.623714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd708661-4030-4a6b-bfae-3f7bef0ee44c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:44.631677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311ab07-0939-4dbc-97b1-45f0e8422aab None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:44.667725 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d011d1-b6e9-4dba-90a5-9c79f1c6c6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:44.668424 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d011d1-b6e9-4dba-90a5-9c79f1c6c6af None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:44.668723 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d011d1-b6e9-4dba-90a5-9c79f1c6c6af None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:44.668989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d011d1-b6e9-4dba-90a5-9c79f1c6c6af None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:44.669709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d011d1-b6e9-4dba-90a5-9c79f1c6c6af None admin] RBAC: Adding query filter params (name=member) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:44.670065 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d011d1-b6e9-4dba-90a5-9c79f1c6c6af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:44.671708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d011d1-b6e9-4dba-90a5-9c79f1c6c6af None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:44.686745 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 85/170] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:22:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:44.686745 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d011d1-b6e9-4dba-90a5-9c79f1c6c6af None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:44.730760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd708661-4030-4a6b-bfae-3f7bef0ee44c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:44.767378 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb699904-8855-462b-91c0-068af8f9a10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:44.767920 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb699904-8855-462b-91c0-068af8f9a10b None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:44.768195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb699904-8855-462b-91c0-068af8f9a10b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:44.768543 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb699904-8855-462b-91c0-068af8f9a10b None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:44.769196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb699904-8855-462b-91c0-068af8f9a10b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:44.770766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb699904-8855-462b-91c0-068af8f9a10b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:44.786697 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:44.794695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d011d1-b6e9-4dba-90a5-9c79f1c6c6af None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:44.803340 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 86/171] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:22:44 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:22:44.804430 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb699904-8855-462b-91c0-068af8f9a10b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:44.828547 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:44.850738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43601860-453c-4688-bac4-3ceb549870ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:44.851430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43601860-453c-4688-bac4-3ceb549870ab None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:44.851705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43601860-453c-4688-bac4-3ceb549870ab None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:44.851973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43601860-453c-4688-bac4-3ceb549870ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:44.866186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43601860-453c-4688-bac4-3ceb549870ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:44.874045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-43601860-453c-4688-bac4-3ceb549870ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:22:44.874045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:44.874045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:44.874045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:44.874045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:44.874045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:44.874045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:44.874045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:44.874045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:44.874045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:44.874045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:44.874045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:44.874045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:44.874045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:44.874045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:44.874045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:44.874915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:44.874915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:44.874915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:44.874915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:44.874915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:44.874915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:44.874915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:44.874915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:44.874915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:44.874915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:44.874915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:44.874915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:44.874915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:44.874915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:44.874915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:44.874915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:44.876025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:44.876025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:44.876025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:44.876025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:44.876025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:44.876025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:44.876025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:44.876025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:44.876025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:44.876025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:44.876025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:22:44.876025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:22:44.876025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 86/172] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:22:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:44.887028 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43601860-453c-4688-bac4-3ceb549870ab None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:44.953106 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb699904-8855-462b-91c0-068af8f9a10b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:44.993658 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc14c4f-d048-4ab9-9819-9669e1fc8994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:44.994411 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14c4f-d048-4ab9-9819-9669e1fc8994 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:44.994749 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14c4f-d048-4ab9-9819-9669e1fc8994 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:44.995156 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc14c4f-d048-4ab9-9819-9669e1fc8994 None admin] PATH_INFO: `/v3/users/7a27e923cf7740548d1b957e3901c3e8` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:45.009137 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43601860-453c-4688-bac4-3ceb549870ab None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:45.012727 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc14c4f-d048-4ab9-9819-9669e1fc8994 None admin] RBAC: Authorizing `identity:get_user(user_id=7a27e923cf7740548d1b957e3901c3e8)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:45.014427 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc14c4f-d048-4ab9-9819-9669e1fc8994 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:45.016326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 87/173] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:44 2022] GET /identity/v3/users/7a27e923cf7740548d1b957e3901c3e8 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:45.017821 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc14c4f-d048-4ab9-9819-9669e1fc8994 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:45.056602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d1547-2ebb-41c2-8168-451b80a3be3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:45.057224 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d1547-2ebb-41c2-8168-451b80a3be3b None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:45.057507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d1547-2ebb-41c2-8168-451b80a3be3b None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:45.057781 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d1547-2ebb-41c2-8168-451b80a3be3b None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:45.058453 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d1547-2ebb-41c2-8168-451b80a3be3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:45.058765 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d1547-2ebb-41c2-8168-451b80a3be3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:45.060205 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d1547-2ebb-41c2-8168-451b80a3be3b None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:45.071396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 87/174] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:45.072245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d1547-2ebb-41c2-8168-451b80a3be3b None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:45.094245 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:45.126639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:45.154111 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc14c4f-d048-4ab9-9819-9669e1fc8994 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:45.196342 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d1547-2ebb-41c2-8168-451b80a3be3b None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:45.197253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ae1b0-5b21-4602-b580-d9d3614b9554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:45.197949 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ae1b0-5b21-4602-b580-d9d3614b9554 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:45.198235 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ae1b0-5b21-4602-b580-d9d3614b9554 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:45.198507 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ae1b0-5b21-4602-b580-d9d3614b9554 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:45.209981 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ae1b0-5b21-4602-b580-d9d3614b9554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:45.215893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-fd5ae1b0-5b21-4602-b580-d9d3614b9554 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:22:45.215893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:45.215893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:45.215893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:45.215893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:45.215893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:45.215893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:45.215893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:45.215893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:45.215893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:45.215893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:45.215893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:45.215893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:45.215893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:45.215893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:45.215893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:45.216772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:45.216772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:45.216772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:45.216772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:45.216772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:45.216772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:45.216772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:45.216772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:45.216772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:45.216772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:45.216772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:45.216772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:45.216772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:45.216772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:45.216772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:45.216772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:45.217555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:45.217555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:45.217555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:45.217555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:45.217555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:45.217555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:45.217555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:45.217555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:45.217555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:45.217555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:45.217555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:22:45.217555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:45.217555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 88/175] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Oct 20 13:22:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:45.218682 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ae1b0-5b21-4602-b580-d9d3614b9554 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:45.235865 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf516e65-d63d-4a45-aff3-d46c88edfa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:45.236848 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf516e65-d63d-4a45-aff3-d46c88edfa96 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:45.237352 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf516e65-d63d-4a45-aff3-d46c88edfa96 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:45.237839 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf516e65-d63d-4a45-aff3-d46c88edfa96 None admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:45.239890 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf516e65-d63d-4a45-aff3-d46c88edfa96 None admin] RBAC: Authorizing `identity:get_project(project_id=1bf5e097ed8d4a1381b8224dd5a11e27)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:45.241567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf516e65-d63d-4a45-aff3-d46c88edfa96 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:45.243514 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 88/176] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:45 2022] GET /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:45.244508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf516e65-d63d-4a45-aff3-d46c88edfa96 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:45.336969 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ae1b0-5b21-4602-b580-d9d3614b9554 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:45.356060 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf516e65-d63d-4a45-aff3-d46c88edfa96 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:45.357629 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:45.375361 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:45.380532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b142713-29ed-4bd2-a0a5-e27df18ee997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:45.381100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b142713-29ed-4bd2-a0a5-e27df18ee997 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:45.381387 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b142713-29ed-4bd2-a0a5-e27df18ee997 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:45.381725 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b142713-29ed-4bd2-a0a5-e27df18ee997 None admin] PATH_INFO: `/v3/users/e32d0f0f686f487a9b949c6cb49dcef8` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:45.383018 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b142713-29ed-4bd2-a0a5-e27df18ee997 None admin] RBAC: Authorizing `identity:get_user(user_id=e32d0f0f686f487a9b949c6cb49dcef8)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:45.384529 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b142713-29ed-4bd2-a0a5-e27df18ee997 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:45.386874 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 89/177] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:45 2022] GET /identity/v3/users/e32d0f0f686f487a9b949c6cb49dcef8 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:45.391754 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b142713-29ed-4bd2-a0a5-e27df18ee997 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:45.402182 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7b1a2-ab56-4892-ad61-4b5699214f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:45.402804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7b1a2-ab56-4892-ad61-4b5699214f27 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:45.403151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7b1a2-ab56-4892-ad61-4b5699214f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:45.403429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae7b1a2-ab56-4892-ad61-4b5699214f27 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:45.404650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7b1a2-ab56-4892-ad61-4b5699214f27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:45.404966 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7b1a2-ab56-4892-ad61-4b5699214f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:45.406357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae7b1a2-ab56-4892-ad61-4b5699214f27 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:45.417790 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 89/178] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:22:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:45.418978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7b1a2-ab56-4892-ad61-4b5699214f27 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:45.519525 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b142713-29ed-4bd2-a0a5-e27df18ee997 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:45.540149 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae7b1a2-ab56-4892-ad61-4b5699214f27 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:45.561047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899647ec-0fc2-40e3-ad73-13aefd64e31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:45.561713 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899647ec-0fc2-40e3-ad73-13aefd64e31d None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:45.561999 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899647ec-0fc2-40e3-ad73-13aefd64e31d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:45.562266 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899647ec-0fc2-40e3-ad73-13aefd64e31d None admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27/users/7a27e923cf7740548d1b957e3901c3e8/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:45.564483 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899647ec-0fc2-40e3-ad73-13aefd64e31d None admin] RBAC: Authorizing `identity:create_grant(project_id=1bf5e097ed8d4a1381b8224dd5a11e27, user_id=7a27e923cf7740548d1b957e3901c3e8, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:45.565937 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899647ec-0fc2-40e3-ad73-13aefd64e31d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:45.583107 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdcdc1-0de3-4c23-b063-cafd54410732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:45.584135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdcdc1-0de3-4c23-b063-cafd54410732 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:45.584642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdcdc1-0de3-4c23-b063-cafd54410732 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:45.585110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdcdc1-0de3-4c23-b063-cafd54410732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:45.590128 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 90/179] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:22:45 2022] PUT /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27/users/7a27e923cf7740548d1b957e3901c3e8/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:22:45.595994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899647ec-0fc2-40e3-ad73-13aefd64e31d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:45.660529 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:45.709913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:45.713641 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdcdc1-0de3-4c23-b063-cafd54410732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:45.715531 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffdcdc1-0de3-4c23-b063-cafd54410732 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:45.826017 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899647ec-0fc2-40e3-ad73-13aefd64e31d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:45.882461 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569015fb-365e-4344-a3b2-836ad6f1c8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:45.883482 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569015fb-365e-4344-a3b2-836ad6f1c8cc None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:45.883763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569015fb-365e-4344-a3b2-836ad6f1c8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:45.884034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569015fb-365e-4344-a3b2-836ad6f1c8cc None admin] PATH_INFO: `/v3/users/e32d0f0f686f487a9b949c6cb49dcef8` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:45.885835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569015fb-365e-4344-a3b2-836ad6f1c8cc None admin] RBAC: Authorizing `identity:get_user(user_id=e32d0f0f686f487a9b949c6cb49dcef8)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:45.887313 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569015fb-365e-4344-a3b2-836ad6f1c8cc None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:45.889092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 91/180] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:45 2022] GET /identity/v3/users/e32d0f0f686f487a9b949c6cb49dcef8 => generated 283 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:45.895263 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569015fb-365e-4344-a3b2-836ad6f1c8cc None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:45.897674 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 90/181] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:22:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 13:22:45.912093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdcdc1-0de3-4c23-b063-cafd54410732 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:46.007849 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:46.037097 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569015fb-365e-4344-a3b2-836ad6f1c8cc None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:46.044396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffdcdc1-0de3-4c23-b063-cafd54410732 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:46.068747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:46.092814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9329f-084b-4e9d-9e24-381aafac2fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:46.093465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9329f-084b-4e9d-9e24-381aafac2fbf None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:46.093747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9329f-084b-4e9d-9e24-381aafac2fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:46.094021 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9329f-084b-4e9d-9e24-381aafac2fbf None admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:46.096056 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd8ce4-05ea-4e46-bbd9-f45517fbae22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:46.096666 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd8ce4-05ea-4e46-bbd9-f45517fbae22 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:46.096938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd8ce4-05ea-4e46-bbd9-f45517fbae22 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:46.097205 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd8ce4-05ea-4e46-bbd9-f45517fbae22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:46.099673 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9329f-084b-4e9d-9e24-381aafac2fbf None admin] RBAC: Authorizing `identity:get_project(project_id=1bf5e097ed8d4a1381b8224dd5a11e27)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:46.101156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9329f-084b-4e9d-9e24-381aafac2fbf None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:46.102847 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 91/182] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:45 2022] GET /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:46.115953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9329f-084b-4e9d-9e24-381aafac2fbf None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:46.213690 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd8ce4-05ea-4e46-bbd9-f45517fbae22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:46.215219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd8ce4-05ea-4e46-bbd9-f45517fbae22 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:46.309856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9329f-084b-4e9d-9e24-381aafac2fbf None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:46.356640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 92/183] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:22:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 13:22:46.362212 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd8ce4-05ea-4e46-bbd9-f45517fbae22 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:46.366473 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff92f31-0115-431e-a769-ccc91e1a7a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:46.367134 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff92f31-0115-431e-a769-ccc91e1a7a28 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:46.367413 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff92f31-0115-431e-a769-ccc91e1a7a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:46.367682 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff92f31-0115-431e-a769-ccc91e1a7a28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:46.368413 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff92f31-0115-431e-a769-ccc91e1a7a28 None admin] RBAC: Adding query filter params (role.id=9c0f227afc2e4a0aa404780de229488c, scope.project.id=1bf5e097ed8d4a1381b8224dd5a11e27, user.id=e32d0f0f686f487a9b949c6cb49dcef8) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:46.368717 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff92f31-0115-431e-a769-ccc91e1a7a28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:46.370169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff92f31-0115-431e-a769-ccc91e1a7a28 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:46.376528 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 92/184] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:22:46 2022] GET /identity/v3/role_assignments?user.id=e32d0f0f686f487a9b949c6cb49dcef8&scope.project.id=1bf5e097ed8d4a1381b8224dd5a11e27&role.id=9c0f227afc2e4a0aa404780de229488c => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:46.388292 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:46.510598 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd8ce4-05ea-4e46-bbd9-f45517fbae22 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:46.547146 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b44a9-a4c3-46d4-b9ca-40afeb6cdd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:46.547787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b44a9-a4c3-46d4-b9ca-40afeb6cdd09 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:46.548065 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b44a9-a4c3-46d4-b9ca-40afeb6cdd09 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:46.548382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b44a9-a4c3-46d4-b9ca-40afeb6cdd09 None admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:46.549517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b44a9-a4c3-46d4-b9ca-40afeb6cdd09 None admin] RBAC: Authorizing `identity:get_project(project_id=1bf5e097ed8d4a1381b8224dd5a11e27)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:46.550978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b44a9-a4c3-46d4-b9ca-40afeb6cdd09 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:46.552781 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 93/185] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:46 2022] GET /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:46.558885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff92f31-0115-431e-a769-ccc91e1a7a28 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:46.574362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:46.690359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff92f31-0115-431e-a769-ccc91e1a7a28 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:46.727578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cb50b-b44a-4ac3-b48d-43436c93e07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:46.728251 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cb50b-b44a-4ac3-b48d-43436c93e07b None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:46.728540 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cb50b-b44a-4ac3-b48d-43436c93e07b None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:46.728815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cb50b-b44a-4ac3-b48d-43436c93e07b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:46.729549 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cb50b-b44a-4ac3-b48d-43436c93e07b None admin] RBAC: Adding query filter params (role.id=c63cd01b72aa49d5932f4b4f762fdf5c, scope.project.id=1bf5e097ed8d4a1381b8224dd5a11e27, user.id=e32d0f0f686f487a9b949c6cb49dcef8) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:46.729864 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cb50b-b44a-4ac3-b48d-43436c93e07b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:46.731409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cb50b-b44a-4ac3-b48d-43436c93e07b None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:46.737764 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 93/186] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:22:46 2022] GET /identity/v3/role_assignments?user.id=e32d0f0f686f487a9b949c6cb49dcef8&scope.project.id=1bf5e097ed8d4a1381b8224dd5a11e27&role.id=c63cd01b72aa49d5932f4b4f762fdf5c => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:47.310656 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec537-6cf4-48db-a9df-a17452def9f4 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:47.311191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec537-6cf4-48db-a9df-a17452def9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:47.311266 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ec537-6cf4-48db-a9df-a17452def9f4 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:47.312760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 94/187] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:47.318380 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2143b7-a85f-4e4b-a1e2-2d7994cfbb77 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:47.318784 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2143b7-a85f-4e4b-a1e2-2d7994cfbb77 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:47.318981 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2143b7-a85f-4e4b-a1e2-2d7994cfbb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:47.336948 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-cb2143b7-a85f-4e4b-a1e2-2d7994cfbb77 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:47.338139 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-cb2143b7-a85f-4e4b-a1e2-2d7994cfbb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:47.371886 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c20880-a3ae-4303-986f-d0069254fbf8 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:47.372222 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c20880-a3ae-4303-986f-d0069254fbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:47.372451 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c20880-a3ae-4303-986f-d0069254fbf8 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:47.373921 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 95/188] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:22:47.378510 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa953a9-d50c-4c1f-aeed-010627893ef2 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:47.378796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa953a9-d50c-4c1f-aeed-010627893ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:47.379105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa953a9-d50c-4c1f-aeed-010627893ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:47.396873 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-6aa953a9-d50c-4c1f-aeed-010627893ef2 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:47.398136 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6aa953a9-d50c-4c1f-aeed-010627893ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:47.414987 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 94/189] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:47.467692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 96/190] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:47.680478 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2143b7-a85f-4e4b-a1e2-2d7994cfbb77 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:47.682831 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:47.737951 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa953a9-d50c-4c1f-aeed-010627893ef2 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:47.751943 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:47.787107 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2143b7-a85f-4e4b-a1e2-2d7994cfbb77 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:47.824111 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33644bea-ce2b-41cc-bd0b-1062edc5a262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:47.825062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33644bea-ce2b-41cc-bd0b-1062edc5a262 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:47.825532 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33644bea-ce2b-41cc-bd0b-1062edc5a262 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:47.826101 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33644bea-ce2b-41cc-bd0b-1062edc5a262 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:47.838138 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33644bea-ce2b-41cc-bd0b-1062edc5a262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:47.838371 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa953a9-d50c-4c1f-aeed-010627893ef2 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:47.843295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-33644bea-ce2b-41cc-bd0b-1062edc5a262 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 13:22:47.843295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:47.843295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:47.843295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:47.843295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:47.843295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:47.843295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:47.843295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:47.843295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:47.843295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:47.843295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:47.843295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:47.843295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:47.843295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:47.843295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:47.843295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:47.844156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:47.844156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:47.844156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:47.844156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:47.844156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:47.844156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:47.844156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:47.844156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:47.844156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:47.844156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:47.844156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:47.844156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:47.844156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:47.844156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:47.844156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:47.844156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:47.844942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:47.844942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:47.844942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:47.844942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:47.844942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:47.844942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:47.844942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:47.844942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:47.844942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:47.844942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:47.844942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 13:22:47.844942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:22:47.844942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 95/191] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:47.850137 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33644bea-ce2b-41cc-bd0b-1062edc5a262 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:47.876937 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633e607-8b18-406e-8b1d-ccfe2c277685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:47.877572 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633e607-8b18-406e-8b1d-ccfe2c277685 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:47.877848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633e607-8b18-406e-8b1d-ccfe2c277685 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:47.878119 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633e607-8b18-406e-8b1d-ccfe2c277685 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:47.879381 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633e607-8b18-406e-8b1d-ccfe2c277685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:47.881996 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633e607-8b18-406e-8b1d-ccfe2c277685 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:47.882722 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 97/192] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:22:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:47.887968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633e607-8b18-406e-8b1d-ccfe2c277685 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:47.928112 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:47.969271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33644bea-ce2b-41cc-bd0b-1062edc5a262 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:47.975128 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:47.999347 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633e607-8b18-406e-8b1d-ccfe2c277685 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:48.008983 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3911efc-8b0a-439e-9615-4384639bb7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:48.009682 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3911efc-8b0a-439e-9615-4384639bb7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:48.009962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3911efc-8b0a-439e-9615-4384639bb7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:48.010236 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3911efc-8b0a-439e-9615-4384639bb7f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:48.011081 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3911efc-8b0a-439e-9615-4384639bb7f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:48.011391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3911efc-8b0a-439e-9615-4384639bb7f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:48.012934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3911efc-8b0a-439e-9615-4384639bb7f2 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:48.027002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 96/193] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:22:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:48.027774 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3911efc-8b0a-439e-9615-4384639bb7f2 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:48.038029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408f779-0cc2-42bd-a293-f670fa796ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:48.038639 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408f779-0cc2-42bd-a293-f670fa796ee1 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:48.038915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408f779-0cc2-42bd-a293-f670fa796ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:48.039217 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408f779-0cc2-42bd-a293-f670fa796ee1 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:48.039872 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408f779-0cc2-42bd-a293-f670fa796ee1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:48.041610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408f779-0cc2-42bd-a293-f670fa796ee1 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:48.067790 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 98/194] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:22:47 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:22:48.104154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37700267-f294-4a70-969f-89aad8a59fdc None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:48.104478 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37700267-f294-4a70-969f-89aad8a59fdc None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:48.104719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37700267-f294-4a70-969f-89aad8a59fdc None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:48.106141 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 99/195] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:22:48.111853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21afea-d817-4574-94aa-919441f4ec12 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:48.112144 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21afea-d817-4574-94aa-919441f4ec12 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:48.112419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21afea-d817-4574-94aa-919441f4ec12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:48.132630 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-be21afea-d817-4574-94aa-919441f4ec12 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:48.134138 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-be21afea-d817-4574-94aa-919441f4ec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:48.149913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3911efc-8b0a-439e-9615-4384639bb7f2 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:48.178973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:48.191528 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badf7d7-1d85-4224-a3f7-b20427e545cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:48.192445 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badf7d7-1d85-4224-a3f7-b20427e545cc None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:48.192729 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badf7d7-1d85-4224-a3f7-b20427e545cc None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:48.193005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badf7d7-1d85-4224-a3f7-b20427e545cc None admin] PATH_INFO: `/v3/users/4fb0b4422d4b46f6b550d68af16f67e2` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:48.207875 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badf7d7-1d85-4224-a3f7-b20427e545cc None admin] RBAC: Authorizing `identity:get_user(user_id=4fb0b4422d4b46f6b550d68af16f67e2)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:48.209538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badf7d7-1d85-4224-a3f7-b20427e545cc None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:48.211578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 97/196] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:48 2022] GET /identity/v3/users/4fb0b4422d4b46f6b550d68af16f67e2 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:48.213812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 100/197] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:48.220341 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badf7d7-1d85-4224-a3f7-b20427e545cc None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:48.326549 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badf7d7-1d85-4224-a3f7-b20427e545cc None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:48.362315 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea3203-ec2a-4dc9-b2ca-600fb315e55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:48.363034 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea3203-ec2a-4dc9-b2ca-600fb315e55e None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:48.363321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea3203-ec2a-4dc9-b2ca-600fb315e55e None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:48.364132 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea3203-ec2a-4dc9-b2ca-600fb315e55e None admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:48.365365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea3203-ec2a-4dc9-b2ca-600fb315e55e None admin] RBAC: Authorizing `identity:get_project(project_id=1bf5e097ed8d4a1381b8224dd5a11e27)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:48.366846 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea3203-ec2a-4dc9-b2ca-600fb315e55e None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:48.368699 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 98/198] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:48 2022] GET /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:48.374567 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21afea-d817-4574-94aa-919441f4ec12 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:48.450736 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:48.492743 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21afea-d817-4574-94aa-919441f4ec12 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:48.501867 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea3203-ec2a-4dc9-b2ca-600fb315e55e None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:48.534824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7893d1b-051e-4d25-9c35-778673f2f013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:48.535584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7893d1b-051e-4d25-9c35-778673f2f013 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:48.535924 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7893d1b-051e-4d25-9c35-778673f2f013 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:48.536194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7893d1b-051e-4d25-9c35-778673f2f013 None admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27/users/4fb0b4422d4b46f6b550d68af16f67e2/roles/5c7df19d9a1a45cabf65945ba964abe8` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:48.539008 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7893d1b-051e-4d25-9c35-778673f2f013 None admin] RBAC: Authorizing `identity:create_grant(project_id=1bf5e097ed8d4a1381b8224dd5a11e27, user_id=4fb0b4422d4b46f6b550d68af16f67e2, role_id=5c7df19d9a1a45cabf65945ba964abe8)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:48.540611 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7893d1b-051e-4d25-9c35-778673f2f013 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:48.561168 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 101/199] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:22:48 2022] PUT /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27/users/4fb0b4422d4b46f6b550d68af16f67e2/roles/5c7df19d9a1a45cabf65945ba964abe8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:22:48.567317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:48.633701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea3203-ec2a-4dc9-b2ca-600fb315e55e None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:48.676445 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cf986-1b01-4591-ad36-a5bdafe7acca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:48.677189 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cf986-1b01-4591-ad36-a5bdafe7acca None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:48.677511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cf986-1b01-4591-ad36-a5bdafe7acca None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:48.677792 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4cf986-1b01-4591-ad36-a5bdafe7acca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:48.690090 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4cf986-1b01-4591-ad36-a5bdafe7acca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:48.695861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-4b4cf986-1b01-4591-ad36-a5bdafe7acca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:48.695861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:48.695861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:48.695861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:48.695861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:48.695861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:48.695861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:48.695861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:48.695861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:48.695861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:48.695861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:48.695861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:48.695861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:48.695861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:48.695861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:48.695861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:48.696801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:48.696801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:48.696801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:48.696801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:48.696801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:48.696801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:48.696801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:48.696801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:48.696801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:48.696801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:48.696801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:48.696801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:48.696801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:48.696801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:48.696801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:48.696801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:48.697580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:48.697580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:48.697580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:48.697580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:48.697580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:48.697580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:48.697580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:48.697580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:48.697580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:48.697580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:48.697580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:48.697580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:22:48.697580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 99/200] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:48.703325 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7893d1b-051e-4d25-9c35-778673f2f013 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:48.814940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7893d1b-051e-4d25-9c35-778673f2f013 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:48.841755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:48.853648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f30078-c644-4e73-a28e-5fa55efee993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:48.854268 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f30078-c644-4e73-a28e-5fa55efee993 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:48.854551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f30078-c644-4e73-a28e-5fa55efee993 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:48.854826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f30078-c644-4e73-a28e-5fa55efee993 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:48.855598 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f30078-c644-4e73-a28e-5fa55efee993 None admin] RBAC: Adding query filter params (name=member) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:48.855909 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f30078-c644-4e73-a28e-5fa55efee993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:48.857341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f30078-c644-4e73-a28e-5fa55efee993 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:48.867313 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 102/201] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:22:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:48.872927 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cf986-1b01-4591-ad36-a5bdafe7acca None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:48.985293 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4cf986-1b01-4591-ad36-a5bdafe7acca None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:48.996806 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:49.023946 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e845e-dbbe-453a-9216-1c896cc2d36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:49.024589 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e845e-dbbe-453a-9216-1c896cc2d36d None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:49.024871 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e845e-dbbe-453a-9216-1c896cc2d36d None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:49.025151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e845e-dbbe-453a-9216-1c896cc2d36d None admin] PATH_INFO: `/v3/users/7a27e923cf7740548d1b957e3901c3e8` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:49.026319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e845e-dbbe-453a-9216-1c896cc2d36d None admin] RBAC: Authorizing `identity:get_user(user_id=7a27e923cf7740548d1b957e3901c3e8)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:49.027825 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e845e-dbbe-453a-9216-1c896cc2d36d None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:49.029767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 100/202] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:48 2022] GET /identity/v3/users/7a27e923cf7740548d1b957e3901c3e8 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:49.035219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f30078-c644-4e73-a28e-5fa55efee993 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:49.142398 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f30078-c644-4e73-a28e-5fa55efee993 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:49.179383 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176b2a8-98a5-46f2-83cf-088e20174bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:49.180020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176b2a8-98a5-46f2-83cf-088e20174bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:49.180302 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176b2a8-98a5-46f2-83cf-088e20174bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:49.180576 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176b2a8-98a5-46f2-83cf-088e20174bb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:49.245693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:49.256535 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176b2a8-98a5-46f2-83cf-088e20174bb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:49.258328 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176b2a8-98a5-46f2-83cf-088e20174bb9 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:49.358849 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 103/203] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:22:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 13:22:49.364491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e845e-dbbe-453a-9216-1c896cc2d36d None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:49.469651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e845e-dbbe-453a-9216-1c896cc2d36d None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:49.507216 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b86db-3114-47ad-b3d2-1f244a675074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:49.507862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b86db-3114-47ad-b3d2-1f244a675074 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:49.508188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b86db-3114-47ad-b3d2-1f244a675074 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:49.508471 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b86db-3114-47ad-b3d2-1f244a675074 None admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:49.509697 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b86db-3114-47ad-b3d2-1f244a675074 None admin] RBAC: Authorizing `identity:get_project(project_id=1bf5e097ed8d4a1381b8224dd5a11e27)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:49.511194 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b86db-3114-47ad-b3d2-1f244a675074 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:49.512848 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 101/204] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:49 2022] GET /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:49.519009 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176b2a8-98a5-46f2-83cf-088e20174bb9 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:49.616978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:49.629610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176b2a8-98a5-46f2-83cf-088e20174bb9 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:49.663539 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090acb41-8968-4801-acf3-bdaf9e3b6267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:49.664488 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090acb41-8968-4801-acf3-bdaf9e3b6267 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:49.664993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090acb41-8968-4801-acf3-bdaf9e3b6267 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:49.665466 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090acb41-8968-4801-acf3-bdaf9e3b6267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:49.666632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090acb41-8968-4801-acf3-bdaf9e3b6267 None admin] RBAC: Adding query filter params (role.id=233938f0e7e84b5098019470ad8cfb4e, scope.project.id=1bf5e097ed8d4a1381b8224dd5a11e27, user.id=7a27e923cf7740548d1b957e3901c3e8) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:49.667165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090acb41-8968-4801-acf3-bdaf9e3b6267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:49.668782 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090acb41-8968-4801-acf3-bdaf9e3b6267 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:49.674703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 104/205] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:22:49 2022] GET /identity/v3/role_assignments?user.id=7a27e923cf7740548d1b957e3901c3e8&scope.project.id=1bf5e097ed8d4a1381b8224dd5a11e27&role.id=233938f0e7e84b5098019470ad8cfb4e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:50.495630 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbc98a-26d5-472b-98ea-139eca97a802 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:50.496145 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbc98a-26d5-472b-98ea-139eca97a802 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:50.496145 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbc98a-26d5-472b-98ea-139eca97a802 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:50.497508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 102/206] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:50.502877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e643ca-2004-48f2-b9a2-55bf90b1ff5c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:50.503278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e643ca-2004-48f2-b9a2-55bf90b1ff5c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:50.503759 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e643ca-2004-48f2-b9a2-55bf90b1ff5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:50.522725 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-26e643ca-2004-48f2-b9a2-55bf90b1ff5c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:50.523955 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-26e643ca-2004-48f2-b9a2-55bf90b1ff5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:50.549470 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57aff4-eeb9-49c9-988f-6cf39fca3d1a None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:50.549751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57aff4-eeb9-49c9-988f-6cf39fca3d1a None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:50.550022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57aff4-eeb9-49c9-988f-6cf39fca3d1a None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:50.552282 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 103/207] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:50.556999 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b0bfa-b9c3-47a4-b52c-54fcdb06809f None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:50.557293 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b0bfa-b9c3-47a4-b52c-54fcdb06809f None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:50.557570 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399b0bfa-b9c3-47a4-b52c-54fcdb06809f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:50.575404 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-399b0bfa-b9c3-47a4-b52c-54fcdb06809f None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:50.576594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-399b0bfa-b9c3-47a4-b52c-54fcdb06809f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:50.596616 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 105/208] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:50.625617 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:50.651517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 104/209] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:50.866723 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e643ca-2004-48f2-b9a2-55bf90b1ff5c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:50.880577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621a1de-aa71-4041-880d-3a5eb97f9ce8 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:50.880866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621a1de-aa71-4041-880d-3a5eb97f9ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:50.881145 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621a1de-aa71-4041-880d-3a5eb97f9ce8 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:50.882646 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 105/210] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:22:50.887592 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110d94e-1204-4fe2-a32a-73f5641ae3c8 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:50.887886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110d94e-1204-4fe2-a32a-73f5641ae3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:50.888147 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110d94e-1204-4fe2-a32a-73f5641ae3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:50.906522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-5110d94e-1204-4fe2-a32a-73f5641ae3c8 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:50.907760 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-5110d94e-1204-4fe2-a32a-73f5641ae3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:50.953912 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:50.972396 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e643ca-2004-48f2-b9a2-55bf90b1ff5c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:50.975861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 106/211] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:50.976773 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110d94e-1204-4fe2-a32a-73f5641ae3c8 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:51.009415 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cf513-f0d9-429d-87b7-c43afc9152df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:51.010106 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cf513-f0d9-429d-87b7-c43afc9152df None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:51.010394 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cf513-f0d9-429d-87b7-c43afc9152df None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:51.010669 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cf513-f0d9-429d-87b7-c43afc9152df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:51.021268 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cf513-f0d9-429d-87b7-c43afc9152df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:51.026033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f10cf513-f0d9-429d-87b7-c43afc9152df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:51.026033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:51.026033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:51.026033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:51.026033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:51.026033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:51.026033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:51.026033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:51.026033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:51.026033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:51.026033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:51.026033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:51.026033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:51.026033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:51.026033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:51.026033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:51.027002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:51.027002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:51.027002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:51.027002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:51.027002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:51.027002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:51.027002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:51.027002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:51.027002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:51.027002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:51.027002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:51.027002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:51.027002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:51.027002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:51.027002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:51.027002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:51.028155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:51.028155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:51.028155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:51.028155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:51.028155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:51.028155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:51.028155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:51.028155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:51.028155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:51.028155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:51.028155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:51.028155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:51.028155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 106/212] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:51.032785 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cf513-f0d9-429d-87b7-c43afc9152df None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:51.081335 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110d94e-1204-4fe2-a32a-73f5641ae3c8 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:51.088951 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:51.118209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07af3d-ed71-44f3-be3a-c3d6e799eab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:51.118771 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07af3d-ed71-44f3-be3a-c3d6e799eab9 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:51.119078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07af3d-ed71-44f3-be3a-c3d6e799eab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:51.119351 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07af3d-ed71-44f3-be3a-c3d6e799eab9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:51.120486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07af3d-ed71-44f3-be3a-c3d6e799eab9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:51.121917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07af3d-ed71-44f3-be3a-c3d6e799eab9 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:51.123704 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 107/213] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:22:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:51.128840 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07af3d-ed71-44f3-be3a-c3d6e799eab9 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:51.143344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cf513-f0d9-429d-87b7-c43afc9152df None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:51.183603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3a4c8-4b78-4803-8d4c-530d646cd387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:51.184351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3a4c8-4b78-4803-8d4c-530d646cd387 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:51.184766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3a4c8-4b78-4803-8d4c-530d646cd387 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:51.185042 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3a4c8-4b78-4803-8d4c-530d646cd387 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:51.185815 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3a4c8-4b78-4803-8d4c-530d646cd387 None admin] RBAC: Adding query filter params (name=member) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:51.186128 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3a4c8-4b78-4803-8d4c-530d646cd387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:51.187640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3a4c8-4b78-4803-8d4c-530d646cd387 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:51.203398 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 107/214] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:22:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:51.204715 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3a4c8-4b78-4803-8d4c-530d646cd387 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:51.209004 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:51.235249 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07af3d-ed71-44f3-be3a-c3d6e799eab9 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:51.268866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca3e9a-01ab-4679-ac54-ab3bf66fd2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:51.269469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca3e9a-01ab-4679-ac54-ab3bf66fd2c0 None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:51.270352 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca3e9a-01ab-4679-ac54-ab3bf66fd2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:51.270624 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca3e9a-01ab-4679-ac54-ab3bf66fd2c0 None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:51.271305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca3e9a-01ab-4679-ac54-ab3bf66fd2c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:51.272727 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca3e9a-01ab-4679-ac54-ab3bf66fd2c0 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:51.293161 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 108/215] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:22:51 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:22:51.294173 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca3e9a-01ab-4679-ac54-ab3bf66fd2c0 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:51.312927 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3a4c8-4b78-4803-8d4c-530d646cd387 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:51.337613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:51.354527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58172d06-1f40-49fc-bc1e-7a1735c577a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:51.355223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58172d06-1f40-49fc-bc1e-7a1735c577a2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:51.355500 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58172d06-1f40-49fc-bc1e-7a1735c577a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:51.355769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58172d06-1f40-49fc-bc1e-7a1735c577a2 None admin] PATH_INFO: `/v3/users/3592dd7c72aa4810b4f549e11c27f64f` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:51.371809 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58172d06-1f40-49fc-bc1e-7a1735c577a2 None admin] RBAC: Authorizing `identity:get_user(user_id=3592dd7c72aa4810b4f549e11c27f64f)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:51.373283 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58172d06-1f40-49fc-bc1e-7a1735c577a2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:51.375039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 108/216] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:51 2022] GET /identity/v3/users/3592dd7c72aa4810b4f549e11c27f64f => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:51.381336 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58172d06-1f40-49fc-bc1e-7a1735c577a2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:51.422449 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca3e9a-01ab-4679-ac54-ab3bf66fd2c0 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:51.452123 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:51.466815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809c33b-bc28-4650-a055-7743d3b5c205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:51.467717 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809c33b-bc28-4650-a055-7743d3b5c205 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:51.468231 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809c33b-bc28-4650-a055-7743d3b5c205 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:51.468653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809c33b-bc28-4650-a055-7743d3b5c205 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:51.480172 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809c33b-bc28-4650-a055-7743d3b5c205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:51.485466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-e809c33b-bc28-4650-a055-7743d3b5c205 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 13:22:51.485466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:51.485466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:51.485466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:51.485466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:51.485466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:51.485466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:51.485466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:51.485466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:51.485466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:51.485466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:51.485466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:51.485466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:51.485466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:51.485466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:51.485466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:51.486391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:51.486391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:51.486391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:51.486391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:51.486391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:51.486391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:51.486391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:51.486391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:51.486391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:51.486391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:51.486391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:51.486391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:51.486391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:51.486391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:51.486391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:51.486391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:51.487268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:51.487268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:51.487268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:51.487268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:51.487268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:51.487268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:51.487268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:51.487268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:51.487268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:51.487268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:51.487268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 13:22:51.487268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:22:51.487857 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 109/217] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:51.494109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809c33b-bc28-4650-a055-7743d3b5c205 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:51.499412 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58172d06-1f40-49fc-bc1e-7a1735c577a2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:51.538755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012a01a-82b4-4b91-a5b2-83777e8d7047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:51.539423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012a01a-82b4-4b91-a5b2-83777e8d7047 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:51.539648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012a01a-82b4-4b91-a5b2-83777e8d7047 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:51.539922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3012a01a-82b4-4b91-a5b2-83777e8d7047 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:51.540645 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012a01a-82b4-4b91-a5b2-83777e8d7047 None admin] RBAC: Adding query filter params (role.id=233938f0e7e84b5098019470ad8cfb4e, user.id=3592dd7c72aa4810b4f549e11c27f64f, scope.system=all) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:51.540951 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012a01a-82b4-4b91-a5b2-83777e8d7047 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:51.542635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3012a01a-82b4-4b91-a5b2-83777e8d7047 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:51.549530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 109/218] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Oct 20 13:22:51 2022] GET /identity/v3/role_assignments?user.id=3592dd7c72aa4810b4f549e11c27f64f&scope.system=all&role.id=233938f0e7e84b5098019470ad8cfb4e => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:51.610700 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:51.624066 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809c33b-bc28-4650-a055-7743d3b5c205 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:51.664863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef0553-35ee-4df3-82f0-e804c47c6b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:51.665488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef0553-35ee-4df3-82f0-e804c47c6b13 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:51.665767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef0553-35ee-4df3-82f0-e804c47c6b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:51.666041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef0553-35ee-4df3-82f0-e804c47c6b13 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:51.667078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef0553-35ee-4df3-82f0-e804c47c6b13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:51.667396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef0553-35ee-4df3-82f0-e804c47c6b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:51.668827 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef0553-35ee-4df3-82f0-e804c47c6b13 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:51.678628 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 110/219] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:22:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:51.684413 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012a01a-82b4-4b91-a5b2-83777e8d7047 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:51.795692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3012a01a-82b4-4b91-a5b2-83777e8d7047 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:51.825081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:51.834331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9405c77-a70d-4338-a960-052c2e65c968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:51.834998 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9405c77-a70d-4338-a960-052c2e65c968 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:51.835668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9405c77-a70d-4338-a960-052c2e65c968 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:51.836303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9405c77-a70d-4338-a960-052c2e65c968 None admin] PATH_INFO: `/v3/users/4fb0b4422d4b46f6b550d68af16f67e2` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:51.837883 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9405c77-a70d-4338-a960-052c2e65c968 None admin] RBAC: Authorizing `identity:get_user(user_id=4fb0b4422d4b46f6b550d68af16f67e2)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:51.839359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9405c77-a70d-4338-a960-052c2e65c968 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:51.840957 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 110/220] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:51 2022] GET /identity/v3/users/4fb0b4422d4b46f6b550d68af16f67e2 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:51.846540 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef0553-35ee-4df3-82f0-e804c47c6b13 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:51.963920 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef0553-35ee-4df3-82f0-e804c47c6b13 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:51.999379 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c91ba-220c-4f8b-a2da-f0ae22857250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:51.999993 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c91ba-220c-4f8b-a2da-f0ae22857250 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:52.000276 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c91ba-220c-4f8b-a2da-f0ae22857250 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:52.000549 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c91ba-220c-4f8b-a2da-f0ae22857250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:52.024706 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:52.076966 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c91ba-220c-4f8b-a2da-f0ae22857250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:52.078503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c91ba-220c-4f8b-a2da-f0ae22857250 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:52.182194 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 111/221] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:22:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 13:22:52.187982 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9405c77-a70d-4338-a960-052c2e65c968 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:52.294599 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9405c77-a70d-4338-a960-052c2e65c968 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:52.331144 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ca9c9-573e-4d8c-8e51-557827be3a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:52.331783 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ca9c9-573e-4d8c-8e51-557827be3a09 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:52.332593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ca9c9-573e-4d8c-8e51-557827be3a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:52.332874 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ca9c9-573e-4d8c-8e51-557827be3a09 None admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:52.334151 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ca9c9-573e-4d8c-8e51-557827be3a09 None admin] RBAC: Authorizing `identity:get_project(project_id=1bf5e097ed8d4a1381b8224dd5a11e27)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:52.335730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ca9c9-573e-4d8c-8e51-557827be3a09 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:52.337679 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 111/222] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:22:52 2022] GET /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:52.343574 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c91ba-220c-4f8b-a2da-f0ae22857250 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:52.398556 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:52.455654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c91ba-220c-4f8b-a2da-f0ae22857250 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:52.494543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbac46f-cca8-457c-8600-6febe2a9bb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:52.495220 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac46f-cca8-457c-8600-6febe2a9bb7d None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:52.495497 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac46f-cca8-457c-8600-6febe2a9bb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:52.495766 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac46f-cca8-457c-8600-6febe2a9bb7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:52.496498 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbac46f-cca8-457c-8600-6febe2a9bb7d None admin] RBAC: Adding query filter params (role.id=5c7df19d9a1a45cabf65945ba964abe8, scope.project.id=1bf5e097ed8d4a1381b8224dd5a11e27, user.id=4fb0b4422d4b46f6b550d68af16f67e2) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:52.496801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbac46f-cca8-457c-8600-6febe2a9bb7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:52.498214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbac46f-cca8-457c-8600-6febe2a9bb7d None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:52.505661 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 112/223] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:22:52 2022] GET /identity/v3/role_assignments?user.id=4fb0b4422d4b46f6b550d68af16f67e2&scope.project.id=1bf5e097ed8d4a1381b8224dd5a11e27&role.id=5c7df19d9a1a45cabf65945ba964abe8 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:53.708234 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d63cba-fa58-4517-9480-5e3519e0fc51 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:53.708788 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d63cba-fa58-4517-9480-5e3519e0fc51 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:53.708788 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d63cba-fa58-4517-9480-5e3519e0fc51 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:53.710099 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 112/224] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:53.715436 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a63de-9d47-4beb-99bf-289da8badc42 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:53.715824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a63de-9d47-4beb-99bf-289da8badc42 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:53.716017 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a63de-9d47-4beb-99bf-289da8badc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:53.734376 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-055a63de-9d47-4beb-99bf-289da8badc42 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:53.735590 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-055a63de-9d47-4beb-99bf-289da8badc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:53.742492 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b2621-b44d-40bc-9269-02d89632d5db None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:53.742779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b2621-b44d-40bc-9269-02d89632d5db None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:53.743094 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b2621-b44d-40bc-9269-02d89632d5db None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:53.744427 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 113/225] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:22:53.749423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164df4b6-433c-42ae-bc67-91990bafc8b5 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:53.749703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164df4b6-433c-42ae-bc67-91990bafc8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:53.749984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164df4b6-433c-42ae-bc67-91990bafc8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:53.767973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-164df4b6-433c-42ae-bc67-91990bafc8b5 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:53.769158 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-164df4b6-433c-42ae-bc67-91990bafc8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:53.803352 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 113/226] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:53.804772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7f4cf-b58b-488a-a2cf-9a233f987c6b None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:53.805059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7f4cf-b58b-488a-a2cf-9a233f987c6b None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:53.805334 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7f4cf-b58b-488a-a2cf-9a233f987c6b None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:53.806578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 114/227] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:53.811888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fc238-9863-46a3-b967-acffaf4728c8 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:53.812167 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fc238-9863-46a3-b967-acffaf4728c8 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:53.812439 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fc238-9863-46a3-b967-acffaf4728c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:53.830545 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-961fc238-9863-46a3-b967-acffaf4728c8 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:53.831765 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-961fc238-9863-46a3-b967-acffaf4728c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:53.834764 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:53.846437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 114/228] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:53.884291 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:53.906401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 115/229] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:54.072155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164df4b6-433c-42ae-bc67-91990bafc8b5 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:54.119009 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fc238-9863-46a3-b967-acffaf4728c8 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:54.177221 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164df4b6-433c-42ae-bc67-91990bafc8b5 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:54.211787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d1718-cef0-4c20-92a4-03d2e7163949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:54.212414 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d1718-cef0-4c20-92a4-03d2e7163949 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:54.212697 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d1718-cef0-4c20-92a4-03d2e7163949 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:54.212970 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d1718-cef0-4c20-92a4-03d2e7163949 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:54.221181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fc238-9863-46a3-b967-acffaf4728c8 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:54.223287 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d1718-cef0-4c20-92a4-03d2e7163949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:54.228049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-b35d1718-cef0-4c20-92a4-03d2e7163949 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 13:22:54.228049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:54.228049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:54.228049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:54.228049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:54.228049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:54.228049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:54.228049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:54.228049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:54.228049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:54.228049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:54.228049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:54.228049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:54.228049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:54.228049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:54.228049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:54.228952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:54.228952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:54.228952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:54.228952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:54.228952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:54.228952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:54.228952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:54.228952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:54.228952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:54.228952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:54.228952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:54.228952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:54.228952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:54.228952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:54.228952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:54.228952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:54.229720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:54.229720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:54.229720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:54.229720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:54.229720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:54.229720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:54.229720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:54.229720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:54.229720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:54.229720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:54.229720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 13:22:54.229720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:54.229720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 115/230] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:54.230386 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d1718-cef0-4c20-92a4-03d2e7163949 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:54.258862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23ee36-080b-4f78-a628-a30ce9265abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:54.259519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23ee36-080b-4f78-a628-a30ce9265abf None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:54.259798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23ee36-080b-4f78-a628-a30ce9265abf None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:54.260070 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23ee36-080b-4f78-a628-a30ce9265abf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:54.270398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23ee36-080b-4f78-a628-a30ce9265abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:54.275298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-9f23ee36-080b-4f78-a628-a30ce9265abf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:54.275298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:54.275298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:54.275298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:54.275298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:54.275298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:54.275298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:54.275298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:54.275298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:54.275298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:54.275298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:54.275298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:54.275298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:54.275298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:54.275298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:54.275298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:54.276176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:54.276176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:54.276176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:54.276176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:54.276176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:54.276176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:54.276176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:54.276176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:54.276176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:54.276176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:54.276176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:54.276176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:54.276176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:54.276176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:54.276176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:54.276176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:54.276971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:54.276971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:54.276971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:54.276971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:54.276971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:54.276971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:54.276971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:54.276971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:54.276971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:54.276971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:54.276971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:54.276971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:22:54.276971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 116/231] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:22:54.278403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23ee36-080b-4f78-a628-a30ce9265abf None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:54.284730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:54.313446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:54.334074 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d1718-cef0-4c20-92a4-03d2e7163949 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:54.368407 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6e050-9392-4490-8ab2-6573ac3eaac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:54.369040 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6e050-9392-4490-8ab2-6573ac3eaac1 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:54.369320 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6e050-9392-4490-8ab2-6573ac3eaac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:54.369593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6e050-9392-4490-8ab2-6573ac3eaac1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:54.370696 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6e050-9392-4490-8ab2-6573ac3eaac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:54.372175 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be6e050-9392-4490-8ab2-6573ac3eaac1 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:54.373744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 116/232] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:22:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:54.374501 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6e050-9392-4490-8ab2-6573ac3eaac1 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:54.379874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23ee36-080b-4f78-a628-a30ce9265abf None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:54.414178 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6e800-c467-401a-94d7-c8c4ee38be6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:54.414782 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6e800-c467-401a-94d7-c8c4ee38be6e None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:54.415091 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6e800-c467-401a-94d7-c8c4ee38be6e None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:54.415367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6e800-c467-401a-94d7-c8c4ee38be6e None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:54.416024 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6e800-c467-401a-94d7-c8c4ee38be6e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:54.416577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6e800-c467-401a-94d7-c8c4ee38be6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:54.417942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6e800-c467-401a-94d7-c8c4ee38be6e None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:54.430526 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 117/233] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:22:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:54.430526 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6e800-c467-401a-94d7-c8c4ee38be6e None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:54.477869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6e050-9392-4490-8ab2-6573ac3eaac1 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:54.499183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:54.514363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55827299-2e87-43d1-a927-d6d6e379d5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:54.514998 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55827299-2e87-43d1-a927-d6d6e379d5fb None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:54.515270 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55827299-2e87-43d1-a927-d6d6e379d5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:54.515545 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55827299-2e87-43d1-a927-d6d6e379d5fb None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:54.516199 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55827299-2e87-43d1-a927-d6d6e379d5fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:54.516500 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55827299-2e87-43d1-a927-d6d6e379d5fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:54.517859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55827299-2e87-43d1-a927-d6d6e379d5fb None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:54.526424 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 117/234] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:22:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:54.530988 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55827299-2e87-43d1-a927-d6d6e379d5fb None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:54.531068 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:54.534605 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6e800-c467-401a-94d7-c8c4ee38be6e None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:54.568453 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80a71a-1885-4942-ab3a-6fe2954d5cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:54.569059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80a71a-1885-4942-ab3a-6fe2954d5cce None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:54.569335 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80a71a-1885-4942-ab3a-6fe2954d5cce None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:54.569603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80a71a-1885-4942-ab3a-6fe2954d5cce None admin] PATH_INFO: `/v3/groups` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:54.570223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80a71a-1885-4942-ab3a-6fe2954d5cce None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:54.571689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80a71a-1885-4942-ab3a-6fe2954d5cce None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:54.587393 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 118/235] 10.222.0.36 () {60 vars in 1134 bytes} [Thu Oct 20 13:22:54 2022] POST /identity/v3/groups => generated 229 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:22:54.588226 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80a71a-1885-4942-ab3a-6fe2954d5cce None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:54.634077 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55827299-2e87-43d1-a927-d6d6e379d5fb None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:54.674890 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c01953-e5a2-4cf1-9c2f-bab5129b8ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:54.676153 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c01953-e5a2-4cf1-9c2f-bab5129b8ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:54.676640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c01953-e5a2-4cf1-9c2f-bab5129b8ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:54.677152 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c01953-e5a2-4cf1-9c2f-bab5129b8ee2 None admin] PATH_INFO: `/v3/users/d139ac8feec24aeba46fa92e0ba281eb` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:54.693745 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c01953-e5a2-4cf1-9c2f-bab5129b8ee2 None admin] RBAC: Authorizing `identity:get_user(user_id=d139ac8feec24aeba46fa92e0ba281eb)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:54.695568 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c01953-e5a2-4cf1-9c2f-bab5129b8ee2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:54.697840 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 118/236] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:54 2022] GET /identity/v3/users/d139ac8feec24aeba46fa92e0ba281eb => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:54.703639 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c01953-e5a2-4cf1-9c2f-bab5129b8ee2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:54.720003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80a71a-1885-4942-ab3a-6fe2954d5cce None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:54.752647 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:54.763797 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef482a18-b953-4b72-a42a-7382eefd2fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:54.764448 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef482a18-b953-4b72-a42a-7382eefd2fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:54.765162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef482a18-b953-4b72-a42a-7382eefd2fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:54.765162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef482a18-b953-4b72-a42a-7382eefd2fe6 None admin] PATH_INFO: `/v3/users/3592dd7c72aa4810b4f549e11c27f64f` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:54.766576 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef482a18-b953-4b72-a42a-7382eefd2fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=3592dd7c72aa4810b4f549e11c27f64f)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:54.768327 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef482a18-b953-4b72-a42a-7382eefd2fe6 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:54.770904 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 119/237] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:54 2022] GET /identity/v3/users/3592dd7c72aa4810b4f549e11c27f64f => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:54.776796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef482a18-b953-4b72-a42a-7382eefd2fe6 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:54.809311 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:54.820621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c01953-e5a2-4cf1-9c2f-bab5129b8ee2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:54.855850 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3446fef-c861-4528-943b-7f9a211e3c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:54.856370 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3446fef-c861-4528-943b-7f9a211e3c2c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:54.856649 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3446fef-c861-4528-943b-7f9a211e3c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:54.856918 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3446fef-c861-4528-943b-7f9a211e3c2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:54.857640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3446fef-c861-4528-943b-7f9a211e3c2c None admin] RBAC: Adding query filter params (role.id=5c7df19d9a1a45cabf65945ba964abe8, user.id=d139ac8feec24aeba46fa92e0ba281eb, scope.system=all) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:54.857948 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3446fef-c861-4528-943b-7f9a211e3c2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:54.859413 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3446fef-c861-4528-943b-7f9a211e3c2c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:54.865267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 119/238] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Oct 20 13:22:54 2022] GET /identity/v3/role_assignments?user.id=d139ac8feec24aeba46fa92e0ba281eb&scope.system=all&role.id=5c7df19d9a1a45cabf65945ba964abe8 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:54.896600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef482a18-b953-4b72-a42a-7382eefd2fe6 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:54.934936 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4315d-71f3-4c38-9cfd-b31b0fd1ed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:54.935644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4315d-71f3-4c38-9cfd-b31b0fd1ed88 None admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:54.935926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4315d-71f3-4c38-9cfd-b31b0fd1ed88 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:54.936270 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4315d-71f3-4c38-9cfd-b31b0fd1ed88 None admin] PATH_INFO: `/v3/system/users/3592dd7c72aa4810b4f549e11c27f64f/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:54.937783 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4315d-71f3-4c38-9cfd-b31b0fd1ed88 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3592dd7c72aa4810b4f549e11c27f64f, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:54.939219 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4315d-71f3-4c38-9cfd-b31b0fd1ed88 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:54.954760 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 120/239] 10.222.0.36 () {58 vars in 1334 bytes} [Thu Oct 20 13:22:54 2022] PUT /identity/v3/system/users/3592dd7c72aa4810b4f549e11c27f64f/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:22:56.794271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834380cb-d14d-43b7-bc89-4ed553e01e1f None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:56.794787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834380cb-d14d-43b7-bc89-4ed553e01e1f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:56.794893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834380cb-d14d-43b7-bc89-4ed553e01e1f None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:56.796241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 120/240] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:56.801993 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d39f4-75a3-4ed2-ba36-878a3492909b None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:56.802406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d39f4-75a3-4ed2-ba36-878a3492909b None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:56.802545 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60d39f4-75a3-4ed2-ba36-878a3492909b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:56.821461 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-b60d39f4-75a3-4ed2-ba36-878a3492909b None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:56.822632 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b60d39f4-75a3-4ed2-ba36-878a3492909b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:56.894986 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 121/241] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:57.026338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad949d53-335c-4921-a230-3099987745b1 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:57.026629 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad949d53-335c-4921-a230-3099987745b1 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:57.027109 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad949d53-335c-4921-a230-3099987745b1 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:57.028503 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 121/242] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:57.034336 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2756ef-975d-4c6d-98ed-d5d636f6f0aa None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:57.034617 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2756ef-975d-4c6d-98ed-d5d636f6f0aa None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:57.034887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2756ef-975d-4c6d-98ed-d5d636f6f0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:57.053510 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-6e2756ef-975d-4c6d-98ed-d5d636f6f0aa None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:57.054604 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6e2756ef-975d-4c6d-98ed-d5d636f6f0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:57.070606 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:57.115801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28870d-0b4f-4b6a-8c61-43ce600265e4 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:57.116657 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28870d-0b4f-4b6a-8c61-43ce600265e4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:57.116944 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28870d-0b4f-4b6a-8c61-43ce600265e4 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:57.120639 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 122/243] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:22:57.123331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c1dad-9ecd-450a-954e-6a3d2e2476d2 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:57.123612 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c1dad-9ecd-450a-954e-6a3d2e2476d2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:57.123885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c1dad-9ecd-450a-954e-6a3d2e2476d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:57.127541 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 122/244] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:22:57.145425 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-e08c1dad-9ecd-450a-954e-6a3d2e2476d2 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:57.146632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e08c1dad-9ecd-450a-954e-6a3d2e2476d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:22:57.166509 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2756ef-975d-4c6d-98ed-d5d636f6f0aa None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:57.218454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 123/245] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:22:57.271925 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2756ef-975d-4c6d-98ed-d5d636f6f0aa None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:57.308088 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f18579-b935-429b-8d53-66744c7a5db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:57.308648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f18579-b935-429b-8d53-66744c7a5db3 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:57.308926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f18579-b935-429b-8d53-66744c7a5db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:57.309195 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f18579-b935-429b-8d53-66744c7a5db3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:57.310285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f18579-b935-429b-8d53-66744c7a5db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:57.312093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f18579-b935-429b-8d53-66744c7a5db3 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:57.313833 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 123/246] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:22:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:57.319406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c1dad-9ecd-450a-954e-6a3d2e2476d2 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:57.353996 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:57.397822 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f18579-b935-429b-8d53-66744c7a5db3 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:57.418530 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:57.424131 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c1dad-9ecd-450a-954e-6a3d2e2476d2 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:57.459555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f02d3d-1e3e-4566-9ff4-2cb6d9958ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:57.460162 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f02d3d-1e3e-4566-9ff4-2cb6d9958ba0 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:57.460453 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f02d3d-1e3e-4566-9ff4-2cb6d9958ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:57.460694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f02d3d-1e3e-4566-9ff4-2cb6d9958ba0 None admin] PATH_INFO: `/v3/groups` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:57.461335 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f02d3d-1e3e-4566-9ff4-2cb6d9958ba0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:57.462743 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f02d3d-1e3e-4566-9ff4-2cb6d9958ba0 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:57.490977 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 124/247] 10.222.0.36 () {60 vars in 1134 bytes} [Thu Oct 20 13:22:57 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:22:57.490977 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f02d3d-1e3e-4566-9ff4-2cb6d9958ba0 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:57.527503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f18579-b935-429b-8d53-66744c7a5db3 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:57.571998 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c47fc9-07d7-4c11-88d7-fcf3014a487a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:57.572532 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c47fc9-07d7-4c11-88d7-fcf3014a487a None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:57.572838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c47fc9-07d7-4c11-88d7-fcf3014a487a None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:57.573092 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c47fc9-07d7-4c11-88d7-fcf3014a487a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:57.589884 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c47fc9-07d7-4c11-88d7-fcf3014a487a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:57.595913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-50c47fc9-07d7-4c11-88d7-fcf3014a487a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 13:22:57.595913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:57.595913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:57.595913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:57.595913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:57.595913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:57.595913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:57.595913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:57.595913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:57.595913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:57.595913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:57.595913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:57.595913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:57.595913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:57.595913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:57.595913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:57.596834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:57.596834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:57.596834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:57.596834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:57.596834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:57.596834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:57.596834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:57.596834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:57.596834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:57.596834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:57.596834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:57.596834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:57.596834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:57.596834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:57.596834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:57.596834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:57.598578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:57.598578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:57.598578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:57.598578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:57.598578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:57.598578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:57.598578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:57.598578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:57.598578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:57.598578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:57.598578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 13:22:57.598578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:22:57.598578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 124/248] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:22:57.605014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c47fc9-07d7-4c11-88d7-fcf3014a487a None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:57.616183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:57.626161 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f02d3d-1e3e-4566-9ff4-2cb6d9958ba0 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:57.666706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d6ca8-35d2-4e7f-8802-6000968c7a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:57.667381 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d6ca8-35d2-4e7f-8802-6000968c7a69 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:57.667648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d6ca8-35d2-4e7f-8802-6000968c7a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:57.667915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d6ca8-35d2-4e7f-8802-6000968c7a69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:57.679551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d6ca8-35d2-4e7f-8802-6000968c7a69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:22:57.686915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-399d6ca8-35d2-4e7f-8802-6000968c7a69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:57.686915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:22:57.686915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:22:57.686915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:22:57.686915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:22:57.686915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:22:57.686915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:22:57.686915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:22:57.686915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:22:57.686915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:22:57.686915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:22:57.686915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:22:57.686915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:22:57.686915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:22:57.686915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:22:57.686915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:22:57.688014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:22:57.688014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:22:57.688014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:22:57.688014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:22:57.688014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:22:57.688014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:22:57.688014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:22:57.688014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:22:57.688014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:22:57.688014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:22:57.688014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:22:57.688014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:22:57.688014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:22:57.688014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:22:57.688014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:22:57.688014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:22:57.688919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:22:57.688919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:22:57.688919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:22:57.688919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:22:57.688919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:22:57.688919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:22:57.688919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:22:57.688919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:22:57.688919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:22:57.688919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:22:57.688919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:22:57.688919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:22:57.688919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 125/249] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:22:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:22:57.695278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d6ca8-35d2-4e7f-8802-6000968c7a69 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:57.698035 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:57.725894 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c47fc9-07d7-4c11-88d7-fcf3014a487a None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:57.766804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae9508-c49e-409b-8806-77bb4669eb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:57.767454 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae9508-c49e-409b-8806-77bb4669eb56 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:57.767731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae9508-c49e-409b-8806-77bb4669eb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:57.768063 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae9508-c49e-409b-8806-77bb4669eb56 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:57.768728 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae9508-c49e-409b-8806-77bb4669eb56 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:57.769079 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae9508-c49e-409b-8806-77bb4669eb56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:57.770540 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ae9508-c49e-409b-8806-77bb4669eb56 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:57.782739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 125/250] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:22:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:57.788869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae9508-c49e-409b-8806-77bb4669eb56 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:57.822979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d6ca8-35d2-4e7f-8802-6000968c7a69 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:57.868365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e307725-44ad-41d1-a45a-273d7bbe88ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:57.869662 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e307725-44ad-41d1-a45a-273d7bbe88ba None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:57.869946 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e307725-44ad-41d1-a45a-273d7bbe88ba None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:57.870219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e307725-44ad-41d1-a45a-273d7bbe88ba None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:57.870894 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e307725-44ad-41d1-a45a-273d7bbe88ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:57.871243 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e307725-44ad-41d1-a45a-273d7bbe88ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:57.872680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e307725-44ad-41d1-a45a-273d7bbe88ba None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:57.884042 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 126/251] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:22:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:57.890020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e307725-44ad-41d1-a45a-273d7bbe88ba None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:57.913172 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:57.918344 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae9508-c49e-409b-8806-77bb4669eb56 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:57.969426 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08714fe4-029f-44e9-aaf6-dfe198042599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:57.970155 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08714fe4-029f-44e9-aaf6-dfe198042599 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:57.970354 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08714fe4-029f-44e9-aaf6-dfe198042599 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:57.970630 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08714fe4-029f-44e9-aaf6-dfe198042599 None admin] PATH_INFO: `/v3/users/d139ac8feec24aeba46fa92e0ba281eb` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:57.971838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08714fe4-029f-44e9-aaf6-dfe198042599 None admin] RBAC: Authorizing `identity:get_user(user_id=d139ac8feec24aeba46fa92e0ba281eb)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:57.973548 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08714fe4-029f-44e9-aaf6-dfe198042599 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:57.975499 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 126/252] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:57 2022] GET /identity/v3/users/d139ac8feec24aeba46fa92e0ba281eb => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:57.980758 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08714fe4-029f-44e9-aaf6-dfe198042599 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:57.993062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:58.033555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e307725-44ad-41d1-a45a-273d7bbe88ba None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:58.077957 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449e000-b40e-4383-9714-ccf2ba912e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:58.078520 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449e000-b40e-4383-9714-ccf2ba912e59 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:58.078805 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449e000-b40e-4383-9714-ccf2ba912e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:58.079110 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449e000-b40e-4383-9714-ccf2ba912e59 None admin] PATH_INFO: `/v3/users/3592dd7c72aa4810b4f549e11c27f64f` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:58.080260 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449e000-b40e-4383-9714-ccf2ba912e59 None admin] RBAC: Authorizing `identity:get_user(user_id=3592dd7c72aa4810b4f549e11c27f64f)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:58.082478 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449e000-b40e-4383-9714-ccf2ba912e59 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:58.084303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 127/253] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:22:57 2022] GET /identity/v3/users/3592dd7c72aa4810b4f549e11c27f64f => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:22:58.089825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449e000-b40e-4383-9714-ccf2ba912e59 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:22:58.101080 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08714fe4-029f-44e9-aaf6-dfe198042599 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:58.141625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46510fe-5ca4-4d3d-8704-6d9acf6c4982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:58.142613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46510fe-5ca4-4d3d-8704-6d9acf6c4982 None admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:58.143075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46510fe-5ca4-4d3d-8704-6d9acf6c4982 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:58.143501 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46510fe-5ca4-4d3d-8704-6d9acf6c4982 None admin] PATH_INFO: `/v3/system/users/d139ac8feec24aeba46fa92e0ba281eb/roles/5c7df19d9a1a45cabf65945ba964abe8` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:58.146424 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46510fe-5ca4-4d3d-8704-6d9acf6c4982 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d139ac8feec24aeba46fa92e0ba281eb, role_id=5c7df19d9a1a45cabf65945ba964abe8)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:58.148252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46510fe-5ca4-4d3d-8704-6d9acf6c4982 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:58.160328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 127/254] 10.222.0.36 () {58 vars in 1334 bytes} [Thu Oct 20 13:22:57 2022] PUT /identity/v3/system/users/d139ac8feec24aeba46fa92e0ba281eb/roles/5c7df19d9a1a45cabf65945ba964abe8 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:22:58.199090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:22:58.222142 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449e000-b40e-4383-9714-ccf2ba912e59 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:22:58.266679 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31a6bb-af34-4ed5-ae74-fd753ab7488e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:22:58.267429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31a6bb-af34-4ed5-ae74-fd753ab7488e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:58.267707 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31a6bb-af34-4ed5-ae74-fd753ab7488e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:58.267976 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31a6bb-af34-4ed5-ae74-fd753ab7488e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:58.268784 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31a6bb-af34-4ed5-ae74-fd753ab7488e None admin] RBAC: Adding query filter params (role.id=233938f0e7e84b5098019470ad8cfb4e, user.id=3592dd7c72aa4810b4f549e11c27f64f, scope.system=all) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:22:58.269739 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31a6bb-af34-4ed5-ae74-fd753ab7488e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:22:58.271306 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31a6bb-af34-4ed5-ae74-fd753ab7488e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:22:58.288684 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 128/255] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Oct 20 13:22:58 2022] GET /identity/v3/role_assignments?user.id=3592dd7c72aa4810b4f549e11c27f64f&scope.system=all&role.id=233938f0e7e84b5098019470ad8cfb4e => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:22:59.948841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec20f3-c7a5-4be2-bfa6-ca3146690e93 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:59.949362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec20f3-c7a5-4be2-bfa6-ca3146690e93 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:59.949362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec20f3-c7a5-4be2-bfa6-ca3146690e93 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:59.950872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 128/256] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:22:59.956358 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a4a4a-98e5-4b00-aa48-6397149aa545 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:22:59.957275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a4a4a-98e5-4b00-aa48-6397149aa545 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:22:59.957769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a4a4a-98e5-4b00-aa48-6397149aa545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:22:59.988212 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-557a4a4a-98e5-4b00-aa48-6397149aa545 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:22:59.989795 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-557a4a4a-98e5-4b00-aa48-6397149aa545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:00.068287 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 129/257] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:22:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 13:23:00.269016 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe3ee2-cf50-4992-b90a-3b52d9522706 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:00.269720 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe3ee2-cf50-4992-b90a-3b52d9522706 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:00.270233 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe3ee2-cf50-4992-b90a-3b52d9522706 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:00.272091 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 129/258] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:00.277258 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20b700-1976-43c6-a061-78f5051d0af8 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:00.277765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20b700-1976-43c6-a061-78f5051d0af8 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:00.278235 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae20b700-1976-43c6-a061-78f5051d0af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:00.307953 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ae20b700-1976-43c6-a061-78f5051d0af8 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:00.309519 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ae20b700-1976-43c6-a061-78f5051d0af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:00.318316 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 130/259] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 13:23:00.584416 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe3ee2-cf50-4992-b90a-3b52d9522706 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:00.610243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe3ee2-cf50-4992-b90a-3b52d9522706 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:00.618967 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4595a18-e191-47b8-83d9-62be9df0bdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:00.619848 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4595a18-e191-47b8-83d9-62be9df0bdda admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:00.620331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4595a18-e191-47b8-83d9-62be9df0bdda admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:00.620803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4595a18-e191-47b8-83d9-62be9df0bdda admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:00.639377 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4595a18-e191-47b8-83d9-62be9df0bdda admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:00.644854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-f4595a18-e191-47b8-83d9-62be9df0bdda admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:23:00.644854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:00.644854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:00.644854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:00.644854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:00.644854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:00.644854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:00.644854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:00.644854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:00.644854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:00.644854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:00.644854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:00.644854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:00.644854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:00.644854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:00.644854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:00.645687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:00.645687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:00.645687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:00.645687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:00.645687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:00.645687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:00.645687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:00.645687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:00.645687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:00.645687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:00.645687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:00.645687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:00.645687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:00.645687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:00.645687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:00.645687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:00.646456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:00.646456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:00.646456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:00.646456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:00.646456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:00.646456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:00.646456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:00.646456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:00.646456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:00.646456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:00.646456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:23:00.646456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:00.646456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 130/260] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Oct 20 13:23:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:00.651949 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20b700-1976-43c6-a061-78f5051d0af8 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:00.668740 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae20b700-1976-43c6-a061-78f5051d0af8 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:00.680455 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9009c7f-19a4-41b8-89ba-ef7fa01e5641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:00.681320 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9009c7f-19a4-41b8-89ba-ef7fa01e5641 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:00.681797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9009c7f-19a4-41b8-89ba-ef7fa01e5641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:00.682264 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9009c7f-19a4-41b8-89ba-ef7fa01e5641 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:00.683197 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9009c7f-19a4-41b8-89ba-ef7fa01e5641 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:00.683699 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9009c7f-19a4-41b8-89ba-ef7fa01e5641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:00.685767 dv-cinder-862136-1-smb devstack@keystone.service[81427]: WARNING py.warnings [None req-f9009c7f-19a4-41b8-89ba-ef7fa01e5641 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 20 13:23:00.685767 dv-cinder-862136-1-smb devstack@keystone.service[81427]: warnings.warn(msg) Oct 20 13:23:00.685767 dv-cinder-862136-1-smb devstack@keystone.service[81427]: Oct 20 13:23:00.687047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9009c7f-19a4-41b8-89ba-ef7fa01e5641 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:00.702343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 131/261] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Oct 20 13:23:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:00.708360 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4595a18-e191-47b8-83d9-62be9df0bdda admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:00.723161 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4595a18-e191-47b8-83d9-62be9df0bdda admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:00.729926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911db94-1a44-4b56-a6a6-82cbd17342ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:00.730609 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911db94-1a44-4b56-a6a6-82cbd17342ef admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:00.730886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911db94-1a44-4b56-a6a6-82cbd17342ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:00.731224 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911db94-1a44-4b56-a6a6-82cbd17342ef admin admin] PATH_INFO: `/v3/groups/a5d95efcc27341e0967509ca472b94b9` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:00.738220 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911db94-1a44-4b56-a6a6-82cbd17342ef admin admin] RBAC: Authorizing `identity:get_group(group_id=a5d95efcc27341e0967509ca472b94b9)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:00.740126 dv-cinder-862136-1-smb devstack@keystone.service[81426]: WARNING py.warnings [None req-5911db94-1a44-4b56-a6a6-82cbd17342ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 13:23:00.740126 dv-cinder-862136-1-smb devstack@keystone.service[81426]: warnings.warn(msg) Oct 20 13:23:00.740126 dv-cinder-862136-1-smb devstack@keystone.service[81426]: Oct 20 13:23:00.741472 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911db94-1a44-4b56-a6a6-82cbd17342ef admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:00.743162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 131/262] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Oct 20 13:23:00 2022] GET /identity/v3/groups/a5d95efcc27341e0967509ca472b94b9 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:00.748905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9009c7f-19a4-41b8-89ba-ef7fa01e5641 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:00.763620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9009c7f-19a4-41b8-89ba-ef7fa01e5641 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:00.768917 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e912f-dfd1-4736-b1da-f73af375ad8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:00.769932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e912f-dfd1-4736-b1da-f73af375ad8c admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:00.770410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e912f-dfd1-4736-b1da-f73af375ad8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:00.770880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e912f-dfd1-4736-b1da-f73af375ad8c admin admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:00.772268 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e912f-dfd1-4736-b1da-f73af375ad8c admin admin] RBAC: Authorizing `identity:get_project(project_id=25e961400d214cb99f377dbe63b7b8f7)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:00.774760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e912f-dfd1-4736-b1da-f73af375ad8c admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:00.776981 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 132/263] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Oct 20 13:23:00 2022] GET /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:00.782415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911db94-1a44-4b56-a6a6-82cbd17342ef admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:00.795345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e912f-dfd1-4736-b1da-f73af375ad8c admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:00.796444 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911db94-1a44-4b56-a6a6-82cbd17342ef admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:00.815285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94523423-a5a9-4d16-8329-6854ab327a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:00.817164 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e912f-dfd1-4736-b1da-f73af375ad8c admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:00.818289 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94523423-a5a9-4d16-8329-6854ab327a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:00.819244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94523423-a5a9-4d16-8329-6854ab327a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:00.819735 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94523423-a5a9-4d16-8329-6854ab327a5b admin admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7/groups/a5d95efcc27341e0967509ca472b94b9/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:00.824682 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94523423-a5a9-4d16-8329-6854ab327a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e961400d214cb99f377dbe63b7b8f7, group_id=a5d95efcc27341e0967509ca472b94b9, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:00.827758 dv-cinder-862136-1-smb devstack@keystone.service[81426]: WARNING py.warnings [None req-94523423-a5a9-4d16-8329-6854ab327a5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 13:23:00.827758 dv-cinder-862136-1-smb devstack@keystone.service[81426]: warnings.warn(msg) Oct 20 13:23:00.827758 dv-cinder-862136-1-smb devstack@keystone.service[81426]: Oct 20 13:23:00.828404 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63208c5-4ecd-42dc-8c43-4b97d70c23b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:00.829675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63208c5-4ecd-42dc-8c43-4b97d70c23b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:00.830803 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63208c5-4ecd-42dc-8c43-4b97d70c23b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:00.832422 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63208c5-4ecd-42dc-8c43-4b97d70c23b8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:00.834053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94523423-a5a9-4d16-8329-6854ab327a5b admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:00.860102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63208c5-4ecd-42dc-8c43-4b97d70c23b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:00.860653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 132/264] 10.222.0.36 () {58 vars in 1463 bytes} [Thu Oct 20 13:23:00 2022] PUT /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7/groups/a5d95efcc27341e0967509ca472b94b9/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:23:00.866675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f63208c5-4ecd-42dc-8c43-4b97d70c23b8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:23:00.866675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:00.866675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:00.866675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:00.866675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:00.866675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:00.866675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:00.866675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:00.866675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:00.866675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:00.866675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:00.866675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:00.866675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:00.866675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:00.866675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:00.866675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:00.867676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:00.867676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:00.867676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:00.867676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:00.867676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:00.867676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:00.867676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:00.867676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:00.867676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:00.867676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:00.867676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:00.867676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:00.867676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:00.867676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:00.867676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:00.867676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:00.868454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:00.868454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:00.868454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:00.868454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:00.868454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:00.868454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:00.868454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:00.868454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:00.868454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:00.868454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:00.868454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:23:00.868454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:00.871326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 133/265] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Oct 20 13:23:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:23:00.880087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94523423-a5a9-4d16-8329-6854ab327a5b admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:00.936956 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126e652-c1d8-44b8-910e-f35a554cdda5 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:00.937575 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126e652-c1d8-44b8-910e-f35a554cdda5 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:00.938069 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126e652-c1d8-44b8-910e-f35a554cdda5 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:00.939641 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 134/266] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:23:00.945713 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:00.950892 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc4a90-a139-468d-9be8-1cb7534f19e6 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:00.951549 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc4a90-a139-468d-9be8-1cb7534f19e6 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:00.952215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc4a90-a139-468d-9be8-1cb7534f19e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:00.976751 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-decc4a90-a139-468d-9be8-1cb7534f19e6 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:00.977367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94523423-a5a9-4d16-8329-6854ab327a5b admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:00.979505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-decc4a90-a139-468d-9be8-1cb7534f19e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:00.984670 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34338829-9073-4d26-8d17-173f770309cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:00.985308 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34338829-9073-4d26-8d17-173f770309cc admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:00.985585 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34338829-9073-4d26-8d17-173f770309cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:00.985856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34338829-9073-4d26-8d17-173f770309cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:00.986531 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34338829-9073-4d26-8d17-173f770309cc admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:00.986833 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34338829-9073-4d26-8d17-173f770309cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:00.988520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: WARNING py.warnings [None req-34338829-9073-4d26-8d17-173f770309cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 20 13:23:00.988520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: warnings.warn(msg) Oct 20 13:23:00.988520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: Oct 20 13:23:00.989421 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34338829-9073-4d26-8d17-173f770309cc admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:01.007814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 133/267] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Oct 20 13:23:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:01.014632 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34338829-9073-4d26-8d17-173f770309cc admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:01.034378 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34338829-9073-4d26-8d17-173f770309cc admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:01.045403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b8a1d-45ee-469b-bb7c-d3059e21a9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:01.046472 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b8a1d-45ee-469b-bb7c-d3059e21a9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:01.047325 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b8a1d-45ee-469b-bb7c-d3059e21a9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:01.048502 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b8a1d-45ee-469b-bb7c-d3059e21a9e3 admin admin] PATH_INFO: `/v3/groups/a5d95efcc27341e0967509ca472b94b9` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:01.052351 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b8a1d-45ee-469b-bb7c-d3059e21a9e3 admin admin] RBAC: Authorizing `identity:get_group(group_id=a5d95efcc27341e0967509ca472b94b9)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:01.056831 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b8a1d-45ee-469b-bb7c-d3059e21a9e3 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:01.060900 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 134/268] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Oct 20 13:23:01 2022] GET /identity/v3/groups/a5d95efcc27341e0967509ca472b94b9 => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:01.064137 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:01.066699 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b8a1d-45ee-469b-bb7c-d3059e21a9e3 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:01.087602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b8a1d-45ee-469b-bb7c-d3059e21a9e3 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:01.100347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdb05fe-c6e2-48cc-86a9-38d94b6d6678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:01.102035 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb05fe-c6e2-48cc-86a9-38d94b6d6678 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:01.103297 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb05fe-c6e2-48cc-86a9-38d94b6d6678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:01.104203 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb05fe-c6e2-48cc-86a9-38d94b6d6678 admin admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:01.106890 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb05fe-c6e2-48cc-86a9-38d94b6d6678 admin admin] RBAC: Authorizing `identity:get_project(project_id=25e961400d214cb99f377dbe63b7b8f7)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:01.108528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 135/269] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:23:01.110723 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdb05fe-c6e2-48cc-86a9-38d94b6d6678 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:01.113440 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 135/270] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Oct 20 13:23:01 2022] GET /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:01.119277 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc4a90-a139-468d-9be8-1cb7534f19e6 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:01.131159 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc4a90-a139-468d-9be8-1cb7534f19e6 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:01.136454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f43c3a-5cb2-4068-869e-71f259215be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:01.137433 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43c3a-5cb2-4068-869e-71f259215be8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:01.137934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43c3a-5cb2-4068-869e-71f259215be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:01.138451 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f43c3a-5cb2-4068-869e-71f259215be8 admin admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7/groups/a5d95efcc27341e0967509ca472b94b9/roles/c63cd01b72aa49d5932f4b4f762fdf5c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:01.141010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f43c3a-5cb2-4068-869e-71f259215be8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e961400d214cb99f377dbe63b7b8f7, group_id=a5d95efcc27341e0967509ca472b94b9, role_id=c63cd01b72aa49d5932f4b4f762fdf5c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:01.142294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: WARNING py.warnings [None req-13f43c3a-5cb2-4068-869e-71f259215be8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 13:23:01.142294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: warnings.warn(msg) Oct 20 13:23:01.142294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: Oct 20 13:23:01.145649 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f43c3a-5cb2-4068-869e-71f259215be8 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:01.161800 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 136/271] 10.222.0.36 () {58 vars in 1463 bytes} [Thu Oct 20 13:23:01 2022] PUT /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7/groups/a5d95efcc27341e0967509ca472b94b9/roles/c63cd01b72aa49d5932f4b4f762fdf5c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:23:01.305698 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8784ead-cf22-4ccf-8158-e2c69eef8ab2 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:01.306416 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8784ead-cf22-4ccf-8158-e2c69eef8ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:01.306921 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8784ead-cf22-4ccf-8158-e2c69eef8ab2 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:01.308881 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 136/272] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:01.321211 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8ff87-61d2-429b-84c5-e89217a590bb None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:01.321507 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8ff87-61d2-429b-84c5-e89217a590bb None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:01.321774 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8ff87-61d2-429b-84c5-e89217a590bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:01.344986 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-cfa8ff87-61d2-429b-84c5-e89217a590bb None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:01.346305 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-cfa8ff87-61d2-429b-84c5-e89217a590bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:01.425579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 137/273] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 13:23:01.443614 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8784ead-cf22-4ccf-8158-e2c69eef8ab2 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:01.577466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8784ead-cf22-4ccf-8158-e2c69eef8ab2 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:01.624786 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dc8c2-3011-48ee-bdef-386ac9055281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:01.625806 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dc8c2-3011-48ee-bdef-386ac9055281 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:01.626284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dc8c2-3011-48ee-bdef-386ac9055281 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:01.626750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dc8c2-3011-48ee-bdef-386ac9055281 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:01.641305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dc8c2-3011-48ee-bdef-386ac9055281 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:01.647689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-cc8dc8c2-3011-48ee-bdef-386ac9055281 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 13:23:01.647689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:01.647689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:01.647689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:01.647689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:01.647689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:01.647689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:01.647689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:01.647689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:01.647689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:01.647689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:01.647689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:01.647689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:01.647689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:01.647689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:01.647689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:01.648578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:01.648578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:01.648578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:01.648578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:01.648578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:01.648578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:01.648578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:01.648578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:01.648578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:01.648578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:01.648578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:01.648578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:01.648578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:01.648578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:01.648578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:01.648578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:01.649398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:01.649398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:01.649398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:01.649398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:01.649398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:01.649398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:01.649398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:01.649398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:01.649398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:01.649398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:01.649398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 20 13:23:01.649398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:01.651811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 137/274] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:23:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:01.660639 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8ff87-61d2-429b-84c5-e89217a590bb None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:01.803719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8ff87-61d2-429b-84c5-e89217a590bb None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:01.812603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dc8c2-3011-48ee-bdef-386ac9055281 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:01.828151 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:01.839106 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dc8c2-3011-48ee-bdef-386ac9055281 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:01.849666 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b2bcd-a322-4092-92b2-371fe2e8c555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:01.850268 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b2bcd-a322-4092-92b2-371fe2e8c555 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:01.850550 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b2bcd-a322-4092-92b2-371fe2e8c555 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:01.850824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b2bcd-a322-4092-92b2-371fe2e8c555 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:01.851243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff469b78-2095-4191-a8c3-0e4143dc0603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:01.851525 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b2bcd-a322-4092-92b2-371fe2e8c555 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:01.851833 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b2bcd-a322-4092-92b2-371fe2e8c555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:01.852518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff469b78-2095-4191-a8c3-0e4143dc0603 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:01.853002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff469b78-2095-4191-a8c3-0e4143dc0603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:01.853224 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b2bcd-a322-4092-92b2-371fe2e8c555 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:01.853666 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff469b78-2095-4191-a8c3-0e4143dc0603 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:01.872527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 138/275] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:23:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:01.877450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b2bcd-a322-4092-92b2-371fe2e8c555 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:01.879096 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff469b78-2095-4191-a8c3-0e4143dc0603 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:01.884934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-ff469b78-2095-4191-a8c3-0e4143dc0603 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:23:01.884934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:01.884934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:01.884934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:01.884934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:01.884934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:01.884934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:01.884934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:01.884934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:01.884934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:01.884934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:01.884934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:01.884934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:01.884934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:01.884934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:01.884934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:01.885817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:01.885817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:01.885817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:01.885817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:01.885817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:01.885817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:01.885817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:01.885817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:01.885817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:01.885817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:01.885817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:01.885817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:01.885817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:01.885817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:01.885817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:01.885817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:01.886587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:01.886587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:01.886587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:01.886587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:01.886587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:01.886587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:01.886587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:01.886587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:01.886587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:01.886587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:01.886587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:23:01.886587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:01.893174 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 138/276] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Oct 20 13:23:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:01.899225 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff469b78-2095-4191-a8c3-0e4143dc0603 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:01.919948 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff469b78-2095-4191-a8c3-0e4143dc0603 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:01.935003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350c9d3-6f55-49c2-aacf-3c22e6bb4079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:01.935965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350c9d3-6f55-49c2-aacf-3c22e6bb4079 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:01.936446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350c9d3-6f55-49c2-aacf-3c22e6bb4079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:01.936937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350c9d3-6f55-49c2-aacf-3c22e6bb4079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:01.937846 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350c9d3-6f55-49c2-aacf-3c22e6bb4079 admin admin] RBAC: Adding query filter params (name=member) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:01.938349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350c9d3-6f55-49c2-aacf-3c22e6bb4079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:01.940307 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350c9d3-6f55-49c2-aacf-3c22e6bb4079 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:01.964080 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 139/277] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Oct 20 13:23:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:01.970419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350c9d3-6f55-49c2-aacf-3c22e6bb4079 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:01.990114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350c9d3-6f55-49c2-aacf-3c22e6bb4079 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:02.001265 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf430d-dd1b-4048-82e7-2c6f3b04bfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:02.002320 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf430d-dd1b-4048-82e7-2c6f3b04bfc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:02.002849 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf430d-dd1b-4048-82e7-2c6f3b04bfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:02.003623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf430d-dd1b-4048-82e7-2c6f3b04bfc5 admin admin] PATH_INFO: `/v3/groups/a5d95efcc27341e0967509ca472b94b9` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:02.007680 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf430d-dd1b-4048-82e7-2c6f3b04bfc5 admin admin] RBAC: Authorizing `identity:get_group(group_id=a5d95efcc27341e0967509ca472b94b9)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:02.010008 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf430d-dd1b-4048-82e7-2c6f3b04bfc5 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:02.011874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 140/278] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Oct 20 13:23:01 2022] GET /identity/v3/groups/a5d95efcc27341e0967509ca472b94b9 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:02.015705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b2bcd-a322-4092-92b2-371fe2e8c555 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:02.017683 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf430d-dd1b-4048-82e7-2c6f3b04bfc5 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:02.033674 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf430d-dd1b-4048-82e7-2c6f3b04bfc5 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:02.043604 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c378a3-08eb-4491-9ff2-252196157e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:02.044698 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c378a3-08eb-4491-9ff2-252196157e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:02.045177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c378a3-08eb-4491-9ff2-252196157e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:02.045719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c378a3-08eb-4491-9ff2-252196157e88 admin admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:02.048719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c378a3-08eb-4491-9ff2-252196157e88 admin admin] RBAC: Authorizing `identity:get_project(project_id=1bf5e097ed8d4a1381b8224dd5a11e27)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:02.051829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c378a3-08eb-4491-9ff2-252196157e88 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:02.054131 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 141/279] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Oct 20 13:23:02 2022] GET /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:02.059475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c378a3-08eb-4491-9ff2-252196157e88 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:02.063528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268932eb-b03a-4a00-a016-a4872b688329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:02.064172 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268932eb-b03a-4a00-a016-a4872b688329 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:02.064457 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268932eb-b03a-4a00-a016-a4872b688329 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:02.064733 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268932eb-b03a-4a00-a016-a4872b688329 None admin] PATH_INFO: `/v3/users/d139ac8feec24aeba46fa92e0ba281eb` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:02.066440 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268932eb-b03a-4a00-a016-a4872b688329 None admin] RBAC: Authorizing `identity:get_user(user_id=d139ac8feec24aeba46fa92e0ba281eb)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:02.070707 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268932eb-b03a-4a00-a016-a4872b688329 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:02.070707 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 139/280] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:23:01 2022] GET /identity/v3/users/d139ac8feec24aeba46fa92e0ba281eb => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:02.072390 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:02.075791 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268932eb-b03a-4a00-a016-a4872b688329 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:02.079410 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c378a3-08eb-4491-9ff2-252196157e88 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:02.088529 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a452af-f5ca-4668-a0d2-8f659c3e00f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:02.089489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a452af-f5ca-4668-a0d2-8f659c3e00f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:02.090068 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a452af-f5ca-4668-a0d2-8f659c3e00f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:02.090543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a452af-f5ca-4668-a0d2-8f659c3e00f6 admin admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27/groups/a5d95efcc27341e0967509ca472b94b9/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:02.095252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a452af-f5ca-4668-a0d2-8f659c3e00f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf5e097ed8d4a1381b8224dd5a11e27, group_id=a5d95efcc27341e0967509ca472b94b9, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:02.098283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a452af-f5ca-4668-a0d2-8f659c3e00f6 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:02.124082 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 142/281] 10.222.0.36 () {58 vars in 1463 bytes} [Thu Oct 20 13:23:02 2022] PUT /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27/groups/a5d95efcc27341e0967509ca472b94b9/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:23:02.146556 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:02.208610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268932eb-b03a-4a00-a016-a4872b688329 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:02.258697 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9438e-2a77-49ff-afbe-879c1824547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:02.259353 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9438e-2a77-49ff-afbe-879c1824547e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:02.259636 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9438e-2a77-49ff-afbe-879c1824547e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:02.259910 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9438e-2a77-49ff-afbe-879c1824547e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:02.260654 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9438e-2a77-49ff-afbe-879c1824547e None admin] RBAC: Adding query filter params (role.id=5c7df19d9a1a45cabf65945ba964abe8, user.id=d139ac8feec24aeba46fa92e0ba281eb, scope.system=all) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:02.260966 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9438e-2a77-49ff-afbe-879c1824547e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:02.262412 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9438e-2a77-49ff-afbe-879c1824547e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:02.279286 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 140/282] 10.222.0.36 () {56 vars in 1308 bytes} [Thu Oct 20 13:23:02 2022] GET /identity/v3/role_assignments?user.id=d139ac8feec24aeba46fa92e0ba281eb&scope.system=all&role.id=5c7df19d9a1a45cabf65945ba964abe8 => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:02.883053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77659d-0cf9-4bbd-ae93-b242aa83cce4 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:02.883659 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77659d-0cf9-4bbd-ae93-b242aa83cce4 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:02.884157 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77659d-0cf9-4bbd-ae93-b242aa83cce4 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:02.885705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 143/283] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:02.891245 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbfc45-437e-4c08-89f7-2b08b5f3cae4 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:02.891784 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbfc45-437e-4c08-89f7-2b08b5f3cae4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:02.892260 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbfc45-437e-4c08-89f7-2b08b5f3cae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:02.917461 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-a6bbfc45-437e-4c08-89f7-2b08b5f3cae4 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:02.919023 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a6bbfc45-437e-4c08-89f7-2b08b5f3cae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:02.997840 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 141/284] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 20 13:23:03.192365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca301-422e-4aa5-98af-da23d1c31063 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:03.193332 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca301-422e-4aa5-98af-da23d1c31063 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:03.193841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca301-422e-4aa5-98af-da23d1c31063 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:03.195428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 144/285] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:03.204199 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f18905-9d06-4fd6-9d89-74800037fc4c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:03.204637 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f18905-9d06-4fd6-9d89-74800037fc4c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:03.204819 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f18905-9d06-4fd6-9d89-74800037fc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:03.232029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-12f18905-9d06-4fd6-9d89-74800037fc4c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:03.233245 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-12f18905-9d06-4fd6-9d89-74800037fc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:03.245137 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 142/286] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 20 13:23:03.465241 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fca301-422e-4aa5-98af-da23d1c31063 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:03.481081 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fca301-422e-4aa5-98af-da23d1c31063 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:03.491110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d25a7-1a50-446c-a048-5bd773779195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:03.492011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d25a7-1a50-446c-a048-5bd773779195 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:03.492505 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d25a7-1a50-446c-a048-5bd773779195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:03.492999 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d25a7-1a50-446c-a048-5bd773779195 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:03.506693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d25a7-1a50-446c-a048-5bd773779195 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:03.513944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-824d25a7-1a50-446c-a048-5bd773779195 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:23:03.513944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:03.513944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:03.513944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:03.513944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:03.513944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:03.513944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:03.513944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:03.513944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:03.513944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:03.513944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:03.513944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:03.513944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:03.513944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:03.513944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:03.513944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:03.514803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:03.514803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:03.514803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:03.514803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:03.514803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:03.514803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:03.514803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:03.514803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:03.514803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:03.514803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:03.514803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:03.514803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:03.514803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:03.514803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:03.514803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:03.514803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:03.515635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:03.515635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:03.515635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:03.515635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:03.515635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:03.515635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:03.515635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:03.515635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:03.515635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:03.515635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:03.515635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:23:03.515635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:03.517914 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 145/287] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Oct 20 13:23:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:03.524386 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f18905-9d06-4fd6-9d89-74800037fc4c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:03.541773 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f18905-9d06-4fd6-9d89-74800037fc4c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:03.546966 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188bdd3-05bc-408f-93df-8166faf02220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:03.547652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188bdd3-05bc-408f-93df-8166faf02220 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:03.547938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188bdd3-05bc-408f-93df-8166faf02220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:03.548212 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188bdd3-05bc-408f-93df-8166faf02220 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:03.548881 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188bdd3-05bc-408f-93df-8166faf02220 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:03.549185 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188bdd3-05bc-408f-93df-8166faf02220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:03.551650 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188bdd3-05bc-408f-93df-8166faf02220 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:03.567491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 143/288] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Oct 20 13:23:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:03.572709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d25a7-1a50-446c-a048-5bd773779195 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:03.586985 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d25a7-1a50-446c-a048-5bd773779195 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:03.595100 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b0bef-6864-4275-88da-a714b6f61dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:03.596000 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b0bef-6864-4275-88da-a714b6f61dca admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:03.596497 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b0bef-6864-4275-88da-a714b6f61dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:03.597573 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b0bef-6864-4275-88da-a714b6f61dca admin admin] PATH_INFO: `/v3/groups/a5d95efcc27341e0967509ca472b94b9` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:03.599042 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b0bef-6864-4275-88da-a714b6f61dca admin admin] RBAC: Authorizing `identity:get_group(group_id=a5d95efcc27341e0967509ca472b94b9)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:03.601248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b0bef-6864-4275-88da-a714b6f61dca admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:03.603030 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 146/289] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Oct 20 13:23:03 2022] GET /identity/v3/groups/a5d95efcc27341e0967509ca472b94b9 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:03.608606 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188bdd3-05bc-408f-93df-8166faf02220 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:03.618802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188bdd3-05bc-408f-93df-8166faf02220 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:03.619912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b0bef-6864-4275-88da-a714b6f61dca admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:03.627109 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4a273-9b84-4ea3-865b-2c215cb142c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:03.627756 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4a273-9b84-4ea3-865b-2c215cb142c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:03.628047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4a273-9b84-4ea3-865b-2c215cb142c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:03.628349 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4a273-9b84-4ea3-865b-2c215cb142c5 admin admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:03.629571 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4a273-9b84-4ea3-865b-2c215cb142c5 admin admin] RBAC: Authorizing `identity:get_project(project_id=1bf5e097ed8d4a1381b8224dd5a11e27)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:03.631675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4a273-9b84-4ea3-865b-2c215cb142c5 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:03.633494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 144/290] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Oct 20 13:23:03 2022] GET /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:03.633980 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b0bef-6864-4275-88da-a714b6f61dca admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:03.638920 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4a273-9b84-4ea3-865b-2c215cb142c5 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:03.647615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0a759-c98b-414b-a475-9e5f35794133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:03.648310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0a759-c98b-414b-a475-9e5f35794133 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:03.648669 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0a759-c98b-414b-a475-9e5f35794133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:03.648954 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0a759-c98b-414b-a475-9e5f35794133 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:03.652355 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4a273-9b84-4ea3-865b-2c215cb142c5 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:03.660466 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04744458-ab0e-4d69-b9fa-dd417f502c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:03.661132 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04744458-ab0e-4d69-b9fa-dd417f502c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:03.661416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04744458-ab0e-4d69-b9fa-dd417f502c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:03.661695 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04744458-ab0e-4d69-b9fa-dd417f502c7e admin admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27/groups/a5d95efcc27341e0967509ca472b94b9/roles/c63cd01b72aa49d5932f4b4f762fdf5c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:03.664806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04744458-ab0e-4d69-b9fa-dd417f502c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf5e097ed8d4a1381b8224dd5a11e27, group_id=a5d95efcc27341e0967509ca472b94b9, role_id=c63cd01b72aa49d5932f4b4f762fdf5c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:03.667716 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04744458-ab0e-4d69-b9fa-dd417f502c7e admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:03.669284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0a759-c98b-414b-a475-9e5f35794133 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:03.674672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-3bc0a759-c98b-414b-a475-9e5f35794133 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:23:03.674672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:03.674672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:03.674672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:03.674672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:03.674672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:03.674672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:03.674672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:03.674672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:03.674672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:03.674672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:03.674672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:03.674672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:03.674672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:03.674672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:03.674672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:03.676215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:03.676215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:03.676215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:03.676215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:03.676215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:03.676215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:03.676215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:03.676215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:03.676215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:03.676215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:03.676215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:03.676215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:03.676215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:03.676215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:03.676215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:03.676215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:03.677188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:03.677188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:03.677188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:03.677188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:03.677188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:03.677188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:03.677188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:03.677188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:03.677188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:03.677188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:03.677188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:23:03.677188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:03.677188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 147/291] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Oct 20 13:23:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:03.683348 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0a759-c98b-414b-a475-9e5f35794133 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:03.688318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 145/292] 10.222.0.36 () {58 vars in 1463 bytes} [Thu Oct 20 13:23:03 2022] PUT /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27/groups/a5d95efcc27341e0967509ca472b94b9/roles/c63cd01b72aa49d5932f4b4f762fdf5c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:23:03.700135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0a759-c98b-414b-a475-9e5f35794133 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:03.784897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30619f3-1782-43d4-99f3-9af5045925f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:03.785604 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30619f3-1782-43d4-99f3-9af5045925f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:03.785892 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30619f3-1782-43d4-99f3-9af5045925f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:03.786169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30619f3-1782-43d4-99f3-9af5045925f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:03.786852 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30619f3-1782-43d4-99f3-9af5045925f1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:03.787184 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30619f3-1782-43d4-99f3-9af5045925f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:03.788919 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30619f3-1782-43d4-99f3-9af5045925f1 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:03.803247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 148/293] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Oct 20 13:23:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:03.809341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04744458-ab0e-4d69-b9fa-dd417f502c7e admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:03.829535 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04744458-ab0e-4d69-b9fa-dd417f502c7e admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:03.836946 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368352ba-acfa-46b1-bbc2-bec28b61c605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:03.837608 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368352ba-acfa-46b1-bbc2-bec28b61c605 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:03.837944 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368352ba-acfa-46b1-bbc2-bec28b61c605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:03.838220 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368352ba-acfa-46b1-bbc2-bec28b61c605 admin admin] PATH_INFO: `/v3/groups/5c0b466c9b824d7f9e42888631d0b18f` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:03.848597 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368352ba-acfa-46b1-bbc2-bec28b61c605 admin admin] RBAC: Authorizing `identity:get_group(group_id=5c0b466c9b824d7f9e42888631d0b18f)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:03.849768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: WARNING py.warnings [None req-368352ba-acfa-46b1-bbc2-bec28b61c605 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 13:23:03.849768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: warnings.warn(msg) Oct 20 13:23:03.849768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: Oct 20 13:23:03.851079 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368352ba-acfa-46b1-bbc2-bec28b61c605 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:03.852837 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 146/294] 10.222.0.36 () {56 vars in 1201 bytes} [Thu Oct 20 13:23:03 2022] GET /identity/v3/groups/5c0b466c9b824d7f9e42888631d0b18f => generated 229 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:03.858934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30619f3-1782-43d4-99f3-9af5045925f1 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:03.874428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30619f3-1782-43d4-99f3-9af5045925f1 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:03.884178 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762f30c-04dd-4450-839d-8e87e0bc7783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:03.884859 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762f30c-04dd-4450-839d-8e87e0bc7783 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:03.885128 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762f30c-04dd-4450-839d-8e87e0bc7783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:03.885400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762f30c-04dd-4450-839d-8e87e0bc7783 admin admin] PATH_INFO: `/v3/projects/fb60201a6517430aaa26188ed8565651` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:03.886594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762f30c-04dd-4450-839d-8e87e0bc7783 admin admin] RBAC: Authorizing `identity:get_project(project_id=fb60201a6517430aaa26188ed8565651)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:03.888464 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762f30c-04dd-4450-839d-8e87e0bc7783 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:03.890255 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 149/295] 10.222.0.36 () {56 vars in 1207 bytes} [Thu Oct 20 13:23:03 2022] GET /identity/v3/projects/fb60201a6517430aaa26188ed8565651 => generated 344 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:03.896601 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368352ba-acfa-46b1-bbc2-bec28b61c605 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:03.912934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368352ba-acfa-46b1-bbc2-bec28b61c605 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:03.920608 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bf95f0-3a4d-4805-8944-9d073292a248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:03.921271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf95f0-3a4d-4805-8944-9d073292a248 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:03.921552 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf95f0-3a4d-4805-8944-9d073292a248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:03.921833 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf95f0-3a4d-4805-8944-9d073292a248 admin admin] PATH_INFO: `/v3/projects/fb60201a6517430aaa26188ed8565651/groups/5c0b466c9b824d7f9e42888631d0b18f/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:03.924805 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf95f0-3a4d-4805-8944-9d073292a248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb60201a6517430aaa26188ed8565651, group_id=5c0b466c9b824d7f9e42888631d0b18f, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:03.927603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bf95f0-3a4d-4805-8944-9d073292a248 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:03.953672 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 147/296] 10.222.0.36 () {58 vars in 1463 bytes} [Thu Oct 20 13:23:03 2022] PUT /identity/v3/projects/fb60201a6517430aaa26188ed8565651/groups/5c0b466c9b824d7f9e42888631d0b18f/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:23:04.150995 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98dfa2-dff9-4fd6-b33b-82c03287df8e None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:04.151300 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98dfa2-dff9-4fd6-b33b-82c03287df8e None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:04.151527 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98dfa2-dff9-4fd6-b33b-82c03287df8e None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:04.153156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 150/297] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:04.158409 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96e693-4a56-409e-b2ba-9c8e0f8fc9b1 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:04.158691 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96e693-4a56-409e-b2ba-9c8e0f8fc9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:04.158997 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96e693-4a56-409e-b2ba-9c8e0f8fc9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:04.166771 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:04.183988 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-fa96e693-4a56-409e-b2ba-9c8e0f8fc9b1 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:04.185686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-fa96e693-4a56-409e-b2ba-9c8e0f8fc9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:04.268228 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 148/298] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:23:04.556252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98dfa2-dff9-4fd6-b33b-82c03287df8e None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:04.619407 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1652cf6-b524-44ff-a96b-1e149fc98d14 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:04.619861 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1652cf6-b524-44ff-a96b-1e149fc98d14 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:04.620246 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1652cf6-b524-44ff-a96b-1e149fc98d14 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:04.622097 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 149/299] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:04.627368 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108458a-1100-4d81-8987-95b59e59c3d4 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:04.627777 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108458a-1100-4d81-8987-95b59e59c3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:04.628962 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108458a-1100-4d81-8987-95b59e59c3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:04.661005 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-2108458a-1100-4d81-8987-95b59e59c3d4 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:04.662375 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2108458a-1100-4d81-8987-95b59e59c3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:04.704648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98dfa2-dff9-4fd6-b33b-82c03287df8e None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:04.706377 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:04.751121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 150/300] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:04.767008 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791e23e-efbe-4acc-9d9e-021e3a3b093b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:04.767658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791e23e-efbe-4acc-9d9e-021e3a3b093b None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:04.767938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791e23e-efbe-4acc-9d9e-021e3a3b093b None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:04.768210 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791e23e-efbe-4acc-9d9e-021e3a3b093b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:04.779452 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791e23e-efbe-4acc-9d9e-021e3a3b093b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:04.784258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-0791e23e-efbe-4acc-9d9e-021e3a3b093b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:23:04.784258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:04.784258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:04.784258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:04.784258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:04.784258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:04.784258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:04.784258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:04.784258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:04.784258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:04.784258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:04.784258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:04.784258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:04.784258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:04.784258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:04.784258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:04.785724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:04.785724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:04.785724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:04.785724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:04.785724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:04.785724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:04.785724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:04.785724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:04.785724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:04.785724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:04.785724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:04.785724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:04.785724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:04.785724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:04.785724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:04.785724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:04.786712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:04.786712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:04.786712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:04.786712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:04.786712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:04.786712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:04.786712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:04.786712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:04.786712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:04.786712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:04.786712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:23:04.786712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:04.792198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108458a-1100-4d81-8987-95b59e59c3d4 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:04.792717 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 151/301] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:23:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:04.857738 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:04.912244 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108458a-1100-4d81-8987-95b59e59c3d4 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:04.967146 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32335f62-eb99-4614-9999-6cbb456916c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:04.967763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32335f62-eb99-4614-9999-6cbb456916c5 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:04.968043 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32335f62-eb99-4614-9999-6cbb456916c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:04.968315 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32335f62-eb99-4614-9999-6cbb456916c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:04.968982 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32335f62-eb99-4614-9999-6cbb456916c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:04.969337 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32335f62-eb99-4614-9999-6cbb456916c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:04.970701 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32335f62-eb99-4614-9999-6cbb456916c5 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:04.983085 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 151/302] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:23:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:04.989061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791e23e-efbe-4acc-9d9e-021e3a3b093b None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:05.111165 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791e23e-efbe-4acc-9d9e-021e3a3b093b None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:05.158540 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44511c5e-efcb-4e74-9e80-1b29b046287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:05.159205 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44511c5e-efcb-4e74-9e80-1b29b046287d None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:05.159663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44511c5e-efcb-4e74-9e80-1b29b046287d None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:05.159932 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44511c5e-efcb-4e74-9e80-1b29b046287d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:05.200284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:05.241640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32335f62-eb99-4614-9999-6cbb456916c5 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:05.243522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44511c5e-efcb-4e74-9e80-1b29b046287d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:05.245013 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44511c5e-efcb-4e74-9e80-1b29b046287d None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:05.373954 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32335f62-eb99-4614-9999-6cbb456916c5 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:05.380195 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 152/303] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:23:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 13:23:05.381557 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedbb3e-0e6a-45e0-ae50-6e0ec08bb52d None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:05.381848 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedbb3e-0e6a-45e0-ae50-6e0ec08bb52d None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:05.382095 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedbb3e-0e6a-45e0-ae50-6e0ec08bb52d None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:05.383643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 153/304] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:05.389547 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedbb3e-0e6a-45e0-ae50-6e0ec08bb52d None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:05.407990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:05.420527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3695ead-9da2-4677-b9b4-9b20adb64a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:05.421482 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3695ead-9da2-4677-b9b4-9b20adb64a92 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:05.421973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3695ead-9da2-4677-b9b4-9b20adb64a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:05.422462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3695ead-9da2-4677-b9b4-9b20adb64a92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:05.435539 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3695ead-9da2-4677-b9b4-9b20adb64a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:05.441913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-d3695ead-9da2-4677-b9b4-9b20adb64a92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:23:05.441913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:05.441913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:05.441913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:05.441913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:05.441913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:05.441913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:05.441913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:05.441913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:05.441913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:05.441913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:05.441913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:05.441913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:05.441913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:05.441913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:05.441913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:05.442769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:05.442769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:05.442769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:05.442769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:05.442769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:05.442769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:05.442769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:05.442769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:05.442769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:05.442769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:05.442769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:05.442769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:05.442769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:05.442769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:05.442769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:05.442769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:05.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:05.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:05.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:05.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:05.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:05.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:05.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:05.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:05.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:05.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:05.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:23:05.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:05.446971 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 152/305] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Oct 20 13:23:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:05.448412 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b6937-a620-4bdb-972b-73d05b4452b5 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:05.448979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b6937-a620-4bdb-972b-73d05b4452b5 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:05.449462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2b6937-a620-4bdb-972b-73d05b4452b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:05.463371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:05.470703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-3b2b6937-a620-4bdb-972b-73d05b4452b5 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:05.472628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3b2b6937-a620-4bdb-972b-73d05b4452b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:05.513498 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedbb3e-0e6a-45e0-ae50-6e0ec08bb52d None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:05.551174 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 153/306] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:05.552118 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b6937-a620-4bdb-972b-73d05b4452b5 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:05.565388 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b2dbb-e6c3-433a-a431-4d3068f06eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:05.566366 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b2dbb-e6c3-433a-a431-4d3068f06eea None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:05.566657 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b2dbb-e6c3-433a-a431-4d3068f06eea None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:05.567114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b2dbb-e6c3-433a-a431-4d3068f06eea None admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:05.568409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b2dbb-e6c3-433a-a431-4d3068f06eea None admin] RBAC: Authorizing `identity:get_project(project_id=25e961400d214cb99f377dbe63b7b8f7)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:05.570467 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b2dbb-e6c3-433a-a431-4d3068f06eea None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:05.572647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 154/307] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:23:05 2022] GET /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:05.578895 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b2dbb-e6c3-433a-a431-4d3068f06eea None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:05.673732 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2b6937-a620-4bdb-972b-73d05b4452b5 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:05.690242 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:05.691923 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b2dbb-e6c3-433a-a431-4d3068f06eea None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:05.716217 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d776865-1955-470f-9e79-36d25a14c7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:05.717066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d776865-1955-470f-9e79-36d25a14c7de None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:05.718068 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d776865-1955-470f-9e79-36d25a14c7de None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:05.718488 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d776865-1955-470f-9e79-36d25a14c7de None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:05.719623 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d776865-1955-470f-9e79-36d25a14c7de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:05.720090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d776865-1955-470f-9e79-36d25a14c7de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:05.722372 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d776865-1955-470f-9e79-36d25a14c7de None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:05.729223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:05.733850 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 154/308] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:05.738144 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43048cae-b905-41b7-83dd-b14e815a1a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:05.738976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048cae-b905-41b7-83dd-b14e815a1a87 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:05.739395 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048cae-b905-41b7-83dd-b14e815a1a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:05.739911 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43048cae-b905-41b7-83dd-b14e815a1a87 None admin] PATH_INFO: `/v3/groups/a5d95efcc27341e0967509ca472b94b9` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:05.740842 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d776865-1955-470f-9e79-36d25a14c7de None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:05.741525 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43048cae-b905-41b7-83dd-b14e815a1a87 None admin] RBAC: Authorizing `identity:get_group(group_id=a5d95efcc27341e0967509ca472b94b9)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:05.743224 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43048cae-b905-41b7-83dd-b14e815a1a87 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:05.746440 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 155/309] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Oct 20 13:23:05 2022] GET /identity/v3/groups/a5d95efcc27341e0967509ca472b94b9 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:05.753298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43048cae-b905-41b7-83dd-b14e815a1a87 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:05.873392 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43048cae-b905-41b7-83dd-b14e815a1a87 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:05.913809 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ff1cc-b017-4f14-8b90-764f71f74344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:05.914415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ff1cc-b017-4f14-8b90-764f71f74344 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:05.914698 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ff1cc-b017-4f14-8b90-764f71f74344 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:05.914977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ff1cc-b017-4f14-8b90-764f71f74344 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:05.916100 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ff1cc-b017-4f14-8b90-764f71f74344 None admin] RBAC: Adding query filter params (group.id=a5d95efcc27341e0967509ca472b94b9, role.id=233938f0e7e84b5098019470ad8cfb4e, scope.project.id=25e961400d214cb99f377dbe63b7b8f7) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:05.916406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ff1cc-b017-4f14-8b90-764f71f74344 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:05.918096 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ff1cc-b017-4f14-8b90-764f71f74344 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:05.923203 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d776865-1955-470f-9e79-36d25a14c7de None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:05.925148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 156/310] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Oct 20 13:23:05 2022] GET /identity/v3/role_assignments?group.id=a5d95efcc27341e0967509ca472b94b9&scope.project.id=25e961400d214cb99f377dbe63b7b8f7&role.id=233938f0e7e84b5098019470ad8cfb4e => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:05.964558 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74539f14-f72c-4042-9c64-eeb2c2b2c775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:05.965175 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74539f14-f72c-4042-9c64-eeb2c2b2c775 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:05.965455 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74539f14-f72c-4042-9c64-eeb2c2b2c775 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:05.965728 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74539f14-f72c-4042-9c64-eeb2c2b2c775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:05.991790 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ff1cc-b017-4f14-8b90-764f71f74344 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:06.022663 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:06.052935 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74539f14-f72c-4042-9c64-eeb2c2b2c775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:06.054415 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74539f14-f72c-4042-9c64-eeb2c2b2c775 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:06.078831 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:06.148645 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ff1cc-b017-4f14-8b90-764f71f74344 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:06.208939 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 155/311] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:23:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 20 13:23:06.214442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74539f14-f72c-4042-9c64-eeb2c2b2c775 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:06.218817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef6954-d618-49a1-b81b-efdceddc3b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:06.219511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef6954-d618-49a1-b81b-efdceddc3b8a None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:06.219792 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef6954-d618-49a1-b81b-efdceddc3b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:06.220066 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef6954-d618-49a1-b81b-efdceddc3b8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:06.243381 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef6954-d618-49a1-b81b-efdceddc3b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:06.248841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-05ef6954-d618-49a1-b81b-efdceddc3b8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:23:06.248841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:06.248841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:06.248841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:06.248841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:06.248841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:06.248841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:06.248841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:06.248841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:06.248841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:06.248841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:06.248841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:06.248841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:06.248841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:06.248841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:06.248841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:06.249734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:06.249734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:06.249734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:06.249734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:06.249734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:06.249734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:06.249734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:06.249734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:06.249734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:06.249734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:06.249734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:06.249734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:06.249734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:06.249734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:06.249734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:06.249734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:06.250519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:06.250519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:06.250519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:06.250519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:06.250519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:06.250519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:06.250519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:06.250519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:06.250519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:06.250519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:06.250519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 20 13:23:06.250519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:06.250519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 157/312] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:23:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:23:06.262294 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef6954-d618-49a1-b81b-efdceddc3b8a None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:06.332585 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:06.359953 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74539f14-f72c-4042-9c64-eeb2c2b2c775 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:06.402848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a2d63-fe55-4788-b62b-53913d1c35c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:06.403529 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a2d63-fe55-4788-b62b-53913d1c35c2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:06.403788 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a2d63-fe55-4788-b62b-53913d1c35c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:06.404053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a2d63-fe55-4788-b62b-53913d1c35c2 None admin] PATH_INFO: `/v3/projects/25e961400d214cb99f377dbe63b7b8f7` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:06.405195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a2d63-fe55-4788-b62b-53913d1c35c2 None admin] RBAC: Authorizing `identity:get_project(project_id=25e961400d214cb99f377dbe63b7b8f7)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:06.406693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a2d63-fe55-4788-b62b-53913d1c35c2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:06.409347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef6954-d618-49a1-b81b-efdceddc3b8a None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:06.409947 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 156/313] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:23:06 2022] GET /identity/v3/projects/25e961400d214cb99f377dbe63b7b8f7 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:06.416147 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a2d63-fe55-4788-b62b-53913d1c35c2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:06.439770 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:06.462567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c87951-1074-41be-99ac-9904628cef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:06.463099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c87951-1074-41be-99ac-9904628cef22 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:06.463611 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c87951-1074-41be-99ac-9904628cef22 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:06.464092 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c87951-1074-41be-99ac-9904628cef22 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:06.465536 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c87951-1074-41be-99ac-9904628cef22 None admin] RBAC: Adding query filter params (name=member) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:06.466055 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c87951-1074-41be-99ac-9904628cef22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:06.468605 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c87951-1074-41be-99ac-9904628cef22 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:06.480962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 158/314] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:23:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:06.489942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c87951-1074-41be-99ac-9904628cef22 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:06.548341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a2d63-fe55-4788-b62b-53913d1c35c2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:06.602780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043fd2d-e5eb-41c5-bd78-988fc285e2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:06.603843 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043fd2d-e5eb-41c5-bd78-988fc285e2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:06.604330 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043fd2d-e5eb-41c5-bd78-988fc285e2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:06.604812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043fd2d-e5eb-41c5-bd78-988fc285e2c2 None admin] PATH_INFO: `/v3/groups/a5d95efcc27341e0967509ca472b94b9` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:06.606190 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043fd2d-e5eb-41c5-bd78-988fc285e2c2 None admin] RBAC: Authorizing `identity:get_group(group_id=a5d95efcc27341e0967509ca472b94b9)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:06.607974 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043fd2d-e5eb-41c5-bd78-988fc285e2c2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:06.610287 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 157/315] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Oct 20 13:23:06 2022] GET /identity/v3/groups/a5d95efcc27341e0967509ca472b94b9 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:06.619792 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043fd2d-e5eb-41c5-bd78-988fc285e2c2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:06.639418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:06.640534 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c87951-1074-41be-99ac-9904628cef22 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:06.682790 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531426e3-d813-4d03-84bf-f83cac8f5502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:06.683807 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531426e3-d813-4d03-84bf-f83cac8f5502 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:06.684291 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531426e3-d813-4d03-84bf-f83cac8f5502 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:06.684765 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531426e3-d813-4d03-84bf-f83cac8f5502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:06.743574 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:06.747276 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043fd2d-e5eb-41c5-bd78-988fc285e2c2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:06.763628 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531426e3-d813-4d03-84bf-f83cac8f5502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:06.765424 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531426e3-d813-4d03-84bf-f83cac8f5502 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:06.792633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2d6f7-00db-46d2-a9ea-5f4b8b05cc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:06.792633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2d6f7-00db-46d2-a9ea-5f4b8b05cc5c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:06.792633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2d6f7-00db-46d2-a9ea-5f4b8b05cc5c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:06.792633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2d6f7-00db-46d2-a9ea-5f4b8b05cc5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:06.793034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2d6f7-00db-46d2-a9ea-5f4b8b05cc5c None admin] RBAC: Adding query filter params (group.id=a5d95efcc27341e0967509ca472b94b9, role.id=c63cd01b72aa49d5932f4b4f762fdf5c, scope.project.id=25e961400d214cb99f377dbe63b7b8f7) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:06.793034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2d6f7-00db-46d2-a9ea-5f4b8b05cc5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:06.794144 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2d6f7-00db-46d2-a9ea-5f4b8b05cc5c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:06.802229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 158/316] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Oct 20 13:23:06 2022] GET /identity/v3/role_assignments?group.id=a5d95efcc27341e0967509ca472b94b9&scope.project.id=25e961400d214cb99f377dbe63b7b8f7&role.id=c63cd01b72aa49d5932f4b4f762fdf5c => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:06.808683 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15a54c-269e-4ebe-9f58-b6ea3f76ee73 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:06.809013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15a54c-269e-4ebe-9f58-b6ea3f76ee73 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:06.809229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15a54c-269e-4ebe-9f58-b6ea3f76ee73 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:06.810755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 159/317] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:06.817419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a89b5-f0fd-474b-baca-32ae6c89baef None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:06.817755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a89b5-f0fd-474b-baca-32ae6c89baef None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:06.818100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a89b5-f0fd-474b-baca-32ae6c89baef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:06.850006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-182a89b5-f0fd-474b-baca-32ae6c89baef None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:06.850690 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-182a89b5-f0fd-474b-baca-32ae6c89baef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:06.909959 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 159/318] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:23:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 13:23:06.916384 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531426e3-d813-4d03-84bf-f83cac8f5502 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:06.960078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 160/319] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:06.961370 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025a3f0-9d9e-454c-9efb-5f893d8e8379 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:06.961657 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025a3f0-9d9e-454c-9efb-5f893d8e8379 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:06.961933 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025a3f0-9d9e-454c-9efb-5f893d8e8379 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:06.964330 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 161/320] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:06.969658 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65850-09e7-4c69-9f2c-2523cf47079d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:06.969944 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65850-09e7-4c69-9f2c-2523cf47079d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:06.970222 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e65850-09e7-4c69-9f2c-2523cf47079d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:06.985281 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:06.992730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d4e65850-09e7-4c69-9f2c-2523cf47079d None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:06.994016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d4e65850-09e7-4c69-9f2c-2523cf47079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:07.022075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:07.041574 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531426e3-d813-4d03-84bf-f83cac8f5502 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:07.082981 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 162/321] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:23:07.083166 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8203cab-3b6e-4ae4-85b8-3a99f539c2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:07.083166 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203cab-3b6e-4ae4-85b8-3a99f539c2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:07.083166 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203cab-3b6e-4ae4-85b8-3a99f539c2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:07.083166 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8203cab-3b6e-4ae4-85b8-3a99f539c2e8 None admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:07.083450 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8203cab-3b6e-4ae4-85b8-3a99f539c2e8 None admin] RBAC: Authorizing `identity:get_project(project_id=1bf5e097ed8d4a1381b8224dd5a11e27)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:07.084912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8203cab-3b6e-4ae4-85b8-3a99f539c2e8 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:07.086708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 160/322] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:23:06 2022] GET /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:07.092368 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e65850-09e7-4c69-9f2c-2523cf47079d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:07.206826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e65850-09e7-4c69-9f2c-2523cf47079d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:07.243164 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f9de9-a94b-4ce0-9de6-ed4ca73834d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:07.243798 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f9de9-a94b-4ce0-9de6-ed4ca73834d7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:07.244121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f9de9-a94b-4ce0-9de6-ed4ca73834d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:07.244343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f9de9-a94b-4ce0-9de6-ed4ca73834d7 None admin] PATH_INFO: `/v3/groups/a5d95efcc27341e0967509ca472b94b9` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:07.245472 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f9de9-a94b-4ce0-9de6-ed4ca73834d7 None admin] RBAC: Authorizing `identity:get_group(group_id=a5d95efcc27341e0967509ca472b94b9)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:07.246859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f9de9-a94b-4ce0-9de6-ed4ca73834d7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:07.248720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 163/323] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Oct 20 13:23:07 2022] GET /identity/v3/groups/a5d95efcc27341e0967509ca472b94b9 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:07.255310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8203cab-3b6e-4ae4-85b8-3a99f539c2e8 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:07.259019 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f9de9-a94b-4ce0-9de6-ed4ca73834d7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:07.263427 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:07.389998 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8203cab-3b6e-4ae4-85b8-3a99f539c2e8 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:07.394513 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f9de9-a94b-4ce0-9de6-ed4ca73834d7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:07.428050 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097bf2c-aad2-42e1-8a2f-f93983d1b745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:07.428966 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097bf2c-aad2-42e1-8a2f-f93983d1b745 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:07.429250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097bf2c-aad2-42e1-8a2f-f93983d1b745 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:07.429521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e097bf2c-aad2-42e1-8a2f-f93983d1b745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:07.430248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097bf2c-aad2-42e1-8a2f-f93983d1b745 None admin] RBAC: Adding query filter params (group.id=a5d95efcc27341e0967509ca472b94b9, role.id=233938f0e7e84b5098019470ad8cfb4e, scope.project.id=1bf5e097ed8d4a1381b8224dd5a11e27) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:07.430550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097bf2c-aad2-42e1-8a2f-f93983d1b745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:07.432002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e097bf2c-aad2-42e1-8a2f-f93983d1b745 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:07.433571 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef370c4-7c8a-4f4d-9f02-6602dcb46aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:07.434372 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef370c4-7c8a-4f4d-9f02-6602dcb46aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:07.434650 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef370c4-7c8a-4f4d-9f02-6602dcb46aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:07.434922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef370c4-7c8a-4f4d-9f02-6602dcb46aa8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:07.438742 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 161/324] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Oct 20 13:23:07 2022] GET /identity/v3/role_assignments?group.id=a5d95efcc27341e0967509ca472b94b9&scope.project.id=1bf5e097ed8d4a1381b8224dd5a11e27&role.id=233938f0e7e84b5098019470ad8cfb4e => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:07.439667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097bf2c-aad2-42e1-8a2f-f93983d1b745 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:07.447492 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef370c4-7c8a-4f4d-9f02-6602dcb46aa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:07.454265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-0ef370c4-7c8a-4f4d-9f02-6602dcb46aa8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:23:07.454265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:07.454265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:07.454265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:07.454265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:07.454265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:07.454265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:07.454265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:07.454265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:07.454265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:07.454265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:07.454265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:07.454265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:07.454265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:07.454265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:07.454265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:07.455485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:07.455485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:07.455485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:07.455485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:07.455485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:07.455485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:07.455485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:07.455485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:07.455485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:07.455485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:07.455485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:07.455485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:07.455485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:07.455485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:07.455485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:07.455485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:07.456579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:07.456579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:07.456579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:07.456579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:07.456579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:07.456579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:07.456579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:07.456579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:07.456579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:07.456579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:07.456579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:23:07.456579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:07.456579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 164/325] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Oct 20 13:23:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:07.461808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef370c4-7c8a-4f4d-9f02-6602dcb46aa8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:07.473235 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:07.551170 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:07.583946 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e097bf2c-aad2-42e1-8a2f-f93983d1b745 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:07.611851 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef370c4-7c8a-4f4d-9f02-6602dcb46aa8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:07.630193 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91373a06-c167-4042-a848-3f84f747851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:07.630907 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91373a06-c167-4042-a848-3f84f747851e None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:07.631248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91373a06-c167-4042-a848-3f84f747851e None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:07.631498 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91373a06-c167-4042-a848-3f84f747851e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:07.647385 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91373a06-c167-4042-a848-3f84f747851e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:07.653602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-91373a06-c167-4042-a848-3f84f747851e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:23:07.653602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:07.653602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:07.653602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:07.653602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:07.653602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:07.653602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:07.653602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:07.653602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:07.653602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:07.653602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:07.653602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:07.653602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:07.653602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:07.653602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:07.653602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:07.654494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:07.654494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:07.654494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:07.654494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:07.654494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:07.654494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:07.654494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:07.654494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:07.654494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:07.654494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:07.654494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:07.654494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:07.654494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:07.654494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:07.654494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:07.654494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:07.655363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:07.655363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:07.655363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:07.655363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:07.655363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:07.655363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:07.655363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:07.655363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:07.655363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:07.655363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:07.655363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:23:07.655363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:07.655363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 162/326] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:23:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:07.658441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02e1e6-aa78-4946-80de-6fd541277888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:07.659806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02e1e6-aa78-4946-80de-6fd541277888 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:07.660512 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02e1e6-aa78-4946-80de-6fd541277888 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:07.660798 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02e1e6-aa78-4946-80de-6fd541277888 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:07.661481 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02e1e6-aa78-4946-80de-6fd541277888 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:07.661576 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91373a06-c167-4042-a848-3f84f747851e None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:07.661791 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02e1e6-aa78-4946-80de-6fd541277888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:07.663197 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02e1e6-aa78-4946-80de-6fd541277888 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:07.674621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 165/327] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:07.681388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02e1e6-aa78-4946-80de-6fd541277888 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:07.759886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:07.789954 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91373a06-c167-4042-a848-3f84f747851e None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:07.811277 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02e1e6-aa78-4946-80de-6fd541277888 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:07.829183 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df87af-0c01-45ea-96e6-e56807593c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:07.829793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df87af-0c01-45ea-96e6-e56807593c69 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:07.830074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df87af-0c01-45ea-96e6-e56807593c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:07.830346 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df87af-0c01-45ea-96e6-e56807593c69 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:07.831653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df87af-0c01-45ea-96e6-e56807593c69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:07.831955 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df87af-0c01-45ea-96e6-e56807593c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:07.833355 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df87af-0c01-45ea-96e6-e56807593c69 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:07.842154 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 163/328] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:23:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:07.843290 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:07.849298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df87af-0c01-45ea-96e6-e56807593c69 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:07.853420 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f805c-b107-43a0-9936-aefa7b01e7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:07.854036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f805c-b107-43a0-9936-aefa7b01e7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:07.854317 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f805c-b107-43a0-9936-aefa7b01e7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:07.854590 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f805c-b107-43a0-9936-aefa7b01e7a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:07.942103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f805c-b107-43a0-9936-aefa7b01e7a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:07.943802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f805c-b107-43a0-9936-aefa7b01e7a2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:07.965772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df87af-0c01-45ea-96e6-e56807593c69 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:08.006636 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f749d49-8ab3-4d74-a0fe-f9b0602ba6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:08.007296 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f749d49-8ab3-4d74-a0fe-f9b0602ba6be None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:08.007575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f749d49-8ab3-4d74-a0fe-f9b0602ba6be None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:08.008142 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f749d49-8ab3-4d74-a0fe-f9b0602ba6be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:08.020597 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:08.068229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 166/329] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:23:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 20 13:23:08.073278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f805c-b107-43a0-9936-aefa7b01e7a2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:08.093837 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f749d49-8ab3-4d74-a0fe-f9b0602ba6be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:08.095823 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f749d49-8ab3-4d74-a0fe-f9b0602ba6be None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:08.104435 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:08.203170 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f805c-b107-43a0-9936-aefa7b01e7a2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:08.215848 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 164/330] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:23:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 20 13:23:08.221406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f749d49-8ab3-4d74-a0fe-f9b0602ba6be None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:08.237354 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a3cf5-8c41-4cb8-becf-fc5ef4668edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:08.238958 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a3cf5-8c41-4cb8-becf-fc5ef4668edf None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:08.239271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a3cf5-8c41-4cb8-becf-fc5ef4668edf None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:08.239546 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a3cf5-8c41-4cb8-becf-fc5ef4668edf None admin] PATH_INFO: `/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:08.240673 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a3cf5-8c41-4cb8-becf-fc5ef4668edf None admin] RBAC: Authorizing `identity:get_project(project_id=1bf5e097ed8d4a1381b8224dd5a11e27)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:08.242132 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a3cf5-8c41-4cb8-becf-fc5ef4668edf None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:08.243915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 167/331] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:23:08 2022] GET /identity/v3/projects/1bf5e097ed8d4a1381b8224dd5a11e27 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:08.249170 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a3cf5-8c41-4cb8-becf-fc5ef4668edf None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:08.262439 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:08.329064 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f749d49-8ab3-4d74-a0fe-f9b0602ba6be None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:08.342380 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:08.350132 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a3cf5-8c41-4cb8-becf-fc5ef4668edf None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:08.363592 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cee64-d5b4-4ac5-b1ee-74409f3b2b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:08.364217 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cee64-d5b4-4ac5-b1ee-74409f3b2b37 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:08.364489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cee64-d5b4-4ac5-b1ee-74409f3b2b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:08.364754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cee64-d5b4-4ac5-b1ee-74409f3b2b37 None admin] PATH_INFO: `/v3/projects/fb60201a6517430aaa26188ed8565651` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:08.365851 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cee64-d5b4-4ac5-b1ee-74409f3b2b37 None admin] RBAC: Authorizing `identity:get_project(project_id=fb60201a6517430aaa26188ed8565651)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:08.367302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832cee64-d5b4-4ac5-b1ee-74409f3b2b37 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:08.368908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 165/332] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:23:08 2022] GET /identity/v3/projects/fb60201a6517430aaa26188ed8565651 => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:08.374485 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cee64-d5b4-4ac5-b1ee-74409f3b2b37 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:08.384730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94dd0f-efee-4f5d-bb4d-660db25b3b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:08.385365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94dd0f-efee-4f5d-bb4d-660db25b3b05 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:08.385647 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94dd0f-efee-4f5d-bb4d-660db25b3b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:08.385919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94dd0f-efee-4f5d-bb4d-660db25b3b05 None admin] PATH_INFO: `/v3/groups/a5d95efcc27341e0967509ca472b94b9` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:08.387047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94dd0f-efee-4f5d-bb4d-660db25b3b05 None admin] RBAC: Authorizing `identity:get_group(group_id=a5d95efcc27341e0967509ca472b94b9)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:08.388479 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94dd0f-efee-4f5d-bb4d-660db25b3b05 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:08.390042 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 168/333] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Oct 20 13:23:08 2022] GET /identity/v3/groups/a5d95efcc27341e0967509ca472b94b9 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:08.396373 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94dd0f-efee-4f5d-bb4d-660db25b3b05 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:08.472933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cee64-d5b4-4ac5-b1ee-74409f3b2b37 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:08.479988 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:08.493200 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94dd0f-efee-4f5d-bb4d-660db25b3b05 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:08.508744 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cceb29-45e4-4547-b4b7-b07783197f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:08.509418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cceb29-45e4-4547-b4b7-b07783197f12 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:08.509697 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cceb29-45e4-4547-b4b7-b07783197f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:08.509977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cceb29-45e4-4547-b4b7-b07783197f12 None admin] PATH_INFO: `/v3/groups/5c0b466c9b824d7f9e42888631d0b18f` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:08.511109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cceb29-45e4-4547-b4b7-b07783197f12 None admin] RBAC: Authorizing `identity:get_group(group_id=5c0b466c9b824d7f9e42888631d0b18f)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:08.512554 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cceb29-45e4-4547-b4b7-b07783197f12 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:08.514308 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 166/334] 10.222.0.36 () {56 vars in 1180 bytes} [Thu Oct 20 13:23:08 2022] GET /identity/v3/groups/5c0b466c9b824d7f9e42888631d0b18f => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:08.520249 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cceb29-45e4-4547-b4b7-b07783197f12 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:08.528871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8b6cf-0b25-4336-a4f7-8fda2401a9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:08.529478 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8b6cf-0b25-4336-a4f7-8fda2401a9ae None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:08.529755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8b6cf-0b25-4336-a4f7-8fda2401a9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:08.530116 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8b6cf-0b25-4336-a4f7-8fda2401a9ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:08.530815 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8b6cf-0b25-4336-a4f7-8fda2401a9ae None admin] RBAC: Adding query filter params (group.id=a5d95efcc27341e0967509ca472b94b9, role.id=c63cd01b72aa49d5932f4b4f762fdf5c, scope.project.id=1bf5e097ed8d4a1381b8224dd5a11e27) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:08.531151 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8b6cf-0b25-4336-a4f7-8fda2401a9ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:08.532574 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8b6cf-0b25-4336-a4f7-8fda2401a9ae None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:08.539959 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 169/335] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Oct 20 13:23:08 2022] GET /identity/v3/role_assignments?group.id=a5d95efcc27341e0967509ca472b94b9&scope.project.id=1bf5e097ed8d4a1381b8224dd5a11e27&role.id=c63cd01b72aa49d5932f4b4f762fdf5c => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:08.627319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cceb29-45e4-4547-b4b7-b07783197f12 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:08.663403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5571096-5286-42e4-8d9d-cb77d7e01cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:08.664073 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5571096-5286-42e4-8d9d-cb77d7e01cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:08.664291 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5571096-5286-42e4-8d9d-cb77d7e01cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:08.664567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5571096-5286-42e4-8d9d-cb77d7e01cf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:08.665309 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5571096-5286-42e4-8d9d-cb77d7e01cf2 None admin] RBAC: Adding query filter params (group.id=5c0b466c9b824d7f9e42888631d0b18f, role.id=9c0f227afc2e4a0aa404780de229488c, scope.project.id=fb60201a6517430aaa26188ed8565651) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:08.665614 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5571096-5286-42e4-8d9d-cb77d7e01cf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:08.667361 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5571096-5286-42e4-8d9d-cb77d7e01cf2 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:08.673743 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 167/336] 10.222.0.36 () {56 vars in 1376 bytes} [Thu Oct 20 13:23:08 2022] GET /identity/v3/role_assignments?group.id=5c0b466c9b824d7f9e42888631d0b18f&scope.project.id=fb60201a6517430aaa26188ed8565651&role.id=9c0f227afc2e4a0aa404780de229488c => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:11.220130 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416d89a-0072-4710-b66a-38a8ac4a4cb3 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:11.221054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416d89a-0072-4710-b66a-38a8ac4a4cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:11.222048 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416d89a-0072-4710-b66a-38a8ac4a4cb3 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:11.223749 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 170/337] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:11.229436 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fe397-41de-439b-a95c-d8a4e723e348 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:11.230299 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fe397-41de-439b-a95c-d8a4e723e348 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:11.230777 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fe397-41de-439b-a95c-d8a4e723e348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:11.255157 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-af8fe397-41de-439b-a95c-d8a4e723e348 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:11.256738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-af8fe397-41de-439b-a95c-d8a4e723e348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:11.304255 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:11.357928 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 168/338] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:11.402824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc117419-417d-44a9-ab20-da9a61fbea71 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:11.403357 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc117419-417d-44a9-ab20-da9a61fbea71 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:11.403774 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc117419-417d-44a9-ab20-da9a61fbea71 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:11.405522 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 171/339] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:11.411447 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7c882-74e7-4694-bf5c-0947fd1dc45d None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:11.412010 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7c882-74e7-4694-bf5c-0947fd1dc45d None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:11.412488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7c882-74e7-4694-bf5c-0947fd1dc45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:11.431928 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-f0b7c882-74e7-4694-bf5c-0947fd1dc45d None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:11.433491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-f0b7c882-74e7-4694-bf5c-0947fd1dc45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:11.529251 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 169/340] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:11.946515 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc117419-417d-44a9-ab20-da9a61fbea71 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:11.952647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7c882-74e7-4694-bf5c-0947fd1dc45d None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:12.000414 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:12.107592 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc117419-417d-44a9-ab20-da9a61fbea71 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:12.110583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:12.117140 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7c882-74e7-4694-bf5c-0947fd1dc45d None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:12.149998 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a3afd-cf3b-42aa-b948-0bde512f5df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:12.150860 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a3afd-cf3b-42aa-b948-0bde512f5df9 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:12.151320 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a3afd-cf3b-42aa-b948-0bde512f5df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:12.151754 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a3afd-cf3b-42aa-b948-0bde512f5df9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:12.155200 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adffb7e-b00e-431a-93c7-33bdc2135d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:12.155842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adffb7e-b00e-431a-93c7-33bdc2135d7e None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:12.156126 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adffb7e-b00e-431a-93c7-33bdc2135d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:12.156403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adffb7e-b00e-431a-93c7-33bdc2135d7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:12.163983 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a3afd-cf3b-42aa-b948-0bde512f5df9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:12.165435 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a3afd-cf3b-42aa-b948-0bde512f5df9 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:12.168245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adffb7e-b00e-431a-93c7-33bdc2135d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:12.170176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adffb7e-b00e-431a-93c7-33bdc2135d7e None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:12.181891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-609a3afd-cf3b-42aa-b948-0bde512f5df9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:12.181891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:12.181891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:12.181891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:12.181891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:12.181891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:12.181891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:12.181891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:12.181891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:12.181891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:12.181891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:12.181891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:12.181891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:12.181891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:12.181891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:12.181891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:12.182877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:12.182877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:12.182877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:12.182877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:12.182877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:12.182877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:12.182877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:12.182877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:12.182877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:12.182877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:12.182877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:12.182877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:12.182877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:12.182877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:12.182877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:12.182877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:12.182877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:12.183799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:12.183799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:12.183799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:12.183799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 172/341] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:12.184492 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0530bff-d2fb-457f-8171-6142b8cc2778 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:12.184769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0530bff-d2fb-457f-8171-6142b8cc2778 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:12.185040 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0530bff-d2fb-457f-8171-6142b8cc2778 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:12.190668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 173/342] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:12.190668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da49bd4-25d4-41f5-ad1a-71483657bc76 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:12.190668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da49bd4-25d4-41f5-ad1a-71483657bc76 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:12.190943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-0adffb7e-b00e-431a-93c7-33bdc2135d7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:12.190943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:12.190943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:12.190943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:12.190943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:12.190943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:12.190943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:12.190943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:12.190943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:12.190943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:12.190943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:12.190943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:12.190943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:12.190943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:12.190943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:12.190943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:12.191796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:12.191796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:12.191796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:12.191796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:12.191796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:12.191796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:12.191796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:12.191796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:12.191796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:12.191796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:12.191796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:12.191796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:12.191796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:12.191796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:12.191796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:12.191796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:12.191796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:12.192654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:12.192654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:12.192654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:12.192839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da49bd4-25d4-41f5-ad1a-71483657bc76 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:12.192839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 174/343] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:12.192839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da49bd4-25d4-41f5-ad1a-71483657bc76 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:12.194408 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 170/344] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:12.195823 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917b315-fa2d-4518-9a15-e1323e552457 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:12.196114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917b315-fa2d-4518-9a15-e1323e552457 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:12.196395 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917b315-fa2d-4518-9a15-e1323e552457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:12.216664 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-1917b315-fa2d-4518-9a15-e1323e552457 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:12.217992 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-1917b315-fa2d-4518-9a15-e1323e552457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:12.280312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:12.294056 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 171/345] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:12.294741 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917b315-fa2d-4518-9a15-e1323e552457 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:12.307358 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da49bd4-25d4-41f5-ad1a-71483657bc76 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:12.358015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae01f2e-c1c0-4b52-9313-106de7909726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:12.358616 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae01f2e-c1c0-4b52-9313-106de7909726 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:12.358888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae01f2e-c1c0-4b52-9313-106de7909726 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:12.359175 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae01f2e-c1c0-4b52-9313-106de7909726 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:12.359835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae01f2e-c1c0-4b52-9313-106de7909726 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:12.360132 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae01f2e-c1c0-4b52-9313-106de7909726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:12.361496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae01f2e-c1c0-4b52-9313-106de7909726 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:12.373715 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 175/346] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:12.374857 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bff3a-2c0c-4391-a899-c0ba237fa87d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:12.375181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bff3a-2c0c-4391-a899-c0ba237fa87d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:12.375455 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bff3a-2c0c-4391-a899-c0ba237fa87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:12.393938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-f22bff3a-2c0c-4391-a899-c0ba237fa87d None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:12.395274 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f22bff3a-2c0c-4391-a899-c0ba237fa87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:12.405495 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:12.432274 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1917b315-fa2d-4518-9a15-e1323e552457 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:12.469353 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f54562-8f10-42b1-bdc2-68e71bbb7b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:12.470085 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f54562-8f10-42b1-bdc2-68e71bbb7b06 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:12.470282 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f54562-8f10-42b1-bdc2-68e71bbb7b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:12.470548 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f54562-8f10-42b1-bdc2-68e71bbb7b06 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:12.471238 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f54562-8f10-42b1-bdc2-68e71bbb7b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:12.471598 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f54562-8f10-42b1-bdc2-68e71bbb7b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:12.473128 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f54562-8f10-42b1-bdc2-68e71bbb7b06 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:12.483868 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 176/347] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:12.485055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bff3a-2c0c-4391-a899-c0ba237fa87d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:12.503493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 172/348] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:12.521038 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f54562-8f10-42b1-bdc2-68e71bbb7b06 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:12.566463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:12.611107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bff3a-2c0c-4391-a899-c0ba237fa87d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:12.660560 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af591a29-5370-48d7-bca4-154a0b7e5c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:12.661795 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af591a29-5370-48d7-bca4-154a0b7e5c8e None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:12.662298 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af591a29-5370-48d7-bca4-154a0b7e5c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:12.663026 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af591a29-5370-48d7-bca4-154a0b7e5c8e None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:12.664437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af591a29-5370-48d7-bca4-154a0b7e5c8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:12.666670 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af591a29-5370-48d7-bca4-154a0b7e5c8e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:12.669965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f54562-8f10-42b1-bdc2-68e71bbb7b06 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:12.696725 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 177/349] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:23:12 2022] POST /identity/v3/users => generated 246 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:23:12.698338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af591a29-5370-48d7-bca4-154a0b7e5c8e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:12.714379 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab784b-96cc-4308-a087-695f4bc55760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:12.715188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab784b-96cc-4308-a087-695f4bc55760 None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:12.715630 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab784b-96cc-4308-a087-695f4bc55760 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:12.716353 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab784b-96cc-4308-a087-695f4bc55760 None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:12.717037 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab784b-96cc-4308-a087-695f4bc55760 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:12.719129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab784b-96cc-4308-a087-695f4bc55760 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:12.735156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:12.751542 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 173/350] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:23:12 2022] POST /identity/v3/users => generated 248 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:23:12.783189 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab784b-96cc-4308-a087-695f4bc55760 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:12.863354 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af591a29-5370-48d7-bca4-154a0b7e5c8e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:12.922540 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:12.943293 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed1c7a-f85b-48f8-8e33-04986647d281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:12.943954 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed1c7a-f85b-48f8-8e33-04986647d281 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:12.944229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed1c7a-f85b-48f8-8e33-04986647d281 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:12.944504 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed1c7a-f85b-48f8-8e33-04986647d281 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:12.958816 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed1c7a-f85b-48f8-8e33-04986647d281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:12.960366 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed1c7a-f85b-48f8-8e33-04986647d281 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:12.961467 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab784b-96cc-4308-a087-695f4bc55760 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:12.980160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-90ed1c7a-f85b-48f8-8e33-04986647d281 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:12.980160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:12.980160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:12.980160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:12.980160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:12.980160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:12.980160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:12.980160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:12.980160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:12.980160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:12.980160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:12.980160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:12.980160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:12.980160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:12.980160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:12.980160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:12.981191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:12.981191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:12.981191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:12.981191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:12.981191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:12.981191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:12.981191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:12.981191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:12.981191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:12.981191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:12.981191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:12.981191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:12.981191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:12.981191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:12.981191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:12.981191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:12.981191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:12.982008 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:12.982008 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:12.982008 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:12.982008 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 178/351] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:12.988360 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed1c7a-f85b-48f8-8e33-04986647d281 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:13.005466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502fa10-3bfc-475c-91fc-ba2d59e02fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:13.006124 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502fa10-3bfc-475c-91fc-ba2d59e02fff None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:13.006429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502fa10-3bfc-475c-91fc-ba2d59e02fff None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:13.006700 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502fa10-3bfc-475c-91fc-ba2d59e02fff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:13.019078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502fa10-3bfc-475c-91fc-ba2d59e02fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:13.020647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502fa10-3bfc-475c-91fc-ba2d59e02fff None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:13.039543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-e502fa10-3bfc-475c-91fc-ba2d59e02fff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:13.039543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:13.039543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:13.039543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:13.039543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:13.039543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:13.039543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:13.039543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:13.039543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:13.039543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:13.039543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:13.039543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:13.039543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:13.039543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:13.039543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:13.039543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:13.040482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:13.040482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:13.040482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:13.040482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:13.040482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:13.040482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:13.040482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:13.040482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:13.040482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:13.040482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:13.040482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:13.040482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:13.040482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:13.040482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:13.040482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:13.040482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:13.040482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:13.041565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:13.041565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:13.041565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:13.041565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 174/352] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:23:13.048028 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502fa10-3bfc-475c-91fc-ba2d59e02fff None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:13.116662 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed1c7a-f85b-48f8-8e33-04986647d281 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:13.123349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:13.159323 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d7d78-803c-4d2a-b6eb-17fa7010b09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:13.160028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d7d78-803c-4d2a-b6eb-17fa7010b09f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:13.160306 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d7d78-803c-4d2a-b6eb-17fa7010b09f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:13.161054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d7d78-803c-4d2a-b6eb-17fa7010b09f None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:13.161706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d7d78-803c-4d2a-b6eb-17fa7010b09f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:13.162011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d7d78-803c-4d2a-b6eb-17fa7010b09f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:13.163793 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d7d78-803c-4d2a-b6eb-17fa7010b09f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:13.186219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 179/353] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:13.192883 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d7d78-803c-4d2a-b6eb-17fa7010b09f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:13.211154 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502fa10-3bfc-475c-91fc-ba2d59e02fff None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:13.240973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:13.276438 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254db9f-3b9e-4192-b79c-17090d29c757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:13.277061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254db9f-3b9e-4192-b79c-17090d29c757 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:13.277346 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254db9f-3b9e-4192-b79c-17090d29c757 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:13.277622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254db9f-3b9e-4192-b79c-17090d29c757 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:13.278267 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254db9f-3b9e-4192-b79c-17090d29c757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:13.278573 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254db9f-3b9e-4192-b79c-17090d29c757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:13.279993 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254db9f-3b9e-4192-b79c-17090d29c757 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:13.298824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 175/354] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:13.298824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94810e76-5f18-4c69-81aa-afd84ac37de4 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:13.298824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94810e76-5f18-4c69-81aa-afd84ac37de4 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:13.298824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94810e76-5f18-4c69-81aa-afd84ac37de4 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:13.298824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 176/355] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:13.298824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94810e76-5f18-4c69-81aa-afd84ac37de4 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:13.321678 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d7d78-803c-4d2a-b6eb-17fa7010b09f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:13.358571 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec97a0f-db52-4793-aaa7-88c58faa04a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:13.359233 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec97a0f-db52-4793-aaa7-88c58faa04a7 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:13.359506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec97a0f-db52-4793-aaa7-88c58faa04a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:13.359779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec97a0f-db52-4793-aaa7-88c58faa04a7 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:13.360430 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec97a0f-db52-4793-aaa7-88c58faa04a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:13.362391 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec97a0f-db52-4793-aaa7-88c58faa04a7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:13.395190 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 180/356] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:23:13 2022] POST /identity/v3/users => generated 249 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:23:13.396761 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff415421-a42c-4e0d-9e19-2685e308170b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:13.397049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff415421-a42c-4e0d-9e19-2685e308170b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:13.397386 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff415421-a42c-4e0d-9e19-2685e308170b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:13.440956 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ff415421-a42c-4e0d-9e19-2685e308170b None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:13.444043 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ff415421-a42c-4e0d-9e19-2685e308170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:13.469523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94810e76-5f18-4c69-81aa-afd84ac37de4 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:13.486231 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:13.545277 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5302ce-f7d0-4c91-84ac-796268ea35ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:13.545916 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5302ce-f7d0-4c91-84ac-796268ea35ac None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:13.546191 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5302ce-f7d0-4c91-84ac-796268ea35ac None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:13.546461 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5302ce-f7d0-4c91-84ac-796268ea35ac None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:13.547150 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5302ce-f7d0-4c91-84ac-796268ea35ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:13.548621 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5302ce-f7d0-4c91-84ac-796268ea35ac None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:13.586688 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 181/357] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:13.593776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 177/358] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:23:13 2022] POST /identity/v3/users => generated 248 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:23:13.898185 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff415421-a42c-4e0d-9e19-2685e308170b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:13.926098 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:14.017974 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff415421-a42c-4e0d-9e19-2685e308170b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:14.059637 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87bf68-c750-4945-878b-610430fde4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:14.060243 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87bf68-c750-4945-878b-610430fde4cf None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:14.060521 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87bf68-c750-4945-878b-610430fde4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:14.060794 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87bf68-c750-4945-878b-610430fde4cf None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:14.061472 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87bf68-c750-4945-878b-610430fde4cf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:14.062878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87bf68-c750-4945-878b-610430fde4cf None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:14.082817 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.sql.core [None req-9a87bf68-c750-4945-878b-610430fde4cf None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 20 13:23:14.082817 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 20 13:23:14.082817 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [parameters: {'id': '552c155c89a349d291ad16220e4191d4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 20 13:23:14.082817 dv-cinder-862136-1-smb devstack@keystone.service[81427]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81427) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 13:23:14.089395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-9a87bf68-c750-4945-878b-610430fde4cf None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 20 13:23:14.089395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:14.089395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 13:23:14.089395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 13:23:14.089395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 13:23:14.089395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 13:23:14.089395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 13:23:14.089395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 13:23:14.089395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 13:23:14.089395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application conn.query(q) Oct 20 13:23:14.089395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 13:23:14.089395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 13:23:14.089395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 13:23:14.089395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application result.read() Oct 20 13:23:14.089395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return ref.to_dict() Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 13:23:14.090236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application next(self.gen) Oct 20 13:23:14.091171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 20 13:23:14.091171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application yield resource Oct 20 13:23:14.091171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 13:23:14.091171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application next(self.gen) Oct 20 13:23:14.091171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 20 13:23:14.091171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 13:23:14.091171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 13:23:14.091171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 13:23:14.091171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 13:23:14.091171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise self.value Oct 20 13:23:14.091171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 20 13:23:14.091171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 13:23:14.091171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 20 13:23:14.091171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application session.commit() Oct 20 13:23:14.091171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 13:23:14.091171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 13:23:14.091171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 13:23:14.092010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 13:23:14.092010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 13:23:14.092010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.session.flush() Oct 20 13:23:14.092010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 13:23:14.092010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 13:23:14.092010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 13:23:14.092010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 13:23:14.092010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 13:23:14.092010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application compat.raise_( Oct 20 13:23:14.092010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 13:23:14.092010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception Oct 20 13:23:14.092010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 13:23:14.092010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 13:23:14.092010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 13:23:14.092010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 13:23:14.092010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 13:23:14.092010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 13:23:14.092880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 13:23:14.092880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 13:23:14.092880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 20 13:23:14.092880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 20 13:23:14.092880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 13:23:14.092880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 13:23:14.092880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 13:23:14.092880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 13:23:14.092880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 13:23:14.092880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 13:23:14.092880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 13:23:14.092880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 13:23:14.092880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 13:23:14.092880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 13:23:14.092880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 13:23:14.092880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception Oct 20 13:23:14.093668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 13:23:14.093668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 13:23:14.093668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 13:23:14.093668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 13:23:14.093668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 13:23:14.093668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 13:23:14.093668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 13:23:14.093668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application conn.query(q) Oct 20 13:23:14.093668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 13:23:14.093668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 13:23:14.093668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 13:23:14.093668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application result.read() Oct 20 13:23:14.093668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 13:23:14.093668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 13:23:14.093668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 13:23:14.093668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 13:23:14.094434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 13:23:14.094434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 13:23:14.094434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 13:23:14.094434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 13:23:14.094434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 20 13:23:14.094434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 20 13:23:14.094434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [parameters: {'id': '552c155c89a349d291ad16220e4191d4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 20 13:23:14.094434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 13:23:14.094434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:14.094434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:14.094434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:14.094434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:14.094434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:14.094434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:14.094434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:14.094434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:14.097441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:14.097441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:14.097441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:14.097441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:14.097441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:14.097441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:14.097441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 20 13:23:14.097441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 20 13:23:14.097441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:14.097441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:14.097441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 20 13:23:14.097441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 20 13:23:14.097441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 13:23:14.097441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 13:23:14.097441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 20 13:23:14.097441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:14.099519 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 182/359] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Oct 20 13:23:13 2022] POST /identity/v3/roles => generated 144 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:14.105971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5302ce-f7d0-4c91-84ac-796268ea35ac None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:14.228536 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5302ce-f7d0-4c91-84ac-796268ea35ac None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:14.266399 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9086e170-d10f-48ef-a08c-5a7a4ad48cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:14.267061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086e170-d10f-48ef-a08c-5a7a4ad48cde None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:14.267339 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086e170-d10f-48ef-a08c-5a7a4ad48cde None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:14.267607 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9086e170-d10f-48ef-a08c-5a7a4ad48cde None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:14.279417 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9086e170-d10f-48ef-a08c-5a7a4ad48cde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:14.284862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-9086e170-d10f-48ef-a08c-5a7a4ad48cde None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:23:14.284862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:14.284862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:14.284862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:14.284862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:14.284862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:14.284862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:14.284862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:14.284862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:14.284862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:14.284862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:14.284862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:14.284862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:14.284862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:14.284862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:14.284862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:14.286552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:14.286552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:14.286552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:14.286552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:14.286552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:14.286552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:14.286552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:14.286552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:14.286552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:14.286552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:14.286552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:14.286552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:14.286552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:14.286552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:14.286552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:14.286552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:14.287643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:14.287643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:14.287643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:14.287643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:14.287643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:14.287643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:14.287643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:14.287643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:14.287643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:14.287643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:14.287643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 20 13:23:14.287643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:14.287643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 178/360] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Oct 20 13:23:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:14.296041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87bf68-c750-4945-878b-610430fde4cf None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:14.398548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:14.414014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87bf68-c750-4945-878b-610430fde4cf None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:14.449632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da56bc1-2e7c-42aa-be6e-fcfc3a5e237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:14.450241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da56bc1-2e7c-42aa-be6e-fcfc3a5e237d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:14.450516 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da56bc1-2e7c-42aa-be6e-fcfc3a5e237d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:14.450780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da56bc1-2e7c-42aa-be6e-fcfc3a5e237d None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:14.451469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da56bc1-2e7c-42aa-be6e-fcfc3a5e237d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:14.451825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da56bc1-2e7c-42aa-be6e-fcfc3a5e237d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:14.453181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da56bc1-2e7c-42aa-be6e-fcfc3a5e237d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:14.461533 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 183/361] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:15.422620 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bb490-4efd-4acb-b532-6b86bb9b8f87 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:15.423158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bb490-4efd-4acb-b532-6b86bb9b8f87 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:15.423258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bb490-4efd-4acb-b532-6b86bb9b8f87 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:15.425271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 179/362] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:15.431009 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bf455-2ef0-4adc-b9bb-b1616ebf8da4 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:15.431820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bf455-2ef0-4adc-b9bb-b1616ebf8da4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:15.432296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bf455-2ef0-4adc-b9bb-b1616ebf8da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:15.467990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-b64bf455-2ef0-4adc-b9bb-b1616ebf8da4 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:15.469534 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b64bf455-2ef0-4adc-b9bb-b1616ebf8da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:15.559292 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 184/363] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:23:15.656608 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cd7b4-517f-4477-9d06-818c122efa4c None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:15.657250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cd7b4-517f-4477-9d06-818c122efa4c None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:15.657727 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cd7b4-517f-4477-9d06-818c122efa4c None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:15.660295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 180/364] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:15.665425 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cda4a-3e62-4322-89f6-34c8ab11fd5a None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:15.666271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cda4a-3e62-4322-89f6-34c8ab11fd5a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:15.666765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22cda4a-3e62-4322-89f6-34c8ab11fd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:15.692094 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d22cda4a-3e62-4322-89f6-34c8ab11fd5a None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:15.693615 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d22cda4a-3e62-4322-89f6-34c8ab11fd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:15.777394 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 185/365] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:15.945777 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cd7b4-517f-4477-9d06-818c122efa4c None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:15.984001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:16.092831 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cd7b4-517f-4477-9d06-818c122efa4c None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:16.136130 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc984bb-b6f8-4dce-8a83-87ff2e2bb1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:16.137163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc984bb-b6f8-4dce-8a83-87ff2e2bb1fc None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:16.137646 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc984bb-b6f8-4dce-8a83-87ff2e2bb1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:16.138120 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc984bb-b6f8-4dce-8a83-87ff2e2bb1fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:16.154373 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc984bb-b6f8-4dce-8a83-87ff2e2bb1fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:16.159897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-dcc984bb-b6f8-4dce-8a83-87ff2e2bb1fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:16.159897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:16.159897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:16.159897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:16.159897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:16.159897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:16.159897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:16.159897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:16.159897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:16.159897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:16.159897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:16.159897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:16.159897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:16.159897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:16.159897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:16.159897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:16.160772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:16.160772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:16.160772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:16.160772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:16.160772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:16.160772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:16.160772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:16.160772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:16.160772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:16.160772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:16.160772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:16.160772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:16.160772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:16.160772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:16.160772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:16.160772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:16.161550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:16.161550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:16.161550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:16.161550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:16.161550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:16.161550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:16.161550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:16.161550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:16.161550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:16.161550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:16.161550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:16.161550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:16.164188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 181/366] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Oct 20 13:23:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:16.170665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cda4a-3e62-4322-89f6-34c8ab11fd5a None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:16.183382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:16.195166 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4fcfc-0a67-410f-8f0d-702352572d9e None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:16.195926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4fcfc-0a67-410f-8f0d-702352572d9e None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:16.196420 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4fcfc-0a67-410f-8f0d-702352572d9e None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:16.199007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 182/367] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:16.209093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847657ff-aa6e-4867-ab07-0a001dc39f28 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:16.209721 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847657ff-aa6e-4867-ab07-0a001dc39f28 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:16.210217 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847657ff-aa6e-4867-ab07-0a001dc39f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:16.247465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-847657ff-aa6e-4867-ab07-0a001dc39f28 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:16.249027 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-847657ff-aa6e-4867-ab07-0a001dc39f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:16.295115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22cda4a-3e62-4322-89f6-34c8ab11fd5a None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:16.333879 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 183/368] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:16.335514 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f0a24-526f-4408-9e89-dccf7cc37c81 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:16.336023 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f0a24-526f-4408-9e89-dccf7cc37c81 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:16.336518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f0a24-526f-4408-9e89-dccf7cc37c81 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:16.338224 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 184/369] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:16.339671 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e8773-a881-456c-96ca-5a93ec1fa711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:16.340508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e8773-a881-456c-96ca-5a93ec1fa711 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:16.341065 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e8773-a881-456c-96ca-5a93ec1fa711 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:16.341535 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e8773-a881-456c-96ca-5a93ec1fa711 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:16.343051 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b689717-bb36-437a-b8b9-61a82b4f587e None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:16.343532 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b689717-bb36-437a-b8b9-61a82b4f587e None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:16.343705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e8773-a881-456c-96ca-5a93ec1fa711 None admin] RBAC: Adding query filter params (name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:16.343978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e8773-a881-456c-96ca-5a93ec1fa711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:16.344400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b689717-bb36-437a-b8b9-61a82b4f587e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:16.345347 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e8773-a881-456c-96ca-5a93ec1fa711 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:16.354600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 186/370] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Oct 20 13:23:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:16.355514 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e8773-a881-456c-96ca-5a93ec1fa711 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:16.369296 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-9b689717-bb36-437a-b8b9-61a82b4f587e None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:16.370454 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9b689717-bb36-437a-b8b9-61a82b4f587e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:16.383413 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:16.441867 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:16.460127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 185/371] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:16.461723 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b689717-bb36-437a-b8b9-61a82b4f587e None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:16.473818 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e8773-a881-456c-96ca-5a93ec1fa711 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:16.508898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9059a0a-d328-4af5-89a1-0e9e6d30b2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:16.509358 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9059a0a-d328-4af5-89a1-0e9e6d30b2ce None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:16.509637 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9059a0a-d328-4af5-89a1-0e9e6d30b2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:16.509905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9059a0a-d328-4af5-89a1-0e9e6d30b2ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:16.521280 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9059a0a-d328-4af5-89a1-0e9e6d30b2ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:16.526877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-c9059a0a-d328-4af5-89a1-0e9e6d30b2ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:16.526877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:16.526877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:16.526877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:16.526877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:16.526877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:16.526877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:16.526877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:16.526877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:16.526877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:16.526877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:16.526877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:16.526877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:16.526877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:16.526877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:16.526877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:16.527810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:16.527810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:16.527810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:16.527810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:16.527810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:16.527810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:16.527810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:16.527810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:16.527810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:16.527810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:16.527810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:16.527810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:16.527810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:16.527810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:16.527810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:16.527810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:16.528588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:16.528588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:16.528588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:16.528588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:16.528588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:16.528588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:16.528588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:16.528588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:16.528588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:16.528588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:16.528588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:16.528588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:16.528588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 187/372] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Oct 20 13:23:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:16.540113 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9059a0a-d328-4af5-89a1-0e9e6d30b2ce None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:16.575053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b689717-bb36-437a-b8b9-61a82b4f587e None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:16.618821 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762fcca-316b-49fb-9dc3-83ae5aa06e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:16.619807 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762fcca-316b-49fb-9dc3-83ae5aa06e95 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:16.620265 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762fcca-316b-49fb-9dc3-83ae5aa06e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:16.620715 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762fcca-316b-49fb-9dc3-83ae5aa06e95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:16.637781 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762fcca-316b-49fb-9dc3-83ae5aa06e95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:16.640243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762fcca-316b-49fb-9dc3-83ae5aa06e95 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:16.667469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-d762fcca-316b-49fb-9dc3-83ae5aa06e95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:16.667469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:16.667469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:16.667469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:16.667469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:16.667469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:16.667469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:16.667469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:16.667469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:16.667469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:16.667469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:16.667469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:16.667469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:16.667469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:16.667469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:16.667469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:16.668401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:16.668401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:16.668401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:16.668401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:16.668401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:16.668401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:16.668401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:16.668401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:16.668401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:16.668401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:16.668401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:16.668401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:16.668401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:16.668401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:16.668401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:16.668401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:16.668401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:16.669223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:16.669223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:16.669223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:16.671149 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 186/373] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:16.675011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:16.677310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762fcca-316b-49fb-9dc3-83ae5aa06e95 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:16.730019 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9059a0a-d328-4af5-89a1-0e9e6d30b2ce None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:16.767632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:16.776414 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb962c89-2797-49a1-b1d5-11c9671e84ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:16.777305 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb962c89-2797-49a1-b1d5-11c9671e84ed None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:16.778285 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb962c89-2797-49a1-b1d5-11c9671e84ed None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:16.778745 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb962c89-2797-49a1-b1d5-11c9671e84ed None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:16.779657 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb962c89-2797-49a1-b1d5-11c9671e84ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:16.780622 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb962c89-2797-49a1-b1d5-11c9671e84ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:16.782912 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb962c89-2797-49a1-b1d5-11c9671e84ed None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:16.794627 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 188/374] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Oct 20 13:23:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:16.795904 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb962c89-2797-49a1-b1d5-11c9671e84ed None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:16.806193 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762fcca-316b-49fb-9dc3-83ae5aa06e95 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:16.841417 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de00222-2a56-4149-b4cb-de7c3cea4d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:16.842186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de00222-2a56-4149-b4cb-de7c3cea4d71 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:16.842465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de00222-2a56-4149-b4cb-de7c3cea4d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:16.842730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de00222-2a56-4149-b4cb-de7c3cea4d71 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:16.843398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de00222-2a56-4149-b4cb-de7c3cea4d71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:16.843700 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de00222-2a56-4149-b4cb-de7c3cea4d71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:16.845062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de00222-2a56-4149-b4cb-de7c3cea4d71 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:16.857802 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 187/375] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:16.862399 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de00222-2a56-4149-b4cb-de7c3cea4d71 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:16.919036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:16.919556 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb962c89-2797-49a1-b1d5-11c9671e84ed None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:16.953649 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e29cd4-d0b3-4eb4-bee4-dfeabe19b22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:16.954273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e29cd4-d0b3-4eb4-bee4-dfeabe19b22d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:16.954551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e29cd4-d0b3-4eb4-bee4-dfeabe19b22d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:16.954822 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e29cd4-d0b3-4eb4-bee4-dfeabe19b22d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:16.965689 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e29cd4-d0b3-4eb4-bee4-dfeabe19b22d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:16.970846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-54e29cd4-d0b3-4eb4-bee4-dfeabe19b22d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:16.970846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:16.970846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:16.970846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:16.970846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:16.970846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:16.970846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:16.970846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:16.970846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:16.970846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:16.970846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:16.970846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:16.970846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:16.970846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:16.970846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:16.970846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:16.972686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:16.972686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:16.972686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:16.972686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:16.972686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:16.972686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:16.972686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:16.972686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:16.972686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:16.972686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:16.972686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:16.972686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:16.972686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:16.972686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:16.972686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:16.972686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:16.973468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:16.973468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:16.973468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:16.973468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:16.973468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:16.973468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:16.973468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:16.973468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:16.973468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:16.973468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:16.973468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:16.973468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:16.973468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 189/376] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Oct 20 13:23:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:16.973468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e29cd4-d0b3-4eb4-bee4-dfeabe19b22d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:16.978257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de00222-2a56-4149-b4cb-de7c3cea4d71 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:17.014865 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47942af1-a488-4187-be94-87c82e0811a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:17.015736 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47942af1-a488-4187-be94-87c82e0811a3 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:17.016156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47942af1-a488-4187-be94-87c82e0811a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:17.016599 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47942af1-a488-4187-be94-87c82e0811a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:17.027837 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47942af1-a488-4187-be94-87c82e0811a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:17.032829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-47942af1-a488-4187-be94-87c82e0811a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:17.032829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:17.032829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:17.032829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:17.032829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:17.032829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:17.032829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:17.032829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:17.032829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:17.032829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:17.032829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:17.032829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:17.032829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:17.032829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:17.032829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:17.032829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:17.034465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:17.034465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:17.034465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:17.034465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:17.034465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:17.034465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:17.034465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:17.034465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:17.034465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:17.034465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:17.034465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:17.034465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:17.034465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:17.034465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:17.034465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:17.034465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:17.035430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:17.035430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:17.035430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:17.035430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:17.035430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:17.035430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:17.035430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:17.035430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:17.035430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:17.035430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:17.035430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:17.035430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:17.036103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:17.037454 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 188/377] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Oct 20 13:23:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:17.038394 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47942af1-a488-4187-be94-87c82e0811a3 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:17.093132 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e29cd4-d0b3-4eb4-bee4-dfeabe19b22d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:17.134905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396759d6-4d35-401e-95cf-43049def289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:17.135567 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396759d6-4d35-401e-95cf-43049def289f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:17.135848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396759d6-4d35-401e-95cf-43049def289f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:17.136123 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396759d6-4d35-401e-95cf-43049def289f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:17.147889 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396759d6-4d35-401e-95cf-43049def289f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:17.149322 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396759d6-4d35-401e-95cf-43049def289f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:17.150237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47942af1-a488-4187-be94-87c82e0811a3 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:17.163871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-396759d6-4d35-401e-95cf-43049def289f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:17.163871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:17.163871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:17.163871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:17.163871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:17.163871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:17.163871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:17.163871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:17.163871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:17.163871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:17.163871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:17.163871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:17.163871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:17.163871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:17.163871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:17.163871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:17.164770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:17.164770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:17.164770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:17.164770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:17.164770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:17.164770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:17.164770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:17.164770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:17.164770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:17.164770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:17.164770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:17.164770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:17.164770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:17.164770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:17.164770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:17.164770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:17.164770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:17.165846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:17.165846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:17.165846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:17.165846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 190/378] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:17.166054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396759d6-4d35-401e-95cf-43049def289f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:17.170873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:17.191808 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63b6f5-f6c9-4aa9-8b70-a6d7f3e0a12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:17.192440 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b6f5-f6c9-4aa9-8b70-a6d7f3e0a12b None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:17.192719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b6f5-f6c9-4aa9-8b70-a6d7f3e0a12b None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:17.192989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b6f5-f6c9-4aa9-8b70-a6d7f3e0a12b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:17.200442 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63b6f5-f6c9-4aa9-8b70-a6d7f3e0a12b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:17.201900 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63b6f5-f6c9-4aa9-8b70-a6d7f3e0a12b None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:17.216062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-2f63b6f5-f6c9-4aa9-8b70-a6d7f3e0a12b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 13:23:17.216062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:17.216062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:17.216062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:17.216062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:17.216062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:17.216062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:17.216062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:17.216062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:17.216062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:17.216062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:17.216062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:17.216062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:17.216062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:17.216062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:17.216062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:17.217019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:17.217897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:17.217897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:17.217897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:17.217897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:17.217897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:17.217897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:17.217897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:17.217897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:17.217897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 13:23:17.217897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:17.217897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 189/379] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Oct 20 13:23:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:17.218827 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63b6f5-f6c9-4aa9-8b70-a6d7f3e0a12b None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:17.277814 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396759d6-4d35-401e-95cf-43049def289f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:17.280157 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:17.311430 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe1bb4-c168-43c1-99db-960ae84abe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:17.312035 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe1bb4-c168-43c1-99db-960ae84abe07 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:17.312311 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe1bb4-c168-43c1-99db-960ae84abe07 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:17.312576 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe1bb4-c168-43c1-99db-960ae84abe07 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:17.313233 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe1bb4-c168-43c1-99db-960ae84abe07 None admin] RBAC: Adding query filter params (name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:17.313539 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe1bb4-c168-43c1-99db-960ae84abe07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:17.315469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe1bb4-c168-43c1-99db-960ae84abe07 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:17.316605 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63b6f5-f6c9-4aa9-8b70-a6d7f3e0a12b None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:17.323523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 191/380] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Oct 20 13:23:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:17.324325 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe1bb4-c168-43c1-99db-960ae84abe07 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:17.355403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba8ff3-2e11-4f24-b2e7-53fe78d95b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:17.356010 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba8ff3-2e11-4f24-b2e7-53fe78d95b92 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:17.356291 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba8ff3-2e11-4f24-b2e7-53fe78d95b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:17.356564 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba8ff3-2e11-4f24-b2e7-53fe78d95b92 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:17.357225 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba8ff3-2e11-4f24-b2e7-53fe78d95b92 None admin] RBAC: Adding query filter params (name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:17.357529 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba8ff3-2e11-4f24-b2e7-53fe78d95b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:17.358911 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba8ff3-2e11-4f24-b2e7-53fe78d95b92 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:17.367604 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 190/381] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Oct 20 13:23:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:17.368748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710b9d3-853d-4b7f-b6e7-9b62be09fbd8 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:17.369032 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710b9d3-853d-4b7f-b6e7-9b62be09fbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:17.369308 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710b9d3-853d-4b7f-b6e7-9b62be09fbd8 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:17.370501 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 191/382] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:17.371208 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710b9d3-853d-4b7f-b6e7-9b62be09fbd8 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:17.412100 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:17.429539 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe1bb4-c168-43c1-99db-960ae84abe07 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:17.461513 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e5719-02a7-4aa8-b2f1-2b0af25fe66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:17.462109 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e5719-02a7-4aa8-b2f1-2b0af25fe66b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:17.462373 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e5719-02a7-4aa8-b2f1-2b0af25fe66b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:17.462644 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e5719-02a7-4aa8-b2f1-2b0af25fe66b None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:17.463330 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e5719-02a7-4aa8-b2f1-2b0af25fe66b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:17.463632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e5719-02a7-4aa8-b2f1-2b0af25fe66b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:17.464977 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79e5719-02a7-4aa8-b2f1-2b0af25fe66b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:17.473415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710b9d3-853d-4b7f-b6e7-9b62be09fbd8 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:17.476764 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 192/383] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:17.478688 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e5719-02a7-4aa8-b2f1-2b0af25fe66b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:17.507202 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:17.507486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51deab5-2dea-44fa-9f91-75bf626e4662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:17.508089 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51deab5-2dea-44fa-9f91-75bf626e4662 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:17.508374 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51deab5-2dea-44fa-9f91-75bf626e4662 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:17.508641 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51deab5-2dea-44fa-9f91-75bf626e4662 None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:17.509361 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51deab5-2dea-44fa-9f91-75bf626e4662 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:17.509664 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51deab5-2dea-44fa-9f91-75bf626e4662 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:17.511162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51deab5-2dea-44fa-9f91-75bf626e4662 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:17.547031 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 192/384] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Oct 20 13:23:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:17.547777 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51deab5-2dea-44fa-9f91-75bf626e4662 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:17.582384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e5719-02a7-4aa8-b2f1-2b0af25fe66b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:17.615964 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f2f95-ff4e-4edd-87d1-55d820844c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:17.616599 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f2f95-ff4e-4edd-87d1-55d820844c13 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:17.616876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f2f95-ff4e-4edd-87d1-55d820844c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:17.617146 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f2f95-ff4e-4edd-87d1-55d820844c13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:17.626878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f2f95-ff4e-4edd-87d1-55d820844c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:17.628414 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f2f95-ff4e-4edd-87d1-55d820844c13 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:17.642812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-612f2f95-ff4e-4edd-87d1-55d820844c13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:17.642812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:17.642812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:17.642812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:17.642812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:17.642812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:17.642812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:17.642812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:17.642812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:17.642812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:17.642812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:17.642812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:17.642812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:17.642812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:17.642812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:17.642812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:17.644275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:17.644275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:17.644275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:17.644275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:17.644275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:17.644275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:17.644275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:17.644275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:17.644275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:17.644275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:17.644275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:17.644275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:17.644275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:17.644275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:17.644275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:17.644275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:17.644275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:17.645286 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:17.645286 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:17.645286 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:17.645286 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 193/385] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:17.645868 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62072a5-b95a-480f-a764-353e0120ca6b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:17.646150 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62072a5-b95a-480f-a764-353e0120ca6b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:17.646420 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62072a5-b95a-480f-a764-353e0120ca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:17.649983 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:17.653391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51deab5-2dea-44fa-9f91-75bf626e4662 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:17.664240 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-a62072a5-b95a-480f-a764-353e0120ca6b None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:17.665446 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a62072a5-b95a-480f-a764-353e0120ca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:17.688024 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1f4b8-02a6-4d25-b98d-209b5cfcc35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:17.688658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1f4b8-02a6-4d25-b98d-209b5cfcc35d None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:17.688938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1f4b8-02a6-4d25-b98d-209b5cfcc35d None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:17.689210 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1f4b8-02a6-4d25-b98d-209b5cfcc35d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:17.698935 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1f4b8-02a6-4d25-b98d-209b5cfcc35d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:17.700409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1f4b8-02a6-4d25-b98d-209b5cfcc35d None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:17.715842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-25b1f4b8-02a6-4d25-b98d-209b5cfcc35d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:17.715842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:17.715842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:17.715842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:17.715842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:17.715842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:17.715842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:17.715842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:17.715842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:17.715842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:17.715842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:17.715842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:17.715842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:17.715842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:17.715842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:17.715842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:17.716709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:17.716709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:17.716709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:17.716709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:17.716709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:17.716709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:17.716709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:17.716709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:17.716709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:17.716709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:17.716709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:17.716709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:17.716709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:17.716709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:17.716709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:17.716709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:17.716709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:17.717560 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:17.717560 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:17.717560 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:17.717560 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 193/386] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:17.717769 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1f4b8-02a6-4d25-b98d-209b5cfcc35d None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:17.736160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 194/387] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:17.751835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62072a5-b95a-480f-a764-353e0120ca6b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:17.762191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:17.829907 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1f4b8-02a6-4d25-b98d-209b5cfcc35d None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:17.854059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62072a5-b95a-480f-a764-353e0120ca6b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:17.866250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619585b9-c71c-4cb0-8345-9091abf72402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:17.866880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619585b9-c71c-4cb0-8345-9091abf72402 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:17.870102 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619585b9-c71c-4cb0-8345-9091abf72402 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:17.870102 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619585b9-c71c-4cb0-8345-9091abf72402 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:17.875175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619585b9-c71c-4cb0-8345-9091abf72402 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:17.876635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619585b9-c71c-4cb0-8345-9091abf72402 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:17.888077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-619585b9-c71c-4cb0-8345-9091abf72402 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 20 13:23:17.888077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:17.888077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:17.888077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:17.888077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:17.888077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:17.888077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:17.888077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:17.888077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:17.888077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:17.888077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:17.888077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:17.888077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:17.888077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:17.888077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:17.888077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:17.888971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:17.890500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:17.890500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:17.890500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:17.890500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:17.890500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:17.890500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:17.890500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:17.890500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:17.890500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 20 13:23:17.890500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:17.890500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 194/388] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:23:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:17.890500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619585b9-c71c-4cb0-8345-9091abf72402 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:17.900842 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c83975-681a-4d24-9356-824b80d7e9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:17.901903 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c83975-681a-4d24-9356-824b80d7e9bc None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:17.902182 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c83975-681a-4d24-9356-824b80d7e9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:17.902454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c83975-681a-4d24-9356-824b80d7e9bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:17.904095 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:17.915402 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c83975-681a-4d24-9356-824b80d7e9bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:17.917120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c83975-681a-4d24-9356-824b80d7e9bc None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:17.932747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f3c83975-681a-4d24-9356-824b80d7e9bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:17.932747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:17.932747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:17.932747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:17.932747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:17.932747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:17.932747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:17.932747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:17.932747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:17.932747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:17.932747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:17.932747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:17.932747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:17.932747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:17.932747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:17.932747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:17.933652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:17.933652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:17.933652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:17.933652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:17.933652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:17.933652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:17.933652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:17.933652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:17.933652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:17.933652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:17.933652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:17.933652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:17.933652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:17.933652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:17.933652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:17.933652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:17.933652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:17.934496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:17.934496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:17.934496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:17.934496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 195/389] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:17.934717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c83975-681a-4d24-9356-824b80d7e9bc None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:17.996686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:18.009734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619585b9-c71c-4cb0-8345-9091abf72402 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:18.041139 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c83975-681a-4d24-9356-824b80d7e9bc None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:18.043830 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bf3f4-589f-4503-9c26-09bb47b551b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:18.044440 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bf3f4-589f-4503-9c26-09bb47b551b3 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:18.044749 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bf3f4-589f-4503-9c26-09bb47b551b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:18.045026 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bf3f4-589f-4503-9c26-09bb47b551b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:18.045674 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bf3f4-589f-4503-9c26-09bb47b551b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:18.045981 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bf3f4-589f-4503-9c26-09bb47b551b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:18.047404 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bf3f4-589f-4503-9c26-09bb47b551b3 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:18.059491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 195/390] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:18.060283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bf3f4-589f-4503-9c26-09bb47b551b3 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:18.077802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25995d1e-fe73-40b5-8643-64d9fe100ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:18.078705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995d1e-fe73-40b5-8643-64d9fe100ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:18.079020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995d1e-fe73-40b5-8643-64d9fe100ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:18.079299 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995d1e-fe73-40b5-8643-64d9fe100ac0 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:18.079991 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25995d1e-fe73-40b5-8643-64d9fe100ac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:18.080242 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25995d1e-fe73-40b5-8643-64d9fe100ac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:18.081629 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25995d1e-fe73-40b5-8643-64d9fe100ac0 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:18.093137 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 196/391] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:18.093924 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25995d1e-fe73-40b5-8643-64d9fe100ac0 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:18.129468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:18.161667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bf3f4-589f-4503-9c26-09bb47b551b3 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:18.193222 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25995d1e-fe73-40b5-8643-64d9fe100ac0 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:18.195157 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a67761-f296-4529-aff4-65c36357db07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:18.195761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a67761-f296-4529-aff4-65c36357db07 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:18.196036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a67761-f296-4529-aff4-65c36357db07 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:18.196299 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a67761-f296-4529-aff4-65c36357db07 None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:18.197012 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a67761-f296-4529-aff4-65c36357db07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:18.197310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a67761-f296-4529-aff4-65c36357db07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:18.198745 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a67761-f296-4529-aff4-65c36357db07 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:18.213354 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:18.216847 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 196/392] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Oct 20 13:23:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:18.217752 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a67761-f296-4529-aff4-65c36357db07 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:18.232244 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d05ca7-cca9-456e-b869-b1306337a04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:18.233091 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d05ca7-cca9-456e-b869-b1306337a04f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:18.233350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d05ca7-cca9-456e-b869-b1306337a04f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:18.233626 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d05ca7-cca9-456e-b869-b1306337a04f None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:18.234265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d05ca7-cca9-456e-b869-b1306337a04f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:18.234575 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d05ca7-cca9-456e-b869-b1306337a04f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:18.235997 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d05ca7-cca9-456e-b869-b1306337a04f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:18.247073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 197/393] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:18.247857 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d05ca7-cca9-456e-b869-b1306337a04f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:18.317847 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a67761-f296-4529-aff4-65c36357db07 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:18.343876 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:18.347414 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d05ca7-cca9-456e-b869-b1306337a04f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:18.352893 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab97f21-2361-4395-a274-19a06c8c6a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:18.353515 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab97f21-2361-4395-a274-19a06c8c6a91 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:18.353791 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab97f21-2361-4395-a274-19a06c8c6a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:18.354066 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab97f21-2361-4395-a274-19a06c8c6a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:18.364343 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab97f21-2361-4395-a274-19a06c8c6a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:18.365789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab97f21-2361-4395-a274-19a06c8c6a91 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:18.380422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-6ab97f21-2361-4395-a274-19a06c8c6a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:18.380422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:18.380422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:18.380422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:18.380422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:18.380422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:18.380422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:18.380422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:18.380422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:18.380422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:18.380422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:18.380422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:18.380422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:18.380422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:18.380422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:18.380422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:18.381493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:18.381493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:18.381493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:18.381493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:18.381493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:18.381493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:18.381493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:18.381493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:18.381493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:18.381493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:18.381493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:18.381493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:18.381493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:18.381493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:18.381493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:18.381493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:18.381493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:18.382505 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:18.382505 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:18.382505 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:18.382505 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 197/394] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:18.383482 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3ddd3-0a02-44ae-b933-8647b45f6519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:18.383853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab97f21-2361-4395-a274-19a06c8c6a91 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:18.384255 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3ddd3-0a02-44ae-b933-8647b45f6519 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:18.384547 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3ddd3-0a02-44ae-b933-8647b45f6519 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:18.384809 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3ddd3-0a02-44ae-b933-8647b45f6519 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:18.392396 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3ddd3-0a02-44ae-b933-8647b45f6519 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:18.393874 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3ddd3-0a02-44ae-b933-8647b45f6519 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:18.406081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-a5c3ddd3-0a02-44ae-b933-8647b45f6519 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 20 13:23:18.406081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:18.406081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:18.406081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:18.406081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:18.406081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:18.406081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:18.406081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:18.406081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:18.406081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:18.406081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:18.406081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:18.406081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:18.406081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:18.406081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:18.406081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:18.407194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:18.408322 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:18.408322 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:18.408322 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:18.408322 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:18.408322 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:18.408322 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:18.408322 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:18.408322 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:18.408322 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 20 13:23:18.408322 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:18.412151 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 198/395] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Oct 20 13:23:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:18.412817 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3ddd3-0a02-44ae-b933-8647b45f6519 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:18.456733 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:18.485014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab97f21-2361-4395-a274-19a06c8c6a91 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:18.513965 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3ddd3-0a02-44ae-b933-8647b45f6519 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:18.519309 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef2d25-acf7-4026-88fd-91d88d2edcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:18.519939 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef2d25-acf7-4026-88fd-91d88d2edcae None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:18.520219 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef2d25-acf7-4026-88fd-91d88d2edcae None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:18.520491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef2d25-acf7-4026-88fd-91d88d2edcae None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:18.527785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef2d25-acf7-4026-88fd-91d88d2edcae None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:18.529229 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef2d25-acf7-4026-88fd-91d88d2edcae None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:18.540817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-d3ef2d25-acf7-4026-88fd-91d88d2edcae None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 13:23:18.540817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:18.540817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:18.540817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:18.540817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:18.540817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:18.540817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:18.540817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:18.540817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:18.540817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:18.540817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:18.540817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:18.540817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:18.540817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:18.540817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:18.540817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:18.541708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:18.542814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:18.542814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:18.542814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:18.542814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:18.542814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:18.542814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:18.542814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:18.542814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:18.542814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 13:23:18.542814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:18.542814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 198/396] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:23:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:18.542814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef2d25-acf7-4026-88fd-91d88d2edcae None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:18.550338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49c751-0925-4e56-900a-179d95b588f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:18.550988 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49c751-0925-4e56-900a-179d95b588f0 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:18.551271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49c751-0925-4e56-900a-179d95b588f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:18.551542 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49c751-0925-4e56-900a-179d95b588f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:18.563524 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49c751-0925-4e56-900a-179d95b588f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:18.565171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49c751-0925-4e56-900a-179d95b588f0 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:18.581968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:18.583476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-7e49c751-0925-4e56-900a-179d95b588f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:18.583476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:18.583476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:18.583476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:18.583476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:18.583476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:18.583476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:18.583476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:18.583476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:18.583476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:18.583476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:18.583476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:18.583476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:18.583476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:18.583476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:18.583476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:18.584463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:18.584463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:18.584463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:18.584463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:18.584463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:18.584463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:18.584463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:18.584463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:18.584463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:18.584463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:18.584463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:18.584463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:18.584463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:18.584463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:18.584463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:18.584463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:18.584463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:18.585296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:18.585296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:18.585296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:18.585296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 199/397] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:18.585296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49c751-0925-4e56-900a-179d95b588f0 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:18.646136 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef2d25-acf7-4026-88fd-91d88d2edcae None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:18.674933 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:18.680447 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac21c9-2014-4e79-86c2-ec3d9cbc0558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:18.681073 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac21c9-2014-4e79-86c2-ec3d9cbc0558 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:18.681349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac21c9-2014-4e79-86c2-ec3d9cbc0558 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:18.681622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac21c9-2014-4e79-86c2-ec3d9cbc0558 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:18.683889 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49c751-0925-4e56-900a-179d95b588f0 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:18.688176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac21c9-2014-4e79-86c2-ec3d9cbc0558 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:18.689624 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac21c9-2014-4e79-86c2-ec3d9cbc0558 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:18.701898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-30ac21c9-2014-4e79-86c2-ec3d9cbc0558 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:18.701898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:18.701898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:18.701898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:18.701898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:18.701898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:18.701898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:18.701898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:18.701898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:18.701898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:18.701898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:18.701898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:18.701898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:18.701898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:18.701898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:18.702753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:18.702753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:18.702753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:18.702753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:18.702753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:18.702753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:18.702753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:18.702753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:18.702753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:18.702753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:18.702753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:18.702753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:18.702753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:18.702753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:18.702753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:18.702753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:18.702753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:18.703627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:18.703627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:18.703627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:18.703627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:18.703627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:18.703627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:18.703627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:18.703627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:18.703627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 199/398] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:18.704159 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac21c9-2014-4e79-86c2-ec3d9cbc0558 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:18.719869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dba30-437d-4ba3-b032-d9b062e4b28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:18.720486 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dba30-437d-4ba3-b032-d9b062e4b28d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:18.720764 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dba30-437d-4ba3-b032-d9b062e4b28d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:18.721592 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dba30-437d-4ba3-b032-d9b062e4b28d None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:18.722231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dba30-437d-4ba3-b032-d9b062e4b28d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:18.722536 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dba30-437d-4ba3-b032-d9b062e4b28d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:18.723933 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dba30-437d-4ba3-b032-d9b062e4b28d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:18.735358 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 200/399] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:18.736143 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dba30-437d-4ba3-b032-d9b062e4b28d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:18.798866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:18.802683 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac21c9-2014-4e79-86c2-ec3d9cbc0558 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:18.834870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dba30-437d-4ba3-b032-d9b062e4b28d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:18.836408 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f03f6-2963-4420-b050-9e3c9a52d8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:18.837015 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f03f6-2963-4420-b050-9e3c9a52d8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:18.837296 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f03f6-2963-4420-b050-9e3c9a52d8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:18.837568 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f03f6-2963-4420-b050-9e3c9a52d8a0 None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:18.838285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f03f6-2963-4420-b050-9e3c9a52d8a0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:18.838590 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f03f6-2963-4420-b050-9e3c9a52d8a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:18.840044 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25f03f6-2963-4420-b050-9e3c9a52d8a0 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:18.856546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 200/400] 10.222.0.36 () {56 vars in 1139 bytes} [Thu Oct 20 13:23:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:18.859844 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f03f6-2963-4420-b050-9e3c9a52d8a0 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:18.871711 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d0daa-2fd2-4675-9935-441cd879d754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:18.872735 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d0daa-2fd2-4675-9935-441cd879d754 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:18.872735 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d0daa-2fd2-4675-9935-441cd879d754 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:18.872913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d0daa-2fd2-4675-9935-441cd879d754 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:18.873588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d0daa-2fd2-4675-9935-441cd879d754 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:18.873895 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d0daa-2fd2-4675-9935-441cd879d754 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:18.875335 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d0daa-2fd2-4675-9935-441cd879d754 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:18.911838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 201/401] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Oct 20 13:23:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:18.912589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d0daa-2fd2-4675-9935-441cd879d754 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:18.926040 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:18.965030 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25f03f6-2963-4420-b050-9e3c9a52d8a0 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:18.998128 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc473f-ec94-4958-ac21-ca082c968e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:18.998736 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc473f-ec94-4958-ac21-ca082c968e63 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:18.999047 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc473f-ec94-4958-ac21-ca082c968e63 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:18.999323 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc473f-ec94-4958-ac21-ca082c968e63 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:18.999957 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc473f-ec94-4958-ac21-ca082c968e63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:19.000261 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc473f-ec94-4958-ac21-ca082c968e63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:19.001666 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc473f-ec94-4958-ac21-ca082c968e63 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:19.012350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d0daa-2fd2-4675-9935-441cd879d754 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:19.012878 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 201/402] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:19.013646 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc473f-ec94-4958-ac21-ca082c968e63 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:19.031022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:19.052609 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22066a-a135-43e2-a5db-6263b2de7682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:19.053215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22066a-a135-43e2-a5db-6263b2de7682 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:19.053490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22066a-a135-43e2-a5db-6263b2de7682 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:19.053773 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22066a-a135-43e2-a5db-6263b2de7682 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:19.054448 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22066a-a135-43e2-a5db-6263b2de7682 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:19.054749 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22066a-a135-43e2-a5db-6263b2de7682 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:19.056248 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22066a-a135-43e2-a5db-6263b2de7682 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:19.074389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 202/403] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:19.075235 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22066a-a135-43e2-a5db-6263b2de7682 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:19.118380 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc473f-ec94-4958-ac21-ca082c968e63 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:19.144155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:19.152051 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97c65a-5ee4-4eff-b2f5-a72c4cdb3f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:19.152657 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97c65a-5ee4-4eff-b2f5-a72c4cdb3f4f None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:19.152936 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97c65a-5ee4-4eff-b2f5-a72c4cdb3f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:19.153209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97c65a-5ee4-4eff-b2f5-a72c4cdb3f4f None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:19.153847 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97c65a-5ee4-4eff-b2f5-a72c4cdb3f4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:19.155319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97c65a-5ee4-4eff-b2f5-a72c4cdb3f4f None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:19.177118 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22066a-a135-43e2-a5db-6263b2de7682 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:19.178394 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 202/404] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:23:19 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:23:19.179190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97c65a-5ee4-4eff-b2f5-a72c4cdb3f4f None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:19.226183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb870f-7fec-4a1c-8d61-e945e35f10ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:19.226924 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb870f-7fec-4a1c-8d61-e945e35f10ae None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:19.227238 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb870f-7fec-4a1c-8d61-e945e35f10ae None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:19.227514 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb870f-7fec-4a1c-8d61-e945e35f10ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:19.240105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb870f-7fec-4a1c-8d61-e945e35f10ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:19.241653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb870f-7fec-4a1c-8d61-e945e35f10ae None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:19.258570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-74bb870f-7fec-4a1c-8d61-e945e35f10ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:19.258570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:19.258570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:19.258570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:19.258570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:19.258570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:19.258570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:19.258570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:19.258570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:19.258570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:19.258570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:19.258570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:19.258570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:19.258570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:19.258570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:19.258570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:19.259593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:19.259593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:19.259593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:19.259593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:19.259593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:19.259593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:19.259593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:19.259593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:19.259593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:19.259593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:19.259593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:19.259593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:19.259593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:19.259593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:19.259593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:19.259593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:19.259593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:19.260443 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:19.260443 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:19.260443 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:19.260443 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 203/405] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:19.261374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb870f-7fec-4a1c-8d61-e945e35f10ae None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:19.268652 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:19.305182 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97c65a-5ee4-4eff-b2f5-a72c4cdb3f4f None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:19.341886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f239d12-accf-4e77-9550-4496a268ed7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:19.342540 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f239d12-accf-4e77-9550-4496a268ed7f None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:19.342818 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f239d12-accf-4e77-9550-4496a268ed7f None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:19.343125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f239d12-accf-4e77-9550-4496a268ed7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:19.354842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f239d12-accf-4e77-9550-4496a268ed7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:19.356382 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f239d12-accf-4e77-9550-4496a268ed7f None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:19.372349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-2f239d12-accf-4e77-9550-4496a268ed7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:19.372349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:19.372349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:19.372349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:19.372349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:19.372349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:19.372349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:19.372349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:19.372349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:19.372349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:19.372349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:19.372349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:19.372349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:19.372349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:19.372349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:19.372349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:19.373321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:19.373321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:19.373321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:19.373321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:19.373321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:19.373321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:19.373321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:19.373321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:19.373321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:19.373321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:19.373321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:19.373321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:19.373321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:19.373321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:19.373321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:19.373321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:19.373321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:19.374498 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:19.374498 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:19.374498 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:19.374498 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 203/406] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:19.374763 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f239d12-accf-4e77-9550-4496a268ed7f None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:19.385129 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb870f-7fec-4a1c-8d61-e945e35f10ae None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:19.415085 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:19.430034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeaa1c-40a1-4f55-beef-7af9670048f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:19.430604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeaa1c-40a1-4f55-beef-7af9670048f8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:19.431179 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeaa1c-40a1-4f55-beef-7af9670048f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:19.431457 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edeaa1c-40a1-4f55-beef-7af9670048f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:19.439423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeaa1c-40a1-4f55-beef-7af9670048f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:19.441747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edeaa1c-40a1-4f55-beef-7af9670048f8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:19.454073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-4edeaa1c-40a1-4f55-beef-7af9670048f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:19.454073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:19.454073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:19.454073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:19.454073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:19.454073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:19.454073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:19.454073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:19.454073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:19.454073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:19.454073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:19.454073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:19.454073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:19.454073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:19.454073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:19.455031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:19.455031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:19.455031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:19.455031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:19.455031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:19.455031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:19.455031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:19.455031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:19.455031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:19.455031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:19.455031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:19.455031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:19.455031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:19.455031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:19.455031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:19.455031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:19.455031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:19.456589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:19.456589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:19.456589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:19.456589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:19.456589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:19.456589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:19.456589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:19.456589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:19.456589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 204/407] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:19.456589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeaa1c-40a1-4f55-beef-7af9670048f8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:19.484325 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f239d12-accf-4e77-9550-4496a268ed7f None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:19.510444 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:19.522631 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d0e15-4082-428f-b237-0c6b620d9b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:19.523325 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d0e15-4082-428f-b237-0c6b620d9b6b None admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:19.523603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d0e15-4082-428f-b237-0c6b620d9b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:19.523874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d0e15-4082-428f-b237-0c6b620d9b6b None admin] PATH_INFO: `/v3/projects/c25f337a79704728adaa03f4103eef1c/users/674c5b25932a41309428ba6c6c72ed02/roles/09686a35c48b45b49ee384e08ee11206` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:19.539911 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d0e15-4082-428f-b237-0c6b620d9b6b None admin] RBAC: Authorizing `identity:create_grant(project_id=c25f337a79704728adaa03f4103eef1c, user_id=674c5b25932a41309428ba6c6c72ed02, role_id=09686a35c48b45b49ee384e08ee11206)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:19.541601 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d0e15-4082-428f-b237-0c6b620d9b6b None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:19.555547 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 204/408] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:23:19 2022] PUT /identity/v3/projects/c25f337a79704728adaa03f4103eef1c/users/674c5b25932a41309428ba6c6c72ed02/roles/09686a35c48b45b49ee384e08ee11206 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:23:19.566613 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edeaa1c-40a1-4f55-beef-7af9670048f8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:19.567914 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d0e15-4082-428f-b237-0c6b620d9b6b None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:19.608318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfb21b-0302-472a-a2bc-db423fad8355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:19.608910 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfb21b-0302-472a-a2bc-db423fad8355 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:19.609197 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfb21b-0302-472a-a2bc-db423fad8355 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:19.609473 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfb21b-0302-472a-a2bc-db423fad8355 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:19.610204 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfb21b-0302-472a-a2bc-db423fad8355 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:19.610507 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfb21b-0302-472a-a2bc-db423fad8355 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:19.612967 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfb21b-0302-472a-a2bc-db423fad8355 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:19.631008 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 205/409] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:19.631008 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfb21b-0302-472a-a2bc-db423fad8355 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:19.700121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:19.709747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d0e15-4082-428f-b237-0c6b620d9b6b None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:19.749213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404335d2-979a-41e5-92ef-a9bdde1590d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:19.749842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404335d2-979a-41e5-92ef-a9bdde1590d0 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:19.750497 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404335d2-979a-41e5-92ef-a9bdde1590d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:19.750781 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404335d2-979a-41e5-92ef-a9bdde1590d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:19.751749 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404335d2-979a-41e5-92ef-a9bdde1590d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:19.752574 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404335d2-979a-41e5-92ef-a9bdde1590d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:19.755245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404335d2-979a-41e5-92ef-a9bdde1590d0 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:19.768843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 205/410] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:19.770273 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404335d2-979a-41e5-92ef-a9bdde1590d0 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:19.776251 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfb21b-0302-472a-a2bc-db423fad8355 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:19.815035 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae33704-1f98-4928-a269-3a92136f56c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:19.815569 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae33704-1f98-4928-a269-3a92136f56c4 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:19.815851 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae33704-1f98-4928-a269-3a92136f56c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:19.816128 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae33704-1f98-4928-a269-3a92136f56c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:19.816822 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae33704-1f98-4928-a269-3a92136f56c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:19.817131 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae33704-1f98-4928-a269-3a92136f56c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:19.818559 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae33704-1f98-4928-a269-3a92136f56c4 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:19.832144 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 206/411] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:19.832976 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae33704-1f98-4928-a269-3a92136f56c4 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:19.833553 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:19.929950 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404335d2-979a-41e5-92ef-a9bdde1590d0 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:19.954405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae33704-1f98-4928-a269-3a92136f56c4 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:19.956427 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:19.976522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3636a5a-1435-467e-90cd-0bf34cb81c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:19.977434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3636a5a-1435-467e-90cd-0bf34cb81c52 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:19.977853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3636a5a-1435-467e-90cd-0bf34cb81c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:19.978264 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3636a5a-1435-467e-90cd-0bf34cb81c52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:19.988063 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3636a5a-1435-467e-90cd-0bf34cb81c52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:19.989681 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3636a5a-1435-467e-90cd-0bf34cb81c52 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:19.994098 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e6926-51e6-493a-a3fc-421d761f3769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:19.994735 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e6926-51e6-493a-a3fc-421d761f3769 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:19.995044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e6926-51e6-493a-a3fc-421d761f3769 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:19.995378 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e6926-51e6-493a-a3fc-421d761f3769 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:20.002257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-c3636a5a-1435-467e-90cd-0bf34cb81c52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:20.002257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:20.002257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:20.002257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:20.002257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:20.002257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:20.002257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:20.002257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:20.002257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:20.002257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:20.002257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:20.002257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:20.002257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:20.002257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:20.002257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:20.003260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:20.003260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:20.003260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:20.003260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:20.003260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:20.003260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:20.003260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:20.003260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:20.003260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:20.003260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:20.003260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:20.003260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:20.003260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:20.003260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:20.003260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:20.003260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:20.003260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:20.004252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:20.004252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:20.004252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:20.004252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:20.004252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:20.004252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:20.004252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:20.004252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:20.004635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e6926-51e6-493a-a3fc-421d761f3769 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:20.004635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e6926-51e6-493a-a3fc-421d761f3769 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:20.006028 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 206/412] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:20.006912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3636a5a-1435-467e-90cd-0bf34cb81c52 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:20.017122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-456e6926-51e6-493a-a3fc-421d761f3769 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:20.017122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:20.017122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:20.017122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:20.017122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:20.017122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:20.017122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:20.017122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:20.017122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:20.017122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:20.017122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:20.017122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:20.017122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:20.017122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:20.017122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:20.018703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:20.018703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:20.018703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:20.018703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:20.018703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:20.018703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:20.018703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:20.018703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:20.018703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:20.018703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:20.018703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:20.018703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:20.018703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:20.018703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:20.018703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:20.018703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:20.018703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:20.019579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:20.019579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:20.019579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:20.019579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:20.019579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:20.019579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:20.019579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:20.019579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:20.019579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 207/413] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:20.020048 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e6926-51e6-493a-a3fc-421d761f3769 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:20.111340 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:20.120038 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3636a5a-1435-467e-90cd-0bf34cb81c52 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:20.133903 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e6926-51e6-493a-a3fc-421d761f3769 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:20.159261 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1110a9-23ca-46d6-b155-6d426ae907e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:20.160181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1110a9-23ca-46d6-b155-6d426ae907e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:20.160617 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1110a9-23ca-46d6-b155-6d426ae907e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:20.161032 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1110a9-23ca-46d6-b155-6d426ae907e1 None admin] PATH_INFO: `/v3/projects/c25f337a79704728adaa03f4103eef1c/users/7d026ec6ed344404a5ebe4352792cc1a/roles/09686a35c48b45b49ee384e08ee11206` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:20.171789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadf86e-7390-4d36-af1f-1e8db99652b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:20.172404 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadf86e-7390-4d36-af1f-1e8db99652b9 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:20.172685 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadf86e-7390-4d36-af1f-1e8db99652b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:20.172960 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadf86e-7390-4d36-af1f-1e8db99652b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:20.173651 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadf86e-7390-4d36-af1f-1e8db99652b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:20.174001 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadf86e-7390-4d36-af1f-1e8db99652b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:20.175537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadf86e-7390-4d36-af1f-1e8db99652b9 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:20.177758 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1110a9-23ca-46d6-b155-6d426ae907e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c25f337a79704728adaa03f4103eef1c, user_id=7d026ec6ed344404a5ebe4352792cc1a, role_id=09686a35c48b45b49ee384e08ee11206)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:20.179373 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1110a9-23ca-46d6-b155-6d426ae907e1 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:20.189419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 208/414] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:20.191207 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadf86e-7390-4d36-af1f-1e8db99652b9 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:20.197634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 207/415] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:23:20 2022] PUT /identity/v3/projects/c25f337a79704728adaa03f4103eef1c/users/7d026ec6ed344404a5ebe4352792cc1a/roles/09686a35c48b45b49ee384e08ee11206 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:23:20.198785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1110a9-23ca-46d6-b155-6d426ae907e1 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:20.219420 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:20.310418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadf86e-7390-4d36-af1f-1e8db99652b9 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:20.315231 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1110a9-23ca-46d6-b155-6d426ae907e1 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:20.350813 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b562018-15a0-4d38-9571-65a44db805f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:20.351593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b562018-15a0-4d38-9571-65a44db805f3 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:20.351874 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b562018-15a0-4d38-9571-65a44db805f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:20.352154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b562018-15a0-4d38-9571-65a44db805f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:20.353131 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b562018-15a0-4d38-9571-65a44db805f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:20.353448 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b562018-15a0-4d38-9571-65a44db805f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:20.354352 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185a150-2f85-4ee6-8a54-ff37ecbc1e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:20.354929 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b562018-15a0-4d38-9571-65a44db805f3 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:20.355400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185a150-2f85-4ee6-8a54-ff37ecbc1e58 None admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:20.355820 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185a150-2f85-4ee6-8a54-ff37ecbc1e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:20.356228 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185a150-2f85-4ee6-8a54-ff37ecbc1e58 None admin] PATH_INFO: `/v3/projects/c25f337a79704728adaa03f4103eef1c/users/5852ff82962e4cea85b8aa8593f09d37/roles/09686a35c48b45b49ee384e08ee11206` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:20.368789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 209/416] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:20.372850 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185a150-2f85-4ee6-8a54-ff37ecbc1e58 None admin] RBAC: Authorizing `identity:create_grant(project_id=c25f337a79704728adaa03f4103eef1c, user_id=5852ff82962e4cea85b8aa8593f09d37, role_id=09686a35c48b45b49ee384e08ee11206)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:20.374464 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b562018-15a0-4d38-9571-65a44db805f3 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:20.374627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185a150-2f85-4ee6-8a54-ff37ecbc1e58 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:20.377922 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:20.402922 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 208/417] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:23:20 2022] PUT /identity/v3/projects/c25f337a79704728adaa03f4103eef1c/users/5852ff82962e4cea85b8aa8593f09d37/roles/09686a35c48b45b49ee384e08ee11206 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:23:20.482559 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:20.511734 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b562018-15a0-4d38-9571-65a44db805f3 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:20.572778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729365a-a0a0-407b-b7e2-ce21b3ea48c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:20.573476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729365a-a0a0-407b-b7e2-ce21b3ea48c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:20.573755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729365a-a0a0-407b-b7e2-ce21b3ea48c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:20.574027 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729365a-a0a0-407b-b7e2-ce21b3ea48c9 None admin] PATH_INFO: `/v3/projects/c25f337a79704728adaa03f4103eef1c/users/8a7a1006ff4b43c3be2cc011359abdd2/roles/09686a35c48b45b49ee384e08ee11206` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:20.594894 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729365a-a0a0-407b-b7e2-ce21b3ea48c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c25f337a79704728adaa03f4103eef1c, user_id=8a7a1006ff4b43c3be2cc011359abdd2, role_id=09686a35c48b45b49ee384e08ee11206)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:20.597433 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729365a-a0a0-407b-b7e2-ce21b3ea48c9 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:20.622850 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 210/418] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:23:20 2022] PUT /identity/v3/projects/c25f337a79704728adaa03f4103eef1c/users/8a7a1006ff4b43c3be2cc011359abdd2/roles/09686a35c48b45b49ee384e08ee11206 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:23:21.827576 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7594856-ba7a-4195-b615-ee1594fe6fdd None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:21.828126 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7594856-ba7a-4195-b615-ee1594fe6fdd None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:21.828126 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7594856-ba7a-4195-b615-ee1594fe6fdd None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:21.829443 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 209/419] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:21.834983 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c693-e1c3-4e9b-ad42-491bbbe008b7 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:21.835371 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c693-e1c3-4e9b-ad42-491bbbe008b7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:21.835538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c693-e1c3-4e9b-ad42-491bbbe008b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:21.860350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-e938c693-e1c3-4e9b-ad42-491bbbe008b7 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:21.861825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e938c693-e1c3-4e9b-ad42-491bbbe008b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:21.972045 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 211/420] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:22.039900 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bd7ee-2e1f-4d28-952f-6e4a84b1f91c None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:22.040221 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bd7ee-2e1f-4d28-952f-6e4a84b1f91c None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:22.040706 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bd7ee-2e1f-4d28-952f-6e4a84b1f91c None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:22.042293 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 210/421] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:22.047591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18cc41-af1a-4e06-a26a-226f53ac99af None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:22.047876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18cc41-af1a-4e06-a26a-226f53ac99af None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:22.048148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18cc41-af1a-4e06-a26a-226f53ac99af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:22.072096 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-8c18cc41-af1a-4e06-a26a-226f53ac99af None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:22.073269 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8c18cc41-af1a-4e06-a26a-226f53ac99af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:22.138342 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:22.149784 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 212/422] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:22.300196 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bd7ee-2e1f-4d28-952f-6e4a84b1f91c None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:22.413113 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bd7ee-2e1f-4d28-952f-6e4a84b1f91c None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:22.449536 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09295e-2917-4231-bd98-665183a4064a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:22.450338 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09295e-2917-4231-bd98-665183a4064a None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:22.450620 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09295e-2917-4231-bd98-665183a4064a None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:22.450887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09295e-2917-4231-bd98-665183a4064a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:22.461615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09295e-2917-4231-bd98-665183a4064a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:22.466396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-af09295e-2917-4231-bd98-665183a4064a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:22.466396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:22.466396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:22.466396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:22.466396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:22.466396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:22.466396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:22.466396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:22.466396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:22.466396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:22.466396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:22.466396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:22.466396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:22.466396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:22.466396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:22.466396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:22.467283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:22.467283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:22.467283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:22.467283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:22.467283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:22.467283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:22.467283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:22.467283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:22.467283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:22.467283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:22.467283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:22.467283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:22.467283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:22.467283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:22.467283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:22.467283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:22.468287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:22.468287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:22.468287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:22.468287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:22.468287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:22.468287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:22.468287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:22.468287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:22.468287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:22.468287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:22.468287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:22.468287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:22.468287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 211/423] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Oct 20 13:23:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:22.475740 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18cc41-af1a-4e06-a26a-226f53ac99af None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:22.562657 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09295e-2917-4231-bd98-665183a4064a None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:22.639219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18cc41-af1a-4e06-a26a-226f53ac99af None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:22.653600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:22.694548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88a107-f4c2-439d-8df7-a7408f66674a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:22.695119 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88a107-f4c2-439d-8df7-a7408f66674a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:22.695398 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88a107-f4c2-439d-8df7-a7408f66674a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:22.695673 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88a107-f4c2-439d-8df7-a7408f66674a None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:22.696335 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88a107-f4c2-439d-8df7-a7408f66674a None admin] RBAC: Adding query filter params (name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:22.696641 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88a107-f4c2-439d-8df7-a7408f66674a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:22.698006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88a107-f4c2-439d-8df7-a7408f66674a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:22.718362 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 213/424] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Oct 20 13:23:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:22.722355 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88a107-f4c2-439d-8df7-a7408f66674a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:22.729013 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09295e-2917-4231-bd98-665183a4064a None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:22.804182 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9975c4b-1899-4514-81a2-99afeab20dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:22.804823 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9975c4b-1899-4514-81a2-99afeab20dfe None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:22.805103 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9975c4b-1899-4514-81a2-99afeab20dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:22.805374 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9975c4b-1899-4514-81a2-99afeab20dfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:22.817245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9975c4b-1899-4514-81a2-99afeab20dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:22.822640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-c9975c4b-1899-4514-81a2-99afeab20dfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:22.822640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:22.822640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:22.822640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:22.822640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:22.822640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:22.822640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:22.822640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:22.822640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:22.822640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:22.822640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:22.822640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:22.822640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:22.822640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:22.822640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:22.822640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:22.823544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:22.823544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:22.823544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:22.823544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:22.823544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:22.823544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:22.823544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:22.823544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:22.823544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:22.823544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:22.823544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:22.823544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:22.823544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:22.823544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:22.823544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:22.823544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:22.824583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:22.824583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:22.824583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:22.824583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:22.824583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:22.824583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:22.824583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:22.824583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:22.824583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:22.824583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:22.824583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:22.824583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:22.824583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 212/425] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Oct 20 13:23:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:23:22.839387 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:22.840028 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9975c4b-1899-4514-81a2-99afeab20dfe None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:22.894119 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88a107-f4c2-439d-8df7-a7408f66674a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:22.930331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c0a53-03bb-451b-b95f-1af5d23e0212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:22.930984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c0a53-03bb-451b-b95f-1af5d23e0212 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:22.931435 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c0a53-03bb-451b-b95f-1af5d23e0212 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:22.931857 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c0a53-03bb-451b-b95f-1af5d23e0212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:22.943302 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c0a53-03bb-451b-b95f-1af5d23e0212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:22.945045 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c0a53-03bb-451b-b95f-1af5d23e0212 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:22.960922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-1c0c0a53-03bb-451b-b95f-1af5d23e0212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:22.960922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:22.960922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:22.960922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:22.960922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:22.960922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:22.960922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:22.960922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:22.960922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:22.960922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:22.960922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:22.960922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:22.960922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:22.960922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:22.960922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:22.960922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:22.961869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:22.961869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:22.961869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:22.961869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:22.961869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:22.961869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:22.961869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:22.961869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:22.961869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:22.961869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:22.961869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:22.961869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:22.961869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:22.961869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:22.961869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:22.961869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:22.961869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:22.962692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:22.962692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:22.962692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:22.969154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 214/426] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:23:22.970638 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b02265-2f66-4e22-9ba4-a3974be1989d None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:22.971388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b02265-2f66-4e22-9ba4-a3974be1989d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:22.971850 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b02265-2f66-4e22-9ba4-a3974be1989d None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:22.973562 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 215/427] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:22.974438 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b02265-2f66-4e22-9ba4-a3974be1989d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:22.974988 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9975c4b-1899-4514-81a2-99afeab20dfe None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:22.990959 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:23.013592 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189c990-6f82-4d26-9723-2ab38c5ab07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:23.014201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189c990-6f82-4d26-9723-2ab38c5ab07e None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:23.014485 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189c990-6f82-4d26-9723-2ab38c5ab07e None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:23.014757 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189c990-6f82-4d26-9723-2ab38c5ab07e None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:23.015442 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189c990-6f82-4d26-9723-2ab38c5ab07e None admin] RBAC: Adding query filter params (name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:23.015982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189c990-6f82-4d26-9723-2ab38c5ab07e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:23.018071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189c990-6f82-4d26-9723-2ab38c5ab07e None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:23.027586 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 213/428] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Oct 20 13:23:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:23.029106 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646f06a-876d-44a2-a601-89ef294efedf None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:23.029592 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646f06a-876d-44a2-a601-89ef294efedf None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:23.030062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646f06a-876d-44a2-a601-89ef294efedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:23.049722 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-5646f06a-876d-44a2-a601-89ef294efedf None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:23.051265 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-5646f06a-876d-44a2-a601-89ef294efedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:23.087593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b02265-2f66-4e22-9ba4-a3974be1989d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:23.095090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:23.124246 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 214/429] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:23.125227 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646f06a-876d-44a2-a601-89ef294efedf None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:23.126455 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18a60c-5791-4906-95b8-f7cc8b0cc02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:23.127372 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18a60c-5791-4906-95b8-f7cc8b0cc02c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:23.127807 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18a60c-5791-4906-95b8-f7cc8b0cc02c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:23.128223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18a60c-5791-4906-95b8-f7cc8b0cc02c None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:23.129006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18a60c-5791-4906-95b8-f7cc8b0cc02c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:23.129451 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18a60c-5791-4906-95b8-f7cc8b0cc02c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:23.131063 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18a60c-5791-4906-95b8-f7cc8b0cc02c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:23.144142 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 216/430] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:23.149879 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18a60c-5791-4906-95b8-f7cc8b0cc02c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:23.236548 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646f06a-876d-44a2-a601-89ef294efedf None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:23.253642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:23.261000 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18a60c-5791-4906-95b8-f7cc8b0cc02c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:23.302317 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7a422-a35b-4175-9daa-bb34fe5a7a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:23.303461 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7a422-a35b-4175-9daa-bb34fe5a7a82 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:23.303945 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7a422-a35b-4175-9daa-bb34fe5a7a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:23.304485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7a422-a35b-4175-9daa-bb34fe5a7a82 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:23.314166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7a422-a35b-4175-9daa-bb34fe5a7a82 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:23.315315 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc98a0-0619-4bc8-9cdf-87dfd28424fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:23.316148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc98a0-0619-4bc8-9cdf-87dfd28424fb None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:23.316570 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc98a0-0619-4bc8-9cdf-87dfd28424fb None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:23.316980 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc98a0-0619-4bc8-9cdf-87dfd28424fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:23.317088 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7a422-a35b-4175-9daa-bb34fe5a7a82 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:23.328896 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc98a0-0619-4bc8-9cdf-87dfd28424fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:23.329835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-3ef7a422-a35b-4175-9daa-bb34fe5a7a82 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 20 13:23:23.329835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:23.329835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:23.329835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:23.329835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:23.329835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:23.329835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:23.329835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:23.329835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:23.329835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:23.329835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:23.329835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:23.329835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:23.329835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:23.329835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:23.329835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:23.330802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:23.331789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:23.331789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:23.331789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:23.331789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:23.331789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:23.331789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:23.331789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:23.331789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:23.331789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 20 13:23:23.331789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:23.332283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc98a0-0619-4bc8-9cdf-87dfd28424fb None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:23.334410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 217/431] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:23:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:23.340184 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554dae6-5dd9-4a06-872d-d6118db556bd None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:23.340905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554dae6-5dd9-4a06-872d-d6118db556bd None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:23.341402 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554dae6-5dd9-4a06-872d-d6118db556bd None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:23.342887 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 218/432] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:23.343810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554dae6-5dd9-4a06-872d-d6118db556bd None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:23.350712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-8ecc98a0-0619-4bc8-9cdf-87dfd28424fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:23.350712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:23.350712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:23.350712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:23.350712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:23.350712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:23.350712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:23.350712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:23.350712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:23.350712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:23.350712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:23.350712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:23.350712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:23.350712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:23.350712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:23.350712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:23.351843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:23.351843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:23.351843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:23.351843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:23.351843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:23.351843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:23.351843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:23.351843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:23.351843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:23.351843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:23.351843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:23.351843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:23.351843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:23.351843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:23.351843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:23.351843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:23.351843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:23.352925 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:23.352925 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:23.352925 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:23.354568 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 215/433] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:23.356023 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385d93f-d62c-4492-b688-2c55cffa2790 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:23.356472 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385d93f-d62c-4492-b688-2c55cffa2790 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:23.356897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385d93f-d62c-4492-b688-2c55cffa2790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:23.376605 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-0385d93f-d62c-4492-b688-2c55cffa2790 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:23.378741 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0385d93f-d62c-4492-b688-2c55cffa2790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:23.381000 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:23.451609 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 216/434] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:23.452700 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385d93f-d62c-4492-b688-2c55cffa2790 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:23.469214 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554dae6-5dd9-4a06-872d-d6118db556bd None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:23.508091 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40131cdd-02c3-426e-97b8-01911ed80732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:23.509231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40131cdd-02c3-426e-97b8-01911ed80732 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:23.509779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40131cdd-02c3-426e-97b8-01911ed80732 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:23.510295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40131cdd-02c3-426e-97b8-01911ed80732 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:23.511296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40131cdd-02c3-426e-97b8-01911ed80732 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:23.511796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40131cdd-02c3-426e-97b8-01911ed80732 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:23.513407 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40131cdd-02c3-426e-97b8-01911ed80732 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:23.532215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 219/435] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Oct 20 13:23:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:23.534166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988034f-55e5-4633-8f80-55cd2e2ac37f None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:23.534451 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988034f-55e5-4633-8f80-55cd2e2ac37f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:23.534727 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988034f-55e5-4633-8f80-55cd2e2ac37f None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:23.539916 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 220/436] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:23.539916 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988034f-55e5-4633-8f80-55cd2e2ac37f None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:23.559072 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:23.572381 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385d93f-d62c-4492-b688-2c55cffa2790 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:23.608268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282d411-7fa8-415c-a135-76b358b0fbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:23.608982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282d411-7fa8-415c-a135-76b358b0fbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:23.609155 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282d411-7fa8-415c-a135-76b358b0fbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:23.609429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282d411-7fa8-415c-a135-76b358b0fbc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:23.610064 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282d411-7fa8-415c-a135-76b358b0fbc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:23.610807 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282d411-7fa8-415c-a135-76b358b0fbc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:23.612708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9282d411-7fa8-415c-a135-76b358b0fbc2 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:23.628479 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 217/437] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:23.628479 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282d411-7fa8-415c-a135-76b358b0fbc2 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:23.634577 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:23.654815 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988034f-55e5-4633-8f80-55cd2e2ac37f None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:23.694969 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551b401-b30f-4333-9b33-61713e4cae88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:23.695978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551b401-b30f-4333-9b33-61713e4cae88 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:23.696257 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551b401-b30f-4333-9b33-61713e4cae88 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:23.696533 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551b401-b30f-4333-9b33-61713e4cae88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:23.708191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551b401-b30f-4333-9b33-61713e4cae88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:23.713456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-2551b401-b30f-4333-9b33-61713e4cae88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:23.713456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:23.713456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:23.713456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:23.713456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:23.713456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:23.713456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:23.713456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:23.713456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:23.713456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:23.713456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:23.713456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:23.713456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:23.713456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:23.713456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:23.713456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:23.714326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:23.714326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:23.714326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:23.714326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:23.714326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:23.714326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:23.714326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:23.714326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:23.714326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:23.714326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:23.714326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:23.714326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:23.714326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:23.714326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:23.714326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:23.714326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:23.715490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:23.715490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:23.715490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:23.715490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:23.715490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:23.715490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:23.715490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:23.715490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:23.715490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:23.715490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:23.715490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:23.715490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:23.715490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 221/438] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Oct 20 13:23:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:23.716153 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412528a-d8fa-447e-b456-6f45aa34652b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:23.716153 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412528a-d8fa-447e-b456-6f45aa34652b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:23.716482 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412528a-d8fa-447e-b456-6f45aa34652b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:23.732930 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9282d411-7fa8-415c-a135-76b358b0fbc2 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:23.734649 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-a412528a-d8fa-447e-b456-6f45aa34652b None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:23.735881 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a412528a-d8fa-447e-b456-6f45aa34652b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:23.768129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8001c2-73f0-4d6c-b056-e4ba4d715f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:23.768754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8001c2-73f0-4d6c-b056-e4ba4d715f10 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:23.769035 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8001c2-73f0-4d6c-b056-e4ba4d715f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:23.769306 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8001c2-73f0-4d6c-b056-e4ba4d715f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:23.779399 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8001c2-73f0-4d6c-b056-e4ba4d715f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:23.780845 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8001c2-73f0-4d6c-b056-e4ba4d715f10 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:23.789047 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:23.796180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-6e8001c2-73f0-4d6c-b056-e4ba4d715f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:23.796180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:23.796180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:23.796180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:23.796180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:23.796180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:23.796180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:23.796180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:23.796180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:23.796180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:23.796180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:23.796180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:23.796180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:23.796180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:23.796180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:23.796180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:23.797071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:23.797071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:23.797071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:23.797071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:23.797071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:23.797071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:23.797071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:23.797071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:23.797071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:23.797071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:23.797071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:23.797071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:23.797071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:23.797071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:23.797071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:23.797071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:23.797071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:23.797882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:23.797882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:23.797882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:23.799524 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 218/439] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:23.800256 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8001c2-73f0-4d6c-b056-e4ba4d715f10 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:23.805141 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 222/440] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:23.805972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412528a-d8fa-447e-b456-6f45aa34652b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:23.890559 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:23.913286 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8001c2-73f0-4d6c-b056-e4ba4d715f10 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:23.919251 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412528a-d8fa-447e-b456-6f45aa34652b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:23.948410 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49014778-b766-4b3b-9555-fe94a779354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:23.949034 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49014778-b766-4b3b-9555-fe94a779354f None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:23.949311 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49014778-b766-4b3b-9555-fe94a779354f None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:23.949585 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49014778-b766-4b3b-9555-fe94a779354f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:23.957181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49014778-b766-4b3b-9555-fe94a779354f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:23.957832 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f9a58-c1a4-48b7-a47f-08204bfa5d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:23.958610 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49014778-b766-4b3b-9555-fe94a779354f None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:23.958818 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f9a58-c1a4-48b7-a47f-08204bfa5d4d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:23.959313 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f9a58-c1a4-48b7-a47f-08204bfa5d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:23.959584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f9a58-c1a4-48b7-a47f-08204bfa5d4d None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:23.960240 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f9a58-c1a4-48b7-a47f-08204bfa5d4d None admin] RBAC: Adding query filter params (name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:23.960534 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f9a58-c1a4-48b7-a47f-08204bfa5d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:23.961859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f9a58-c1a4-48b7-a47f-08204bfa5d4d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:23.972129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-49014778-b766-4b3b-9555-fe94a779354f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 13:23:23.972129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:23.972129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:23.972129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:23.972129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:23.972129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:23.972129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:23.972129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:23.972129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:23.972129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:23.972129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:23.972129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:23.972129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:23.972129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:23.972129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:23.972129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:23.973099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:23.974007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:23.974007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:23.974007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:23.974007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:23.974007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:23.974007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:23.974007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:23.974007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:23.974007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 13:23:23.974007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:23.975109 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 223/441] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Oct 20 13:23:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:23.975622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 219/442] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Oct 20 13:23:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:23.975887 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f9a58-c1a4-48b7-a47f-08204bfa5d4d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:23.976993 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49014778-b766-4b3b-9555-fe94a779354f None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:24.039667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:24.082433 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f9a58-c1a4-48b7-a47f-08204bfa5d4d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:24.083707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49014778-b766-4b3b-9555-fe94a779354f None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:24.116583 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e0fba-0829-4989-87ec-c84feef3c03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:24.117206 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e0fba-0829-4989-87ec-c84feef3c03e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:24.117488 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e0fba-0829-4989-87ec-c84feef3c03e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:24.117763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e0fba-0829-4989-87ec-c84feef3c03e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:24.118865 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22f1ae-b0d7-4b9e-8163-17e13e19c171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:24.119494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f1ae-b0d7-4b9e-8163-17e13e19c171 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:24.119771 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f1ae-b0d7-4b9e-8163-17e13e19c171 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:24.120043 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22f1ae-b0d7-4b9e-8163-17e13e19c171 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:24.120436 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:24.120682 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22f1ae-b0d7-4b9e-8163-17e13e19c171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:24.120987 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22f1ae-b0d7-4b9e-8163-17e13e19c171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:24.122372 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22f1ae-b0d7-4b9e-8163-17e13e19c171 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:24.129000 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e0fba-0829-4989-87ec-c84feef3c03e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:24.134223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 220/443] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:24.134345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f86e0fba-0829-4989-87ec-c84feef3c03e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:24.134345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:24.134345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:24.134345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:24.134345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:24.134345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:24.134345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:24.134345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:24.134345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:24.134345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:24.134345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:24.134345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:24.134345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:24.134345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:24.134345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:24.134345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:24.135314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:24.135314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:24.135314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:24.135314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:24.135314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:24.135314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:24.135314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:24.135314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:24.135314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:24.135314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:24.135314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:24.135314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:24.135314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:24.135314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:24.135314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:24.135314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:24.136107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:24.136107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:24.136107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:24.136107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:24.136107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:24.136107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:24.136107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:24.136107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:24.136107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:24.136107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:24.136107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:24.136107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:24.136689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22f1ae-b0d7-4b9e-8163-17e13e19c171 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:24.136755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 224/444] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Oct 20 13:23:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:24.136755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e0fba-0829-4989-87ec-c84feef3c03e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:24.234552 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e0fba-0829-4989-87ec-c84feef3c03e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:24.239223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22f1ae-b0d7-4b9e-8163-17e13e19c171 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:24.258996 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:24.268215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c1cbd-e95a-4267-a12a-2797cb715e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:24.268822 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c1cbd-e95a-4267-a12a-2797cb715e0a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:24.269099 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c1cbd-e95a-4267-a12a-2797cb715e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:24.269369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c1cbd-e95a-4267-a12a-2797cb715e0a None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:24.270087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c1cbd-e95a-4267-a12a-2797cb715e0a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:24.270400 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c1cbd-e95a-4267-a12a-2797cb715e0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:24.271847 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c1cbd-e95a-4267-a12a-2797cb715e0a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:24.273654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd9692-b1ef-4b38-8e24-16fcfb8ded9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:24.274290 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9692-b1ef-4b38-8e24-16fcfb8ded9d None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:24.274571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9692-b1ef-4b38-8e24-16fcfb8ded9d None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:24.274846 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9692-b1ef-4b38-8e24-16fcfb8ded9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:24.285594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd9692-b1ef-4b38-8e24-16fcfb8ded9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:24.287075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd9692-b1ef-4b38-8e24-16fcfb8ded9d None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:24.289302 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 225/445] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Oct 20 13:23:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:24.290152 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c1cbd-e95a-4267-a12a-2797cb715e0a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:24.308565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-6afd9692-b1ef-4b38-8e24-16fcfb8ded9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:24.308565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:24.308565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:24.308565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:24.308565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:24.308565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:24.308565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:24.308565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:24.308565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:24.308565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:24.308565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:24.308565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:24.308565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:24.308565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:24.308565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:24.308565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:24.309689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:24.309689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:24.309689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:24.309689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:24.309689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:24.309689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:24.309689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:24.309689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:24.309689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:24.309689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:24.309689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:24.309689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:24.309689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:24.309689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:24.309689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:24.309689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:24.309689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:24.310508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:24.310508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:24.310508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:24.310508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 221/446] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:24.310508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd9692-b1ef-4b38-8e24-16fcfb8ded9d None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:24.349298 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:24.393568 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c1cbd-e95a-4267-a12a-2797cb715e0a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:24.412180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd9692-b1ef-4b38-8e24-16fcfb8ded9d None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:24.426875 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f406cf-ee06-4c28-95e6-896102a1ac94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:24.427527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f406cf-ee06-4c28-95e6-896102a1ac94 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:24.427802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f406cf-ee06-4c28-95e6-896102a1ac94 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:24.428071 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f406cf-ee06-4c28-95e6-896102a1ac94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:24.437758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f406cf-ee06-4c28-95e6-896102a1ac94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:24.442693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f5f406cf-ee06-4c28-95e6-896102a1ac94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:24.442693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:24.442693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:24.442693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:24.442693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:24.442693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:24.442693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:24.442693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:24.442693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:24.442693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:24.442693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:24.442693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:24.442693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:24.442693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:24.442693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:24.442693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:24.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:24.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:24.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:24.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:24.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:24.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:24.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:24.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:24.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:24.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:24.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:24.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:24.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:24.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:24.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:24.443600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:24.444389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:24.444389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:24.444389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:24.444389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:24.444389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:24.444389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:24.444389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:24.444389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:24.444389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:24.444389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:24.444389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:24.444389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:24.444389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 226/447] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Oct 20 13:23:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:24.445056 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f406cf-ee06-4c28-95e6-896102a1ac94 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:24.448686 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2ce90-2329-43bd-8c55-243287e962e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:24.449145 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2ce90-2329-43bd-8c55-243287e962e8 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:24.449427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2ce90-2329-43bd-8c55-243287e962e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:24.449693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2ce90-2329-43bd-8c55-243287e962e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:24.457303 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2ce90-2329-43bd-8c55-243287e962e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:24.458754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba2ce90-2329-43bd-8c55-243287e962e8 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:24.469800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-8ba2ce90-2329-43bd-8c55-243287e962e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:24.469800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:24.469800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:24.469800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:24.469800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:24.469800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:24.469800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:24.469800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:24.469800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:24.469800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:24.469800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:24.469800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:24.469800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:24.469800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:24.469800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:24.471432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:24.471432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:24.471432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:24.471432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:24.471432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:24.471432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:24.471432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:24.471432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:24.471432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:24.471432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:24.471432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:24.471432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:24.471432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:24.471432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:24.471432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:24.471432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:24.471432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:24.472906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:24.472906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:24.472906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:24.472906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:24.472906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:24.472906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:24.472906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:24.472906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:24.472906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 222/448] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:24.472906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2ce90-2329-43bd-8c55-243287e962e8 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:24.502678 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:24.549577 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f406cf-ee06-4c28-95e6-896102a1ac94 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:24.563529 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:24.573119 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2ce90-2329-43bd-8c55-243287e962e8 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:24.586671 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49503b51-5dc2-4cf9-894a-edd378d55d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:24.587295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49503b51-5dc2-4cf9-894a-edd378d55d24 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:24.587572 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49503b51-5dc2-4cf9-894a-edd378d55d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:24.587836 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49503b51-5dc2-4cf9-894a-edd378d55d24 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:24.588482 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49503b51-5dc2-4cf9-894a-edd378d55d24 None admin] RBAC: Adding query filter params (name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:24.588778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49503b51-5dc2-4cf9-894a-edd378d55d24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:24.590138 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49503b51-5dc2-4cf9-894a-edd378d55d24 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:24.602271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 227/449] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Oct 20 13:23:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:24.604356 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49503b51-5dc2-4cf9-894a-edd378d55d24 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:24.610662 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979fd1-4b51-417d-bc5d-8aa32bb4d311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:24.611848 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979fd1-4b51-417d-bc5d-8aa32bb4d311 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:24.612131 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979fd1-4b51-417d-bc5d-8aa32bb4d311 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:24.612447 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d979fd1-4b51-417d-bc5d-8aa32bb4d311 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:24.679385 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d979fd1-4b51-417d-bc5d-8aa32bb4d311 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:24.680852 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d979fd1-4b51-417d-bc5d-8aa32bb4d311 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:24.704730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49503b51-5dc2-4cf9-894a-edd378d55d24 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:24.709008 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:24.739681 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952b285-288c-4d77-9b18-cacf44397f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:24.740278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952b285-288c-4d77-9b18-cacf44397f64 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:24.740562 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952b285-288c-4d77-9b18-cacf44397f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:24.740834 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952b285-288c-4d77-9b18-cacf44397f64 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:24.741468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952b285-288c-4d77-9b18-cacf44397f64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:24.741770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952b285-288c-4d77-9b18-cacf44397f64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:24.743151 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952b285-288c-4d77-9b18-cacf44397f64 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:24.754779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 228/450] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:24.755611 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952b285-288c-4d77-9b18-cacf44397f64 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:24.779126 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 223/451] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:23:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 13:23:24.779969 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979fd1-4b51-417d-bc5d-8aa32bb4d311 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:24.794241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:24.859679 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952b285-288c-4d77-9b18-cacf44397f64 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:24.875907 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d979fd1-4b51-417d-bc5d-8aa32bb4d311 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:24.894618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e55015-ba1e-47bd-a43a-ae8b3fa38f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:24.895253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e55015-ba1e-47bd-a43a-ae8b3fa38f6d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:24.895537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e55015-ba1e-47bd-a43a-ae8b3fa38f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:24.895811 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e55015-ba1e-47bd-a43a-ae8b3fa38f6d None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:24.896467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e55015-ba1e-47bd-a43a-ae8b3fa38f6d None admin] RBAC: Adding query filter params (name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:24.896769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e55015-ba1e-47bd-a43a-ae8b3fa38f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:24.898126 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e55015-ba1e-47bd-a43a-ae8b3fa38f6d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:24.906013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 229/452] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Oct 20 13:23:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:24.906468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:24.907045 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e55015-ba1e-47bd-a43a-ae8b3fa38f6d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:24.915826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5085ad-9ed7-4b13-8999-2777a6e2f4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:24.916950 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5085ad-9ed7-4b13-8999-2777a6e2f4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:24.917236 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5085ad-9ed7-4b13-8999-2777a6e2f4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:24.917518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5085ad-9ed7-4b13-8999-2777a6e2f4c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:24.918215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5085ad-9ed7-4b13-8999-2777a6e2f4c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:24.918535 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5085ad-9ed7-4b13-8999-2777a6e2f4c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:24.920001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5085ad-9ed7-4b13-8999-2777a6e2f4c2 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:24.937219 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 224/453] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:24.938016 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5085ad-9ed7-4b13-8999-2777a6e2f4c2 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:25.006429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:25.011349 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e55015-ba1e-47bd-a43a-ae8b3fa38f6d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:25.037619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5085ad-9ed7-4b13-8999-2777a6e2f4c2 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:25.045599 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d125d-993f-4321-9a49-111ce65c6741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:25.046226 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d125d-993f-4321-9a49-111ce65c6741 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:25.046508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d125d-993f-4321-9a49-111ce65c6741 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:25.046781 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d125d-993f-4321-9a49-111ce65c6741 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:25.057768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d125d-993f-4321-9a49-111ce65c6741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:25.059245 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d125d-993f-4321-9a49-111ce65c6741 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:25.071455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6aed2-b52a-40c6-abd1-5aa1676b79fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:25.072168 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6aed2-b52a-40c6-abd1-5aa1676b79fb None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:25.072526 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6aed2-b52a-40c6-abd1-5aa1676b79fb None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:25.072875 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6aed2-b52a-40c6-abd1-5aa1676b79fb None admin] PATH_INFO: `/v3/users/glance` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:25.073491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-964d125d-993f-4321-9a49-111ce65c6741 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:25.073491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:25.073491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:25.073491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:25.073491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:25.073491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:25.073491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:25.073491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:25.073491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:25.073491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:25.073491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:25.073491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:25.073491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:25.073491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:25.073491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:25.073491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:25.074369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:25.074369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:25.074369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:25.074369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:25.074369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:25.074369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:25.074369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:25.074369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:25.074369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:25.074369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:25.074369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:25.074369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:25.074369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:25.074369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:25.074369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:25.074369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:25.074369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:25.075223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:25.075223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:25.075223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:25.075223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 230/454] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:25.075463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d125d-993f-4321-9a49-111ce65c6741 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:25.081690 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6aed2-b52a-40c6-abd1-5aa1676b79fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:25.083173 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6aed2-b52a-40c6-abd1-5aa1676b79fb None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:25.094305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-4ba6aed2-b52a-40c6-abd1-5aa1676b79fb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 20 13:23:25.094305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:25.094305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:25.094305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:25.094305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:25.094305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:25.094305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:25.094305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:25.094305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:25.094305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:25.094305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:25.094305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:25.094305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:25.094305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:25.094305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:25.094305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:25.095349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:25.096271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:25.096271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:25.096271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:25.096271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:25.096271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:25.096271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:25.096271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:25.096271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:25.096271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 20 13:23:25.096271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:25.096271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 225/455] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:23:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:25.096813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6aed2-b52a-40c6-abd1-5aa1676b79fb None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:25.147704 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:25.183369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d125d-993f-4321-9a49-111ce65c6741 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:25.195186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6aed2-b52a-40c6-abd1-5aa1676b79fb None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:25.215763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300f2b2-2b3b-4714-9c4d-f7b6f52c9a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:25.216382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300f2b2-2b3b-4714-9c4d-f7b6f52c9a1f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:25.216658 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300f2b2-2b3b-4714-9c4d-f7b6f52c9a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:25.216926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300f2b2-2b3b-4714-9c4d-f7b6f52c9a1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:25.227242 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300f2b2-2b3b-4714-9c4d-f7b6f52c9a1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:25.228544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee562da2-205b-4011-8781-9e22e921a11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:25.228679 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300f2b2-2b3b-4714-9c4d-f7b6f52c9a1f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:25.229162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562da2-205b-4011-8781-9e22e921a11f None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:25.229439 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562da2-205b-4011-8781-9e22e921a11f None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:25.229710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562da2-205b-4011-8781-9e22e921a11f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:25.240521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee562da2-205b-4011-8781-9e22e921a11f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:25.241937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee562da2-205b-4011-8781-9e22e921a11f None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:25.243036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-1300f2b2-2b3b-4714-9c4d-f7b6f52c9a1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:25.243036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:25.243036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:25.243036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:25.243036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:25.243036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:25.243036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:25.243036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:25.243036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:25.243036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:25.243036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:25.243036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:25.243036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:25.243036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:25.243036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:25.243036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:25.243940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:25.243940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:25.243940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:25.243940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:25.243940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:25.243940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:25.243940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:25.243940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:25.243940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:25.243940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:25.243940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:25.243940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:25.243940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:25.243940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:25.243940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:25.243940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:25.243940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:25.244769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:25.244769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:25.244769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:25.244769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 231/456] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:25.244981 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300f2b2-2b3b-4714-9c4d-f7b6f52c9a1f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:25.247658 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:25.261937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-ee562da2-205b-4011-8781-9e22e921a11f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:25.261937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:25.261937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:25.261937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:25.261937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:25.261937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:25.261937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:25.261937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:25.261937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:25.261937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:25.261937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:25.261937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:25.261937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:25.261937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:25.261937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:25.261937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:25.263059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:25.263059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:25.263059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:25.263059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:25.263059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:25.263059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:25.263059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:25.263059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:25.263059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:25.263059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:25.263059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:25.263059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:25.263059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:25.263059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:25.263059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:25.263059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:25.263059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:25.264178 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:25.264178 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:25.264178 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:25.264178 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 226/457] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:25.264178 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee562da2-205b-4011-8781-9e22e921a11f None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:25.347513 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300f2b2-2b3b-4714-9c4d-f7b6f52c9a1f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:25.362602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee562da2-205b-4011-8781-9e22e921a11f None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:25.364903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:25.380739 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a5dc6-cfef-4962-9afe-7732527a5f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:25.381391 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5dc6-cfef-4962-9afe-7732527a5f4a None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:25.381667 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5dc6-cfef-4962-9afe-7732527a5f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:25.381941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5dc6-cfef-4962-9afe-7732527a5f4a None admin] PATH_INFO: `/v3/projects/c25f337a79704728adaa03f4103eef1c/users/c893e6388ed340eca17da2e279ca34a9/roles/09686a35c48b45b49ee384e08ee11206` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:25.396531 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a5dc6-cfef-4962-9afe-7732527a5f4a None admin] RBAC: Authorizing `identity:create_grant(project_id=c25f337a79704728adaa03f4103eef1c, user_id=c893e6388ed340eca17da2e279ca34a9, role_id=09686a35c48b45b49ee384e08ee11206)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:25.396832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac870b-ecac-4552-883f-1333ef0ca5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:25.397432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac870b-ecac-4552-883f-1333ef0ca5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:25.397759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac870b-ecac-4552-883f-1333ef0ca5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:25.397978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a5dc6-cfef-4962-9afe-7732527a5f4a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:25.398075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac870b-ecac-4552-883f-1333ef0ca5a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:25.398593 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac870b-ecac-4552-883f-1333ef0ca5a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:25.398893 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac870b-ecac-4552-883f-1333ef0ca5a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:25.400285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac870b-ecac-4552-883f-1333ef0ca5a6 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:25.411058 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 232/458] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:23:25 2022] PUT /identity/v3/projects/c25f337a79704728adaa03f4103eef1c/users/c893e6388ed340eca17da2e279ca34a9/roles/09686a35c48b45b49ee384e08ee11206 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:23:25.411690 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a5dc6-cfef-4962-9afe-7732527a5f4a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:25.423418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 227/459] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:25.428465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac870b-ecac-4552-883f-1333ef0ca5a6 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:25.474118 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:25.533215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a5dc6-cfef-4962-9afe-7732527a5f4a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:25.549108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac870b-ecac-4552-883f-1333ef0ca5a6 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:25.574320 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21373dc4-c7c0-4c13-beee-5658c7375374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:25.575229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21373dc4-c7c0-4c13-beee-5658c7375374 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:25.575741 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21373dc4-c7c0-4c13-beee-5658c7375374 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:25.575741 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21373dc4-c7c0-4c13-beee-5658c7375374 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:25.576485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21373dc4-c7c0-4c13-beee-5658c7375374 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:25.576782 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21373dc4-c7c0-4c13-beee-5658c7375374 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:25.578196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21373dc4-c7c0-4c13-beee-5658c7375374 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:25.589461 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e016d-72d6-4e8b-92e7-00928dae936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:25.590393 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e016d-72d6-4e8b-92e7-00928dae936e None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:25.591018 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e016d-72d6-4e8b-92e7-00928dae936e None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:25.591496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e016d-72d6-4e8b-92e7-00928dae936e None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:25.592358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e016d-72d6-4e8b-92e7-00928dae936e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:25.592876 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e016d-72d6-4e8b-92e7-00928dae936e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:25.595145 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e016d-72d6-4e8b-92e7-00928dae936e None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:25.597425 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 233/460] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Oct 20 13:23:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:25.602594 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21373dc4-c7c0-4c13-beee-5658c7375374 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:25.608739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 228/461] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:25.612409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e016d-72d6-4e8b-92e7-00928dae936e None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:25.636499 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:25.713075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21373dc4-c7c0-4c13-beee-5658c7375374 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:25.716996 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e016d-72d6-4e8b-92e7-00928dae936e None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:25.725273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:25.753276 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25582ed9-7793-43aa-907d-346b72d074e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:25.753488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f1fcc-9a25-41f0-93dd-5ce62e6f5849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:25.753974 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f1fcc-9a25-41f0-93dd-5ce62e6f5849 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:25.754073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25582ed9-7793-43aa-907d-346b72d074e7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:25.754250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f1fcc-9a25-41f0-93dd-5ce62e6f5849 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:25.754475 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25582ed9-7793-43aa-907d-346b72d074e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:25.754566 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f1fcc-9a25-41f0-93dd-5ce62e6f5849 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:25.754820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25582ed9-7793-43aa-907d-346b72d074e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:25.755566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25582ed9-7793-43aa-907d-346b72d074e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:25.755939 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25582ed9-7793-43aa-907d-346b72d074e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:25.757376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25582ed9-7793-43aa-907d-346b72d074e7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:25.762282 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f1fcc-9a25-41f0-93dd-5ce62e6f5849 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:25.763736 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f1fcc-9a25-41f0-93dd-5ce62e6f5849 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:25.769716 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 234/462] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:25.770388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25582ed9-7793-43aa-907d-346b72d074e7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:25.779654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-4b0f1fcc-9a25-41f0-93dd-5ce62e6f5849 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 13:23:25.779654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:25.779654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:25.779654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:25.779654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:25.779654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:25.779654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:25.779654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:25.779654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:25.779654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:25.779654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:25.779654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:25.779654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:25.779654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:25.779654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:25.779654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:25.780748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:25.781622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:25.781622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:25.781622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:25.781622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:25.781622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:25.781622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:25.781622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:25.781622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:25.781622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 13:23:25.781622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:25.781622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 229/463] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:23:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:25.782172 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f1fcc-9a25-41f0-93dd-5ce62e6f5849 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:25.875433 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:25.889920 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f1fcc-9a25-41f0-93dd-5ce62e6f5849 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:25.897173 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25582ed9-7793-43aa-907d-346b72d074e7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:25.927544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2949be4-08a7-4d98-9703-1f5ac937a7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:25.928438 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2949be4-08a7-4d98-9703-1f5ac937a7fb None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:25.928438 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2949be4-08a7-4d98-9703-1f5ac937a7fb None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:25.928735 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2949be4-08a7-4d98-9703-1f5ac937a7fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:25.933118 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c7d78-5c98-4773-a979-6d50e001506d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:25.933718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c7d78-5c98-4773-a979-6d50e001506d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:25.933993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c7d78-5c98-4773-a979-6d50e001506d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:25.934262 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840c7d78-5c98-4773-a979-6d50e001506d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:25.935531 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2949be4-08a7-4d98-9703-1f5ac937a7fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:25.936982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2949be4-08a7-4d98-9703-1f5ac937a7fb None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:25.948465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-f2949be4-08a7-4d98-9703-1f5ac937a7fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:25.948465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:25.948465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:25.948465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:25.948465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:25.948465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:25.948465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:25.948465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:25.948465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:25.948465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:25.948465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:25.948465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:25.948465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:25.948465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:25.948465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:25.949331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:25.949331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:25.949331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:25.949331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:25.949331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:25.949331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:25.949331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:25.949331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:25.949331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:25.949331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:25.949331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:25.949331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:25.949331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:25.949331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:25.949331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:25.949331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:25.949331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:25.950163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:25.950163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:25.950163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:25.950163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:25.950163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:25.950163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:25.950163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:25.950163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:25.954366 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 230/464] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:25.955738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2949be4-08a7-4d98-9703-1f5ac937a7fb None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:25.977252 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:26.007661 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c7d78-5c98-4773-a979-6d50e001506d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:26.009219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840c7d78-5c98-4773-a979-6d50e001506d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:26.061906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2949be4-08a7-4d98-9703-1f5ac937a7fb None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:26.097609 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9be027-cf95-4e56-8c2d-5f7c6b3676da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:26.098249 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9be027-cf95-4e56-8c2d-5f7c6b3676da None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:26.098535 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9be027-cf95-4e56-8c2d-5f7c6b3676da None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:26.098814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9be027-cf95-4e56-8c2d-5f7c6b3676da None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:26.106569 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9be027-cf95-4e56-8c2d-5f7c6b3676da None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:26.108097 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9be027-cf95-4e56-8c2d-5f7c6b3676da None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:26.117449 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 235/465] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 13:23:26.118580 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c7d78-5c98-4773-a979-6d50e001506d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:26.120616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-de9be027-cf95-4e56-8c2d-5f7c6b3676da None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 20 13:23:26.120616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:26.120616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:26.120616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:26.120616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:26.120616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:26.120616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:26.120616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:26.120616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:26.120616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:26.120616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:26.120616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:26.120616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:26.120616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:26.120616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:26.120616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:26.121667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:26.122811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:26.122811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:26.122811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:26.122811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:26.122811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:26.122811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:26.122811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:26.122811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:26.122811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 20 13:23:26.122811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:26.126337 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 231/466] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Oct 20 13:23:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:26.127360 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9be027-cf95-4e56-8c2d-5f7c6b3676da None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:26.131770 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:26.194778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:26.228359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840c7d78-5c98-4773-a979-6d50e001506d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:26.236457 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9be027-cf95-4e56-8c2d-5f7c6b3676da None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:26.267289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd4e1d-2377-4fd3-89e4-1e69a68d45e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:26.267958 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd4e1d-2377-4fd3-89e4-1e69a68d45e7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:26.268234 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd4e1d-2377-4fd3-89e4-1e69a68d45e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:26.268508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd4e1d-2377-4fd3-89e4-1e69a68d45e7 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:26.269224 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd4e1d-2377-4fd3-89e4-1e69a68d45e7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:26.269530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd4e1d-2377-4fd3-89e4-1e69a68d45e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:26.270971 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd4e1d-2377-4fd3-89e4-1e69a68d45e7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:26.271746 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bf098-c570-475b-90f7-3fa5f685849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:26.272601 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bf098-c570-475b-90f7-3fa5f685849c None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:26.273083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bf098-c570-475b-90f7-3fa5f685849c None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:26.273567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bf098-c570-475b-90f7-3fa5f685849c None admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:26.274353 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bf098-c570-475b-90f7-3fa5f685849c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:26.274731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bf098-c570-475b-90f7-3fa5f685849c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:26.276259 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4bf098-c570-475b-90f7-3fa5f685849c None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:26.290107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 236/467] 10.222.0.36 () {56 vars in 1137 bytes} [Thu Oct 20 13:23:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:26.296234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 232/468] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:26.296234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bf098-c570-475b-90f7-3fa5f685849c None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:26.296910 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd4e1d-2377-4fd3-89e4-1e69a68d45e7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:26.362828 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:26.401626 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd4e1d-2377-4fd3-89e4-1e69a68d45e7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:26.403293 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bf098-c570-475b-90f7-3fa5f685849c None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:26.428863 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:26.437995 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be757bf1-c219-4e60-9ebb-d7d10aa2f3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:26.438621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be757bf1-c219-4e60-9ebb-d7d10aa2f3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:26.438902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be757bf1-c219-4e60-9ebb-d7d10aa2f3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:26.439281 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be757bf1-c219-4e60-9ebb-d7d10aa2f3d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:26.440944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a4a02-3a98-463f-89e2-f205257cae3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:26.441653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a4a02-3a98-463f-89e2-f205257cae3c None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:26.442050 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a4a02-3a98-463f-89e2-f205257cae3c None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:26.442320 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a4a02-3a98-463f-89e2-f205257cae3c None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:26.443062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a4a02-3a98-463f-89e2-f205257cae3c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:26.443367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a4a02-3a98-463f-89e2-f205257cae3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:26.444776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a4a02-3a98-463f-89e2-f205257cae3c None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:26.449851 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be757bf1-c219-4e60-9ebb-d7d10aa2f3d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:26.451306 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be757bf1-c219-4e60-9ebb-d7d10aa2f3d9 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:26.467034 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 233/469] 10.222.0.36 () {56 vars in 1139 bytes} [Thu Oct 20 13:23:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:26.467034 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a4a02-3a98-463f-89e2-f205257cae3c None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:26.467236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-be757bf1-c219-4e60-9ebb-d7d10aa2f3d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:26.467236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:26.467236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:26.467236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:26.467236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:26.467236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:26.467236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:26.467236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:26.467236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:26.467236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:26.467236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:26.467236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:26.467236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:26.467236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:26.467236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:26.467236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:26.468055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:26.468055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:26.468055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:26.468055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:26.468055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:26.468055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:26.468055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:26.468055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:26.468055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:26.468055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:26.468055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:26.468055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:26.468055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:26.468055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:26.468055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:26.468055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:26.468055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:26.468873 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:26.468873 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:26.468873 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:26.468873 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 237/470] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:26.468873 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be757bf1-c219-4e60-9ebb-d7d10aa2f3d9 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:26.571924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a4a02-3a98-463f-89e2-f205257cae3c None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:26.577224 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be757bf1-c219-4e60-9ebb-d7d10aa2f3d9 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:26.595291 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:26.608854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed919432-0a8e-4faf-acae-def6e2f51c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:26.609609 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed919432-0a8e-4faf-acae-def6e2f51c18 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:26.609892 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed919432-0a8e-4faf-acae-def6e2f51c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:26.610162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed919432-0a8e-4faf-acae-def6e2f51c18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:26.616507 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c2b53-9426-4e59-b021-8203eb3d1fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:26.617116 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c2b53-9426-4e59-b021-8203eb3d1fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:26.617396 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c2b53-9426-4e59-b021-8203eb3d1fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:26.617669 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c2b53-9426-4e59-b021-8203eb3d1fa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:26.618395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c2b53-9426-4e59-b021-8203eb3d1fa5 None admin] RBAC: Adding query filter params (role.id=09686a35c48b45b49ee384e08ee11206, scope.project.id=c25f337a79704728adaa03f4103eef1c, user.id=674c5b25932a41309428ba6c6c72ed02) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:26.618704 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c2b53-9426-4e59-b021-8203eb3d1fa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:26.620157 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c2b53-9426-4e59-b021-8203eb3d1fa5 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:26.635007 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 238/471] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:23:26 2022] GET /identity/v3/role_assignments?user.id=674c5b25932a41309428ba6c6c72ed02&scope.project.id=c25f337a79704728adaa03f4103eef1c&role.id=09686a35c48b45b49ee384e08ee11206 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:26.635007 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c2b53-9426-4e59-b021-8203eb3d1fa5 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:26.688961 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:26.734161 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed919432-0a8e-4faf-acae-def6e2f51c18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:26.735979 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed919432-0a8e-4faf-acae-def6e2f51c18 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:26.753697 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c2b53-9426-4e59-b021-8203eb3d1fa5 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:26.793703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff362d77-b8c7-491a-a49a-541a454e62de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:26.794415 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff362d77-b8c7-491a-a49a-541a454e62de None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:26.794758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff362d77-b8c7-491a-a49a-541a454e62de None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:26.795126 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff362d77-b8c7-491a-a49a-541a454e62de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:26.870930 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 234/472] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 13:23:26.870930 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed919432-0a8e-4faf-acae-def6e2f51c18 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:26.879915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff362d77-b8c7-491a-a49a-541a454e62de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:26.881967 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff362d77-b8c7-491a-a49a-541a454e62de None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:26.901318 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:26.940586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:26.987845 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed919432-0a8e-4faf-acae-def6e2f51c18 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:27.023876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 239/473] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 13:23:27.025045 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff362d77-b8c7-491a-a49a-541a454e62de None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:27.029248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b4a6b-f6e1-40ee-ab86-f4fc80a5371d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:27.029248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b4a6b-f6e1-40ee-ab86-f4fc80a5371d None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:27.029456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b4a6b-f6e1-40ee-ab86-f4fc80a5371d None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:27.029659 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b4a6b-f6e1-40ee-ab86-f4fc80a5371d None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:27.030313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b4a6b-f6e1-40ee-ab86-f4fc80a5371d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:27.030621 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b4a6b-f6e1-40ee-ab86-f4fc80a5371d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:27.032043 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b4a6b-f6e1-40ee-ab86-f4fc80a5371d None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:27.045406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 235/474] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:27.046239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b4a6b-f6e1-40ee-ab86-f4fc80a5371d None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:27.136043 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff362d77-b8c7-491a-a49a-541a454e62de None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:27.161702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:27.181701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b4a6b-f6e1-40ee-ab86-f4fc80a5371d None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:27.186206 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea683b3-1118-47df-81db-dbc4f86e5395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:27.187090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea683b3-1118-47df-81db-dbc4f86e5395 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:27.187549 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea683b3-1118-47df-81db-dbc4f86e5395 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:27.188028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea683b3-1118-47df-81db-dbc4f86e5395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:27.202410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea683b3-1118-47df-81db-dbc4f86e5395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:27.204690 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea683b3-1118-47df-81db-dbc4f86e5395 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:27.208925 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:27.219420 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e17b0-1fdb-4c68-81ec-6e4f0e0dd73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:27.220222 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e17b0-1fdb-4c68-81ec-6e4f0e0dd73e None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:27.221099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e17b0-1fdb-4c68-81ec-6e4f0e0dd73e None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:27.221431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e17b0-1fdb-4c68-81ec-6e4f0e0dd73e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:27.227369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-4ea683b3-1118-47df-81db-dbc4f86e5395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:27.227369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:27.227369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:27.227369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:27.227369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:27.227369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:27.227369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:27.227369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:27.227369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:27.227369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:27.227369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:27.227369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:27.227369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:27.227369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:27.227369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:27.227369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:27.228278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:27.228278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:27.228278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:27.228278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:27.228278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:27.228278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:27.228278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:27.228278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:27.228278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:27.228278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:27.228278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:27.228278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:27.228278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:27.228278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:27.228278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:27.228278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:27.228278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:27.229102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:27.229102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:27.229102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:27.230964 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 240/475] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:27.232361 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea683b3-1118-47df-81db-dbc4f86e5395 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:27.238987 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e17b0-1fdb-4c68-81ec-6e4f0e0dd73e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:27.238987 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e17b0-1fdb-4c68-81ec-6e4f0e0dd73e None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:27.250648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-981e17b0-1fdb-4c68-81ec-6e4f0e0dd73e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:27.250648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:27.250648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:27.250648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:27.250648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:27.250648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:27.250648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:27.250648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:27.250648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:27.250648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:27.250648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:27.250648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:27.250648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:27.250648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:27.250648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:27.250648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:27.252177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:27.252177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:27.252177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:27.252177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:27.252177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:27.252177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:27.252177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:27.252177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:27.252177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:27.252177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:27.252177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:27.252177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:27.252177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:27.252177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:27.252177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:27.252177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:27.252177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:27.253162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:27.253162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:27.253162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:27.253162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 236/476] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:27.253372 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e17b0-1fdb-4c68-81ec-6e4f0e0dd73e None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:27.355658 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea683b3-1118-47df-81db-dbc4f86e5395 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:27.390170 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e17b0-1fdb-4c68-81ec-6e4f0e0dd73e None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:27.395661 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0c249-eb34-48d1-a687-d114ba74f665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:27.396546 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0c249-eb34-48d1-a687-d114ba74f665 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:27.397027 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0c249-eb34-48d1-a687-d114ba74f665 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:27.397541 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0c249-eb34-48d1-a687-d114ba74f665 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:27.417852 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0c249-eb34-48d1-a687-d114ba74f665 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:27.419936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e0c249-eb34-48d1-a687-d114ba74f665 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:27.432871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-c7e0c249-eb34-48d1-a687-d114ba74f665 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:27.432871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:27.432871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:27.432871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:27.432871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:27.432871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:27.432871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:27.432871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:27.432871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:27.432871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:27.432871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:27.432871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:27.432871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:27.432871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:27.432871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:27.433762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:27.433762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:27.433762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:27.433762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:27.433762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:27.433762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:27.433762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:27.433762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:27.433762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:27.433762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:27.433762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:27.433762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:27.433762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:27.433762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:27.433762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:27.433762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:27.433762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:27.434589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:27.434589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:27.434589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:27.434589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:27.434589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:27.434589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:27.434589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:27.434589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:27.434589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 241/477] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:27.435097 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0c249-eb34-48d1-a687-d114ba74f665 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:27.445450 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151478a-0543-44c0-b417-1948f6915fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:27.446183 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151478a-0543-44c0-b417-1948f6915fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:27.446462 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151478a-0543-44c0-b417-1948f6915fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:27.446731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151478a-0543-44c0-b417-1948f6915fe5 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:27.447402 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151478a-0543-44c0-b417-1948f6915fe5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:27.447703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151478a-0543-44c0-b417-1948f6915fe5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:27.449259 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151478a-0543-44c0-b417-1948f6915fe5 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:27.450899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:27.464623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 237/478] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:27.466227 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151478a-0543-44c0-b417-1948f6915fe5 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:27.499596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:27.560363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e0c249-eb34-48d1-a687-d114ba74f665 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:27.597719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151478a-0543-44c0-b417-1948f6915fe5 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:27.598630 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec1ae5-78f9-42fa-a023-145bcde676b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:27.599267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec1ae5-78f9-42fa-a023-145bcde676b3 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:27.599647 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec1ae5-78f9-42fa-a023-145bcde676b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:27.599921 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec1ae5-78f9-42fa-a023-145bcde676b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:27.600651 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec1ae5-78f9-42fa-a023-145bcde676b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:27.600956 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec1ae5-78f9-42fa-a023-145bcde676b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:27.602340 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec1ae5-78f9-42fa-a023-145bcde676b3 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:27.618088 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 242/479] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:27.619105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec1ae5-78f9-42fa-a023-145bcde676b3 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:27.643868 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62d6cb-623b-49f3-a638-c6620d130a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:27.644556 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62d6cb-623b-49f3-a638-c6620d130a4a None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:27.644845 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62d6cb-623b-49f3-a638-c6620d130a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:27.645120 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62d6cb-623b-49f3-a638-c6620d130a4a None admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:27.645820 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62d6cb-623b-49f3-a638-c6620d130a4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:27.646127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62d6cb-623b-49f3-a638-c6620d130a4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:27.647596 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62d6cb-623b-49f3-a638-c6620d130a4a None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:27.664117 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 238/480] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:27.664117 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62d6cb-623b-49f3-a638-c6620d130a4a None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:27.719441 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:27.733108 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec1ae5-78f9-42fa-a023-145bcde676b3 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:27.751151 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:27.768813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62d6cb-623b-49f3-a638-c6620d130a4a None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:27.771784 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b3401-de1a-439c-be11-14d1971babec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:27.772406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b3401-de1a-439c-be11-14d1971babec None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:27.772679 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b3401-de1a-439c-be11-14d1971babec None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:27.772947 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b3401-de1a-439c-be11-14d1971babec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:27.779860 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b3401-de1a-439c-be11-14d1971babec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:27.781304 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b3401-de1a-439c-be11-14d1971babec None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:27.793229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-884b3401-de1a-439c-be11-14d1971babec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:27.793229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:27.793229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:27.793229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:27.793229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:27.793229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:27.793229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:27.793229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:27.793229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:27.793229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:27.793229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:27.793229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:27.793229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:27.793229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:27.793229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:27.794061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:27.794061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:27.794061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:27.794061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:27.794061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:27.794061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:27.794061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:27.794061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:27.794061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:27.794061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:27.794061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:27.794061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:27.794061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:27.794061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:27.794061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:27.794061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:27.794061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:27.794888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:27.794888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:27.794888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:27.794888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:27.794888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:27.794888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:27.794888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:27.794888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:27.799092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 243/481] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:27.800337 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbf381-7537-4e63-b3d6-6152658dbb61 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:27.800626 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbf381-7537-4e63-b3d6-6152658dbb61 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:27.800902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbf381-7537-4e63-b3d6-6152658dbb61 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:27.806278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 244/482] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:27.806278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbf381-7537-4e63-b3d6-6152658dbb61 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:27.810215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39463cb7-402d-4922-88bf-bfc84b21a4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:27.810853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39463cb7-402d-4922-88bf-bfc84b21a4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:27.811198 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39463cb7-402d-4922-88bf-bfc84b21a4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:27.811476 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39463cb7-402d-4922-88bf-bfc84b21a4c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:27.820143 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39463cb7-402d-4922-88bf-bfc84b21a4c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:27.821588 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39463cb7-402d-4922-88bf-bfc84b21a4c6 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:27.832949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-39463cb7-402d-4922-88bf-bfc84b21a4c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:27.832949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:27.832949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:27.832949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:27.832949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:27.832949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:27.832949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:27.832949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:27.832949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:27.832949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:27.832949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:27.832949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:27.832949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:27.832949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:27.832949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:27.833768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:27.833768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:27.833768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:27.833768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:27.833768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:27.833768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:27.833768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:27.833768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:27.833768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:27.833768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:27.833768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:27.833768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:27.833768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:27.833768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:27.833768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:27.833768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:27.833768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:27.834639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:27.834639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:27.834639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:27.834639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:27.834639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:27.834639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:27.834639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:27.834639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:27.834639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 239/483] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:27.835736 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39463cb7-402d-4922-88bf-bfc84b21a4c6 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:27.924603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbf381-7537-4e63-b3d6-6152658dbb61 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:27.945298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39463cb7-402d-4922-88bf-bfc84b21a4c6 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:27.960420 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:27.961227 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9e5bb-cd5e-408f-ae7a-0d7dc8458418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:27.962402 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e5bb-cd5e-408f-ae7a-0d7dc8458418 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:27.962713 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e5bb-cd5e-408f-ae7a-0d7dc8458418 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:27.963023 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e5bb-cd5e-408f-ae7a-0d7dc8458418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:27.963757 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9e5bb-cd5e-408f-ae7a-0d7dc8458418 None admin] RBAC: Adding query filter params (role.id=09686a35c48b45b49ee384e08ee11206, scope.project.id=c25f337a79704728adaa03f4103eef1c, user.id=7d026ec6ed344404a5ebe4352792cc1a) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:27.964076 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9e5bb-cd5e-408f-ae7a-0d7dc8458418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:27.965506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9e5bb-cd5e-408f-ae7a-0d7dc8458418 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:27.972269 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 245/484] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:23:27 2022] GET /identity/v3/role_assignments?user.id=7d026ec6ed344404a5ebe4352792cc1a&scope.project.id=c25f337a79704728adaa03f4103eef1c&role.id=09686a35c48b45b49ee384e08ee11206 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:27.973449 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17beeeb1-e430-4602-8b33-84c2cae72893 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:27.973735 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17beeeb1-e430-4602-8b33-84c2cae72893 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:27.974012 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17beeeb1-e430-4602-8b33-84c2cae72893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:27.995211 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-17beeeb1-e430-4602-8b33-84c2cae72893 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:27.996170 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1a293-e61f-4015-a84f-1d867c31beb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:27.996626 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-17beeeb1-e430-4602-8b33-84c2cae72893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:27.997469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1a293-e61f-4015-a84f-1d867c31beb5 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:27.997941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1a293-e61f-4015-a84f-1d867c31beb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:27.998849 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1a293-e61f-4015-a84f-1d867c31beb5 None admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:28.000944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1a293-e61f-4015-a84f-1d867c31beb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:28.001468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1a293-e61f-4015-a84f-1d867c31beb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:28.004009 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1a293-e61f-4015-a84f-1d867c31beb5 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:28.025304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 240/485] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:28.025304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1a293-e61f-4015-a84f-1d867c31beb5 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:28.050607 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:28.092181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 246/486] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:28.093448 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17beeeb1-e430-4602-8b33-84c2cae72893 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:28.180397 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1a293-e61f-4015-a84f-1d867c31beb5 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:28.217093 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17beeeb1-e430-4602-8b33-84c2cae72893 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:28.219223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca2044-552e-4b7e-b598-af215e9511a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:28.220176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca2044-552e-4b7e-b598-af215e9511a7 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:28.220968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca2044-552e-4b7e-b598-af215e9511a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:28.221497 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca2044-552e-4b7e-b598-af215e9511a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:28.222396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca2044-552e-4b7e-b598-af215e9511a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:28.222927 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca2044-552e-4b7e-b598-af215e9511a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:28.224605 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca2044-552e-4b7e-b598-af215e9511a7 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:28.237808 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 241/487] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:28.243842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca2044-552e-4b7e-b598-af215e9511a7 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:28.256054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f39e4-3e18-4ade-98f0-488951053253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:28.257104 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f39e4-3e18-4ade-98f0-488951053253 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:28.257384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f39e4-3e18-4ade-98f0-488951053253 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:28.257654 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183f39e4-3e18-4ade-98f0-488951053253 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:28.258379 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f39e4-3e18-4ade-98f0-488951053253 None admin] RBAC: Adding query filter params (role.id=09686a35c48b45b49ee384e08ee11206, scope.project.id=c25f337a79704728adaa03f4103eef1c, user.id=8a7a1006ff4b43c3be2cc011359abdd2) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:28.258687 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f39e4-3e18-4ade-98f0-488951053253 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:28.260834 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183f39e4-3e18-4ade-98f0-488951053253 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:28.275058 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 247/488] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:23:28 2022] GET /identity/v3/role_assignments?user.id=8a7a1006ff4b43c3be2cc011359abdd2&scope.project.id=c25f337a79704728adaa03f4103eef1c&role.id=09686a35c48b45b49ee384e08ee11206 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:28.292020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:28.371941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca2044-552e-4b7e-b598-af215e9511a7 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:28.410242 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f39e4-3e18-4ade-98f0-488951053253 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:28.413569 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ff62b-16c0-4570-8336-b8c80b49b4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:28.414459 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ff62b-16c0-4570-8336-b8c80b49b4db None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:28.415071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ff62b-16c0-4570-8336-b8c80b49b4db None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:28.415795 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ff62b-16c0-4570-8336-b8c80b49b4db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:28.416737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ff62b-16c0-4570-8336-b8c80b49b4db None admin] RBAC: Adding query filter params (role.id=09686a35c48b45b49ee384e08ee11206, scope.project.id=c25f337a79704728adaa03f4103eef1c, user.id=5852ff82962e4cea85b8aa8593f09d37) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:28.417253 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ff62b-16c0-4570-8336-b8c80b49b4db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:28.419011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ff62b-16c0-4570-8336-b8c80b49b4db None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:28.426071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 242/489] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:23:28 2022] GET /identity/v3/role_assignments?user.id=5852ff82962e4cea85b8aa8593f09d37&scope.project.id=c25f337a79704728adaa03f4103eef1c&role.id=09686a35c48b45b49ee384e08ee11206 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:28.461779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:28.547457 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183f39e4-3e18-4ade-98f0-488951053253 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:28.585858 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8ba04-54b9-4b02-9f52-5f08d1b5088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:28.586508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8ba04-54b9-4b02-9f52-5f08d1b5088f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:28.586787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8ba04-54b9-4b02-9f52-5f08d1b5088f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:28.587086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8ba04-54b9-4b02-9f52-5f08d1b5088f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:28.600226 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8ba04-54b9-4b02-9f52-5f08d1b5088f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:28.605423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-06b8ba04-54b9-4b02-9f52-5f08d1b5088f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:28.605423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:28.605423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:28.605423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:28.605423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:28.605423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:28.605423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:28.605423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:28.605423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:28.605423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:28.605423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:28.605423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:28.605423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:28.605423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:28.605423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:28.605423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:28.606351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:28.606351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:28.606351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:28.606351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:28.606351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:28.606351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:28.606351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:28.606351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:28.606351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:28.606351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:28.606351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:28.606351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:28.606351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:28.606351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:28.606351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:28.606351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:28.607367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:28.607367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:28.607367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:28.607367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:28.607367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:28.607367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:28.607367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:28.607367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:28.607367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:28.607367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:28.607367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:28.607367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:28.607367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 248/490] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Oct 20 13:23:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:23:28.612913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ff62b-16c0-4570-8336-b8c80b49b4db None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:28.730763 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:28.735327 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ff62b-16c0-4570-8336-b8c80b49b4db None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:28.780151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd889af-e09d-4a47-b914-c8bacc999b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:28.780773 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd889af-e09d-4a47-b914-c8bacc999b49 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:28.781058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd889af-e09d-4a47-b914-c8bacc999b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:28.781335 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd889af-e09d-4a47-b914-c8bacc999b49 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:28.782002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd889af-e09d-4a47-b914-c8bacc999b49 None admin] RBAC: Adding query filter params (name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:28.782309 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd889af-e09d-4a47-b914-c8bacc999b49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:28.784365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd889af-e09d-4a47-b914-c8bacc999b49 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:28.793484 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 243/491] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Oct 20 13:23:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:28.799310 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8ba04-54b9-4b02-9f52-5f08d1b5088f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:28.917196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:28.928907 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8ba04-54b9-4b02-9f52-5f08d1b5088f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:28.965760 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d73de-6f69-44b3-8d7c-d211651e5fe4 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:28.966102 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d73de-6f69-44b3-8d7c-d211651e5fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:28.966338 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d73de-6f69-44b3-8d7c-d211651e5fe4 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:28.967902 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 244/492] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:23:28.973006 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cca94e-772d-4921-93bf-e8d839272b25 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:28.973292 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cca94e-772d-4921-93bf-e8d839272b25 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:28.973580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cca94e-772d-4921-93bf-e8d839272b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:28.990707 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5312444-deea-4b9d-b4a5-4a02fb052f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:28.991360 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5312444-deea-4b9d-b4a5-4a02fb052f60 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:28.991566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5312444-deea-4b9d-b4a5-4a02fb052f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:28.991839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5312444-deea-4b9d-b4a5-4a02fb052f60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:28.998490 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-d2cca94e-772d-4921-93bf-e8d839272b25 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:28.999719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d2cca94e-772d-4921-93bf-e8d839272b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:29.014110 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5312444-deea-4b9d-b4a5-4a02fb052f60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:29.015615 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5312444-deea-4b9d-b4a5-4a02fb052f60 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:29.034968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-b5312444-deea-4b9d-b4a5-4a02fb052f60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:29.034968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:29.034968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:29.034968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:29.034968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:29.034968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:29.034968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:29.034968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:29.034968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:29.034968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:29.034968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:29.034968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:29.034968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:29.034968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:29.034968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:29.034968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:29.036319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:29.036319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:29.036319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:29.036319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:29.036319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:29.036319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:29.036319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:29.036319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:29.036319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:29.036319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:29.036319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:29.036319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:29.036319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:29.036319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:29.036319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:29.036319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:29.036319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:29.037917 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:29.037917 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:29.037917 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:29.037917 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 249/493] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:29.043332 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5312444-deea-4b9d-b4a5-4a02fb052f60 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:29.149564 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 245/494] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:23:29.198418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5312444-deea-4b9d-b4a5-4a02fb052f60 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:29.242558 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be8f14-76a1-45f5-8fc5-cba171ed992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:29.243544 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be8f14-76a1-45f5-8fc5-cba171ed992e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:29.244038 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be8f14-76a1-45f5-8fc5-cba171ed992e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:29.244503 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be8f14-76a1-45f5-8fc5-cba171ed992e None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:29.245331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be8f14-76a1-45f5-8fc5-cba171ed992e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:29.245825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be8f14-76a1-45f5-8fc5-cba171ed992e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:29.247394 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be8f14-76a1-45f5-8fc5-cba171ed992e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:29.264796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 250/495] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:29.270411 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cca94e-772d-4921-93bf-e8d839272b25 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:29.381730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:29.391658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cca94e-772d-4921-93bf-e8d839272b25 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:29.430365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66dc63-ead3-4698-a605-7e9a08584aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:29.431027 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66dc63-ead3-4698-a605-7e9a08584aec None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:29.431311 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66dc63-ead3-4698-a605-7e9a08584aec None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:29.431583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66dc63-ead3-4698-a605-7e9a08584aec None admin] PATH_INFO: `/v3/users/swift` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:29.439913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66dc63-ead3-4698-a605-7e9a08584aec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:29.441385 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66dc63-ead3-4698-a605-7e9a08584aec None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:29.454252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-4d66dc63-ead3-4698-a605-7e9a08584aec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 20 13:23:29.454252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:29.454252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:29.454252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:29.454252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:29.454252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:29.454252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:29.454252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:29.454252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:29.454252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:29.454252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:29.454252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:29.454252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:29.454252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:29.454252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:29.454252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:29.455507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:29.457190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:29.457190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:29.457190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:29.457190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:29.457190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:29.457190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:29.457190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:29.457190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:29.457190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 20 13:23:29.457190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:29.457190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 246/496] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:23:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:29.464014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be8f14-76a1-45f5-8fc5-cba171ed992e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:29.480302 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:29.596978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be8f14-76a1-45f5-8fc5-cba171ed992e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:29.609408 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66dc63-ead3-4698-a605-7e9a08584aec None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:29.637583 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31924289-7876-41a0-95f7-fa144846849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:29.638514 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31924289-7876-41a0-95f7-fa144846849c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:29.639006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31924289-7876-41a0-95f7-fa144846849c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:29.639472 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31924289-7876-41a0-95f7-fa144846849c None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:29.640408 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31924289-7876-41a0-95f7-fa144846849c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:29.640906 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31924289-7876-41a0-95f7-fa144846849c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:29.643509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31924289-7876-41a0-95f7-fa144846849c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:29.676247 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 251/497] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Oct 20 13:23:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:29.683939 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31924289-7876-41a0-95f7-fa144846849c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:29.795297 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:29.812858 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66dc63-ead3-4698-a605-7e9a08584aec None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:29.853804 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31924289-7876-41a0-95f7-fa144846849c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:29.891794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93786f-d04c-4479-b8d0-2c73634efd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:29.893308 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93786f-d04c-4479-b8d0-2c73634efd8a None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:29.893421 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93786f-d04c-4479-b8d0-2c73634efd8a None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:29.893605 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93786f-d04c-4479-b8d0-2c73634efd8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:29.907385 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93786f-d04c-4479-b8d0-2c73634efd8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:29.917905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-be93786f-d04c-4479-b8d0-2c73634efd8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:23:29.917905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:29.917905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:29.917905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:29.917905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:29.917905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:29.917905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:29.917905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:29.917905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:29.917905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:29.917905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:29.917905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:29.917905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:29.917905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:29.917905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:29.917905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:29.918811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:29.918811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:29.918811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:29.918811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:29.918811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:29.918811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:29.918811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:29.918811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:29.918811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:29.918811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:29.918811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:29.918811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:29.918811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:29.918811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:29.918811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:29.918811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:29.919751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:29.919751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:29.919751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:29.919751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:29.919751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:29.919751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:29.919751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:29.919751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:29.919751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:29.919751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:29.919751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:23:29.919751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:29.919751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 247/498] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:23:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:23:29.927390 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93786f-d04c-4479-b8d0-2c73634efd8a None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:29.929241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fcc80-0cd6-4960-b23c-e5c1a3fbded2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:29.929866 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fcc80-0cd6-4960-b23c-e5c1a3fbded2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:29.930143 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fcc80-0cd6-4960-b23c-e5c1a3fbded2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:29.930414 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fcc80-0cd6-4960-b23c-e5c1a3fbded2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:29.942499 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:30.047075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93786f-d04c-4479-b8d0-2c73634efd8a None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:30.091972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fcc80-0cd6-4960-b23c-e5c1a3fbded2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:30.094104 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fcc80-0cd6-4960-b23c-e5c1a3fbded2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:30.104600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55410b-98b2-4884-8f7f-d7c45688295a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:30.105308 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55410b-98b2-4884-8f7f-d7c45688295a None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:30.105418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55410b-98b2-4884-8f7f-d7c45688295a None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:30.105685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55410b-98b2-4884-8f7f-d7c45688295a None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:30.106355 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55410b-98b2-4884-8f7f-d7c45688295a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:30.106661 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55410b-98b2-4884-8f7f-d7c45688295a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:30.108046 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55410b-98b2-4884-8f7f-d7c45688295a None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:30.122363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 248/499] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:23:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:30.128811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55410b-98b2-4884-8f7f-d7c45688295a None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:30.161058 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:30.214323 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 252/500] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:23:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 20 13:23:30.220032 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fcc80-0cd6-4960-b23c-e5c1a3fbded2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:30.240410 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:30.278411 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55410b-98b2-4884-8f7f-d7c45688295a None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:30.337678 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e007f-d78c-41db-bf9f-d0ed69433630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:30.338485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fcc80-0cd6-4960-b23c-e5c1a3fbded2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:30.338646 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e007f-d78c-41db-bf9f-d0ed69433630 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:30.338826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e007f-d78c-41db-bf9f-d0ed69433630 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:30.339272 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e007f-d78c-41db-bf9f-d0ed69433630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:30.351190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e007f-d78c-41db-bf9f-d0ed69433630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:30.352912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2e007f-d78c-41db-bf9f-d0ed69433630 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:30.377083 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0dd43-5f20-47ef-8ade-38e5d686f430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:30.378071 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0dd43-5f20-47ef-8ade-38e5d686f430 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:30.378431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-5a2e007f-d78c-41db-bf9f-d0ed69433630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:30.378431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:30.378431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:30.378431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:30.378431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:30.378431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:30.378431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:30.378431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:30.378431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:30.378431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:30.378431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:30.378431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:30.378431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:30.378431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:30.378431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:30.378431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:30.380001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:30.380001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:30.380001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:30.380001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:30.380001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:30.380001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:30.380001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:30.380001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:30.380001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:30.380001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:30.380001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:30.380001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:30.380001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:30.380001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:30.380001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:30.380001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:30.380001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:30.380867 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:30.380867 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:30.380867 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:30.381496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0dd43-5f20-47ef-8ade-38e5d686f430 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:30.381965 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0dd43-5f20-47ef-8ade-38e5d686f430 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:30.385171 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 249/501] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:23:30.390484 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e007f-d78c-41db-bf9f-d0ed69433630 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:30.394307 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f0dd43-5f20-47ef-8ade-38e5d686f430 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:30.396024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f0dd43-5f20-47ef-8ade-38e5d686f430 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:30.412719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-96f0dd43-5f20-47ef-8ade-38e5d686f430 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:30.412719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:30.412719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:30.412719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:30.412719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:30.412719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:30.412719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:30.412719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:30.412719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:30.412719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:30.412719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:30.412719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:30.412719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:30.412719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:30.412719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:30.412719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:30.413698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:30.413698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:30.413698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:30.413698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:30.413698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:30.413698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:30.413698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:30.413698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:30.413698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:30.413698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:30.413698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:30.413698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:30.413698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:30.413698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:30.413698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:30.413698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:30.413698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:30.414551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:30.414551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:30.414551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:30.417624 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 253/502] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:30.422544 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0dd43-5f20-47ef-8ade-38e5d686f430 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:30.464408 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:30.559922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0dd43-5f20-47ef-8ade-38e5d686f430 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:30.603502 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2e007f-d78c-41db-bf9f-d0ed69433630 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:30.640049 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:30.640848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3ae0b-5966-48b4-8111-176a1b02a35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:30.641184 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3ae0b-5966-48b4-8111-176a1b02a35a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:30.641513 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3ae0b-5966-48b4-8111-176a1b02a35a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:30.641789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3ae0b-5966-48b4-8111-176a1b02a35a None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:30.643345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3ae0b-5966-48b4-8111-176a1b02a35a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:30.643860 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3ae0b-5966-48b4-8111-176a1b02a35a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:30.645275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3ae0b-5966-48b4-8111-176a1b02a35a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:30.655273 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41173738-4ad3-4a54-9f00-ac8c4d0677a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:30.656302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41173738-4ad3-4a54-9f00-ac8c4d0677a1 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:30.656785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41173738-4ad3-4a54-9f00-ac8c4d0677a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:30.657283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41173738-4ad3-4a54-9f00-ac8c4d0677a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:30.659271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41173738-4ad3-4a54-9f00-ac8c4d0677a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:30.659787 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41173738-4ad3-4a54-9f00-ac8c4d0677a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:30.661490 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41173738-4ad3-4a54-9f00-ac8c4d0677a1 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:30.674321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 254/503] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:30.675740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 250/504] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:30.681169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41173738-4ad3-4a54-9f00-ac8c4d0677a1 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:30.681286 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3ae0b-5966-48b4-8111-176a1b02a35a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:30.835950 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41173738-4ad3-4a54-9f00-ac8c4d0677a1 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:30.850176 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:30.893126 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3ae0b-5966-48b4-8111-176a1b02a35a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:30.912333 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d4022-b10b-49ae-bba3-57b74c66b2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:30.913363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d4022-b10b-49ae-bba3-57b74c66b2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:30.913866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d4022-b10b-49ae-bba3-57b74c66b2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:30.914347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d4022-b10b-49ae-bba3-57b74c66b2e3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:30.932527 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d4022-b10b-49ae-bba3-57b74c66b2e3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:30.936055 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d4022-b10b-49ae-bba3-57b74c66b2e3 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:30.960429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-344d4022-b10b-49ae-bba3-57b74c66b2e3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 13:23:30.960429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:30.960429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:30.960429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:30.960429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:30.960429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:30.960429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:30.960429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:30.960429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:30.960429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:30.960429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:30.960429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:30.960429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:30.960429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:30.960429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:30.960429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:30.961418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:30.962328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:30.962328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:30.962328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:30.962328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:30.962328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:30.962328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:30.962328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:30.962328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:30.962328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 13:23:30.962328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:30.968659 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 251/505] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Oct 20 13:23:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:30.975835 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5041f-2a98-4ae8-af9e-8f0f99091db4 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:30.975835 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5041f-2a98-4ae8-af9e-8f0f99091db4 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:30.975835 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f5041f-2a98-4ae8-af9e-8f0f99091db4 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:30.977410 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 252/506] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:23:30.978110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5041f-2a98-4ae8-af9e-8f0f99091db4 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:30.983460 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22f9c4-6533-4f7c-a90d-e51e99a55207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:30.984633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22f9c4-6533-4f7c-a90d-e51e99a55207 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:30.985113 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22f9c4-6533-4f7c-a90d-e51e99a55207 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:30.987306 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22f9c4-6533-4f7c-a90d-e51e99a55207 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:30.996356 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22f9c4-6533-4f7c-a90d-e51e99a55207 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:30.998268 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22f9c4-6533-4f7c-a90d-e51e99a55207 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:31.013087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-7a22f9c4-6533-4f7c-a90d-e51e99a55207 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:31.013087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:31.013087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:31.013087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:31.013087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:31.013087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:31.013087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:31.013087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:31.013087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:31.013087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:31.013087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:31.013087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:31.013087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:31.013087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:31.013087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:31.014020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:31.014020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:31.014020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:31.014020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:31.014020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:31.014020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:31.014020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:31.014020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:31.014020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:31.014020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:31.014020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:31.014020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:31.014020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:31.014020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:31.014020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:31.014020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:31.014020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:31.015530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:31.015530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:31.015530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:31.015530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:31.015530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:31.015530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:31.015530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:31.015530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:31.015530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 255/507] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:31.016013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c635340-d0d8-4c01-9b03-a96605ced56e None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:31.016013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c635340-d0d8-4c01-9b03-a96605ced56e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:31.016328 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c635340-d0d8-4c01-9b03-a96605ced56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:31.037689 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5c635340-d0d8-4c01-9b03-a96605ced56e None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:31.038883 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5c635340-d0d8-4c01-9b03-a96605ced56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:31.051221 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:31.114019 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 256/508] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:31.115925 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c635340-d0d8-4c01-9b03-a96605ced56e None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:31.117856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f5041f-2a98-4ae8-af9e-8f0f99091db4 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:31.155052 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc63a86c-3c45-41f4-9682-025d167efce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:31.155881 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63a86c-3c45-41f4-9682-025d167efce7 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:31.156310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63a86c-3c45-41f4-9682-025d167efce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:31.156785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc63a86c-3c45-41f4-9682-025d167efce7 None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:31.158381 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63a86c-3c45-41f4-9682-025d167efce7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:31.158876 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63a86c-3c45-41f4-9682-025d167efce7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:31.160543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc63a86c-3c45-41f4-9682-025d167efce7 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:31.188154 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 253/509] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Oct 20 13:23:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:31.190747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bab774-d1ad-4a88-9693-ea2cbc6baa4f None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:31.191314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bab774-d1ad-4a88-9693-ea2cbc6baa4f None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:31.191820 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bab774-d1ad-4a88-9693-ea2cbc6baa4f None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:31.193746 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 254/510] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:31.194794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bab774-d1ad-4a88-9693-ea2cbc6baa4f None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:31.213388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:31.260895 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c635340-d0d8-4c01-9b03-a96605ced56e None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:31.306608 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26be0ab-8515-445b-a40e-91c456583eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:31.307241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26be0ab-8515-445b-a40e-91c456583eeb None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:31.307517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26be0ab-8515-445b-a40e-91c456583eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:31.307785 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26be0ab-8515-445b-a40e-91c456583eeb None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:31.308465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26be0ab-8515-445b-a40e-91c456583eeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:31.308765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26be0ab-8515-445b-a40e-91c456583eeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:31.310417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26be0ab-8515-445b-a40e-91c456583eeb None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:31.318178 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bab774-d1ad-4a88-9693-ea2cbc6baa4f None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:31.320114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:31.322669 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 257/511] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:31.323871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfcb65-0d7e-4793-89c6-9c1e2eb4ca33 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:31.324155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfcb65-0d7e-4793-89c6-9c1e2eb4ca33 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:31.324438 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfcb65-0d7e-4793-89c6-9c1e2eb4ca33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:31.342628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-bddfcb65-0d7e-4793-89c6-9c1e2eb4ca33 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:31.344066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-bddfcb65-0d7e-4793-89c6-9c1e2eb4ca33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:31.362873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7fa0a-2305-4d3e-bed4-dfd7c5d6c8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:31.363545 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7fa0a-2305-4d3e-bed4-dfd7c5d6c8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:31.363829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7fa0a-2305-4d3e-bed4-dfd7c5d6c8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:31.364105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7fa0a-2305-4d3e-bed4-dfd7c5d6c8d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:31.374374 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7fa0a-2305-4d3e-bed4-dfd7c5d6c8d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:31.375867 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7fa0a-2305-4d3e-bed4-dfd7c5d6c8d9 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:31.391468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-4bc7fa0a-2305-4d3e-bed4-dfd7c5d6c8d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:31.391468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:31.391468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:31.391468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:31.391468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:31.391468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:31.391468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:31.391468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:31.391468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:31.391468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:31.391468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:31.391468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:31.391468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:31.391468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:31.391468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:31.391468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:31.393003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:31.393003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:31.393003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:31.393003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:31.393003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:31.393003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:31.393003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:31.393003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:31.393003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:31.393003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:31.393003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:31.393003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:31.393003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:31.393003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:31.393003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:31.393003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:31.393003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:31.393985 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:31.393985 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:31.393985 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:31.393985 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 255/512] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:31.394424 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d5aaa-e62f-4bca-b229-845d842837d8 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:31.394691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d5aaa-e62f-4bca-b229-845d842837d8 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:31.394990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d5aaa-e62f-4bca-b229-845d842837d8 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:31.396193 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 256/513] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:31.396888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d5aaa-e62f-4bca-b229-845d842837d8 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:31.419867 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 258/514] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:31.420631 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfcb65-0d7e-4793-89c6-9c1e2eb4ca33 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:31.484733 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:31.510440 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d5aaa-e62f-4bca-b229-845d842837d8 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:31.535390 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfcb65-0d7e-4793-89c6-9c1e2eb4ca33 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:31.550429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352602c-5ab3-4bc5-9b3a-b290c4a08f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:31.551143 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352602c-5ab3-4bc5-9b3a-b290c4a08f43 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:31.551414 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352602c-5ab3-4bc5-9b3a-b290c4a08f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:31.551689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352602c-5ab3-4bc5-9b3a-b290c4a08f43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:31.552391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352602c-5ab3-4bc5-9b3a-b290c4a08f43 None admin] RBAC: Adding query filter params (role.id=09686a35c48b45b49ee384e08ee11206, scope.project.id=c25f337a79704728adaa03f4103eef1c, user.id=c893e6388ed340eca17da2e279ca34a9) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:31.552693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352602c-5ab3-4bc5-9b3a-b290c4a08f43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:31.554106 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352602c-5ab3-4bc5-9b3a-b290c4a08f43 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:31.567413 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 257/515] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:23:31 2022] GET /identity/v3/role_assignments?user.id=c893e6388ed340eca17da2e279ca34a9&scope.project.id=c25f337a79704728adaa03f4103eef1c&role.id=09686a35c48b45b49ee384e08ee11206 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:31.569049 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352602c-5ab3-4bc5-9b3a-b290c4a08f43 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:31.580885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e17b6d-dee1-4a4d-88d6-8c14932dc63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:31.581292 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e17b6d-dee1-4a4d-88d6-8c14932dc63e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:31.581675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e17b6d-dee1-4a4d-88d6-8c14932dc63e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:31.582050 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e17b6d-dee1-4a4d-88d6-8c14932dc63e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:31.595750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:31.599910 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e17b6d-dee1-4a4d-88d6-8c14932dc63e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:31.601978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e17b6d-dee1-4a4d-88d6-8c14932dc63e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:31.621744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-98e17b6d-dee1-4a4d-88d6-8c14932dc63e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:31.621744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:31.621744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:31.621744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:31.621744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:31.621744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:31.621744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:31.621744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:31.621744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:31.621744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:31.621744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:31.621744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:31.621744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:31.621744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:31.621744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:31.621744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:31.623095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:31.623095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:31.623095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:31.623095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:31.623095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:31.623095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:31.623095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:31.623095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:31.623095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:31.623095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:31.623095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:31.623095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:31.623095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:31.623095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:31.623095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:31.623095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:31.623095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:31.623994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:31.623994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:31.623994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:31.626093 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 259/516] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:31.628315 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779ecad-d292-4d8c-a54a-ebcfd41f008c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:31.628769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779ecad-d292-4d8c-a54a-ebcfd41f008c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:31.629199 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779ecad-d292-4d8c-a54a-ebcfd41f008c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:31.650427 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-6779ecad-d292-4d8c-a54a-ebcfd41f008c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:31.652005 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6779ecad-d292-4d8c-a54a-ebcfd41f008c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:31.714752 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352602c-5ab3-4bc5-9b3a-b290c4a08f43 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:31.734991 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 260/517] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:31.734991 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779ecad-d292-4d8c-a54a-ebcfd41f008c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:31.760082 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896a3bc-eda9-4ae2-8700-69e8f65332b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:31.760822 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896a3bc-eda9-4ae2-8700-69e8f65332b1 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:31.761098 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896a3bc-eda9-4ae2-8700-69e8f65332b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:31.761978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896a3bc-eda9-4ae2-8700-69e8f65332b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:31.762082 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896a3bc-eda9-4ae2-8700-69e8f65332b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:31.762531 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896a3bc-eda9-4ae2-8700-69e8f65332b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:31.763862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896a3bc-eda9-4ae2-8700-69e8f65332b1 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:31.778798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 258/518] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:31.778988 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896a3bc-eda9-4ae2-8700-69e8f65332b1 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:31.787864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:31.867552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:31.885129 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779ecad-d292-4d8c-a54a-ebcfd41f008c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:31.899627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896a3bc-eda9-4ae2-8700-69e8f65332b1 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:31.936584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd6cfb-f1b4-49d6-ae4c-d03d81182f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:31.937195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd6cfb-f1b4-49d6-ae4c-d03d81182f4b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:31.937469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd6cfb-f1b4-49d6-ae4c-d03d81182f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:31.937734 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd6cfb-f1b4-49d6-ae4c-d03d81182f4b None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:31.938376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd6cfb-f1b4-49d6-ae4c-d03d81182f4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:31.938677 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd6cfb-f1b4-49d6-ae4c-d03d81182f4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:31.940301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd6cfb-f1b4-49d6-ae4c-d03d81182f4b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:31.941922 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc9c1e-851e-401f-bccd-1c0a294b5050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:31.943371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc9c1e-851e-401f-bccd-1c0a294b5050 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:31.943851 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc9c1e-851e-401f-bccd-1c0a294b5050 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:31.944316 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc9c1e-851e-401f-bccd-1c0a294b5050 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:31.945087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc9c1e-851e-401f-bccd-1c0a294b5050 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:31.946654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc9c1e-851e-401f-bccd-1c0a294b5050 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:31.957415 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 261/519] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:31.958371 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd6cfb-f1b4-49d6-ae4c-d03d81182f4b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:31.961104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-f5bc9c1e-851e-401f-bccd-1c0a294b5050 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 13:23:31.961104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:31.961104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:23:31.961104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:23:31.961104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:23:31.961104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:23:31.961104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:23:31.961104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:31.961104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 13:23:31.961104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:31.961104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:31.961104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:31.961104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:31.961104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:31.961104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:31.961104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:31.961104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:31.962059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:31.962059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:31.962059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:31.962059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:31.962059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:31.962059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:31.962059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:23:31.962059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:23:31.962059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:23:31.962059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:23:31.962059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:31.962059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:31.962059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:31.962059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:31.962059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:31.962059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:31.962885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:31.962885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:31.962885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:31.962885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:31.962885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:31.962885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:31.962885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:31.962885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:31.962885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:31.962885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:31.962885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:23:31.962885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:31.962885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 13:23:31.962885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:31.967097 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 259/520] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Oct 20 13:23:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:31.968139 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc9c1e-851e-401f-bccd-1c0a294b5050 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:32.063409 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:32.067740 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd6cfb-f1b4-49d6-ae4c-d03d81182f4b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:32.083336 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc9c1e-851e-401f-bccd-1c0a294b5050 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:32.104765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c94f3-48c8-4ff6-bd48-190faf3e7951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:32.105481 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c94f3-48c8-4ff6-bd48-190faf3e7951 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:32.105762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c94f3-48c8-4ff6-bd48-190faf3e7951 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:32.106028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c94f3-48c8-4ff6-bd48-190faf3e7951 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:32.113736 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c94f3-48c8-4ff6-bd48-190faf3e7951 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:32.115279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c94f3-48c8-4ff6-bd48-190faf3e7951 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:32.121166 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb633a1e-0686-42ec-bd8a-63721bf534ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:32.121771 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb633a1e-0686-42ec-bd8a-63721bf534ba None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:32.122048 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb633a1e-0686-42ec-bd8a-63721bf534ba None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:32.122318 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb633a1e-0686-42ec-bd8a-63721bf534ba None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:32.123003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb633a1e-0686-42ec-bd8a-63721bf534ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:32.124389 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb633a1e-0686-42ec-bd8a-63721bf534ba None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:32.126968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-827c94f3-48c8-4ff6-bd48-190faf3e7951 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:32.126968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:32.126968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:32.126968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:32.126968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:32.126968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:32.126968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:32.126968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:32.126968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:32.126968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:32.126968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:32.126968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:32.126968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:32.126968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:32.126968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:32.127865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:32.127865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:32.127865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:32.127865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:32.127865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:32.127865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:32.127865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:32.127865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:32.127865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:32.127865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:32.127865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:32.127865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:32.127865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:32.127865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:32.127865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:32.127865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:32.127865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:32.128747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:32.128747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:32.128747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:32.128747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:32.128747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:32.128747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:32.128747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:32.128747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:32.128747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 262/521] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:32.129680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c94f3-48c8-4ff6-bd48-190faf3e7951 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:32.141135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:32.159439 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 260/522] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:23:31 2022] POST /identity/v3/users => generated 254 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:23:32.161283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb633a1e-0686-42ec-bd8a-63721bf534ba None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:32.255872 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c94f3-48c8-4ff6-bd48-190faf3e7951 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:32.302295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54f660-48b6-4a97-b471-bb490187ef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:32.303410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54f660-48b6-4a97-b471-bb490187ef71 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:32.303958 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54f660-48b6-4a97-b471-bb490187ef71 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:32.304231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54f660-48b6-4a97-b471-bb490187ef71 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:32.304876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54f660-48b6-4a97-b471-bb490187ef71 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:32.305176 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54f660-48b6-4a97-b471-bb490187ef71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:32.305917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb633a1e-0686-42ec-bd8a-63721bf534ba None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:32.306573 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54f660-48b6-4a97-b471-bb490187ef71 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:32.313485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 263/523] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Oct 20 13:23:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:32.315225 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54f660-48b6-4a97-b471-bb490187ef71 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:32.349267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:32.358238 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47527a4b-350b-4452-a0aa-17c3059932ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:32.359021 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47527a4b-350b-4452-a0aa-17c3059932ea None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:32.359315 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47527a4b-350b-4452-a0aa-17c3059932ea None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:32.359699 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47527a4b-350b-4452-a0aa-17c3059932ea None admin] PATH_INFO: `/v3/services/network` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:32.360319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47527a4b-350b-4452-a0aa-17c3059932ea None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:32.361824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47527a4b-350b-4452-a0aa-17c3059932ea None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:32.371518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-47527a4b-350b-4452-a0aa-17c3059932ea None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 13:23:32.371518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:32.371518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:23:32.371518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:23:32.371518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:23:32.371518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:23:32.371518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:23:32.371518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:32.371518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 13:23:32.371518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:32.371518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:32.371518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:32.371518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:32.371518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:32.371518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:32.371518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:32.371518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:32.372503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:32.372503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:32.372503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:32.372503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:32.372503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:32.372503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:32.372503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:23:32.372503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:23:32.372503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:23:32.372503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:23:32.372503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:32.372503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:32.372503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:32.372503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:32.372503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:32.372503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:32.373314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:32.373314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:32.373314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:32.373314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:32.373314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:32.373314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:32.373314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:32.373314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:32.373314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:32.373314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:32.373314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:23:32.373314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:32.373314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 13:23:32.373314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:32.373314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 261/524] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:32 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:32.374068 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47527a4b-350b-4452-a0aa-17c3059932ea None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:32.448729 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54f660-48b6-4a97-b471-bb490187ef71 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:32.461535 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:32.490766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459c999-b2fe-4f33-bfd1-733ebb1d553e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:32.492179 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459c999-b2fe-4f33-bfd1-733ebb1d553e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:32.492664 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459c999-b2fe-4f33-bfd1-733ebb1d553e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:32.493162 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459c999-b2fe-4f33-bfd1-733ebb1d553e None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:32.494058 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459c999-b2fe-4f33-bfd1-733ebb1d553e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:32.495055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459c999-b2fe-4f33-bfd1-733ebb1d553e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:32.496978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459c999-b2fe-4f33-bfd1-733ebb1d553e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:32.507948 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47527a4b-350b-4452-a0aa-17c3059932ea None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:32.524760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 264/525] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:32.524760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459c999-b2fe-4f33-bfd1-733ebb1d553e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:32.562305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a8b8e-1392-4fac-9e77-57f4b78690b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:32.563560 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a8b8e-1392-4fac-9e77-57f4b78690b5 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:32.565212 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a8b8e-1392-4fac-9e77-57f4b78690b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:32.565724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a8b8e-1392-4fac-9e77-57f4b78690b5 None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:32.566568 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a8b8e-1392-4fac-9e77-57f4b78690b5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:32.567103 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a8b8e-1392-4fac-9e77-57f4b78690b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:32.568672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a8b8e-1392-4fac-9e77-57f4b78690b5 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:32.582979 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 262/526] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Oct 20 13:23:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:32.582979 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a8b8e-1392-4fac-9e77-57f4b78690b5 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:32.649945 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:32.694010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459c999-b2fe-4f33-bfd1-733ebb1d553e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:32.768296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e0854-0014-47d9-b46f-2439a4e16b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:32.769010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e0854-0014-47d9-b46f-2439a4e16b5f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:32.769446 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e0854-0014-47d9-b46f-2439a4e16b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:32.769549 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2e0854-0014-47d9-b46f-2439a4e16b5f None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:32.770583 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e0854-0014-47d9-b46f-2439a4e16b5f None admin] RBAC: Adding query filter params (name=network) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:32.770583 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e0854-0014-47d9-b46f-2439a4e16b5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:32.772086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2e0854-0014-47d9-b46f-2439a4e16b5f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:32.778824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 265/527] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Oct 20 13:23:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:32.793989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e0854-0014-47d9-b46f-2439a4e16b5f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:32.837427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a8b8e-1392-4fac-9e77-57f4b78690b5 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:32.870563 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:32.888475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402f9df-8209-49b7-ac24-8c2030c4b198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:32.889167 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402f9df-8209-49b7-ac24-8c2030c4b198 None admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:32.889449 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402f9df-8209-49b7-ac24-8c2030c4b198 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:32.889726 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402f9df-8209-49b7-ac24-8c2030c4b198 None admin] PATH_INFO: `/v3/projects/c25f337a79704728adaa03f4103eef1c/users/674c5b25932a41309428ba6c6c72ed02/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:32.896343 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402f9df-8209-49b7-ac24-8c2030c4b198 None admin] RBAC: Authorizing `identity:create_grant(project_id=c25f337a79704728adaa03f4103eef1c, user_id=674c5b25932a41309428ba6c6c72ed02, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:32.901603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a402f9df-8209-49b7-ac24-8c2030c4b198 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:32.928750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 263/528] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:23:32 2022] PUT /identity/v3/projects/c25f337a79704728adaa03f4103eef1c/users/674c5b25932a41309428ba6c6c72ed02/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:23:33.014912 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2e0854-0014-47d9-b46f-2439a4e16b5f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:33.090683 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea12919-b9a7-4bf9-881a-fa1060d7fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:33.091362 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea12919-b9a7-4bf9-881a-fa1060d7fbc1 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:33.091643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea12919-b9a7-4bf9-881a-fa1060d7fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:33.091915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea12919-b9a7-4bf9-881a-fa1060d7fbc1 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:33.092561 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea12919-b9a7-4bf9-881a-fa1060d7fbc1 None admin] RBAC: Adding query filter params (type=network) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:33.092866 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea12919-b9a7-4bf9-881a-fa1060d7fbc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:33.094311 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea12919-b9a7-4bf9-881a-fa1060d7fbc1 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:33.101142 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 266/529] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Oct 20 13:23:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:34.104188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8a56f-6882-42ca-95e4-e53b931863a8 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:34.104721 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8a56f-6882-42ca-95e4-e53b931863a8 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:34.104721 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8a56f-6882-42ca-95e4-e53b931863a8 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:34.106314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 264/530] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:34.112301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f2a30-cf3c-4787-9f88-5ad55935c801 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:34.112705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f2a30-cf3c-4787-9f88-5ad55935c801 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:34.112890 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f2a30-cf3c-4787-9f88-5ad55935c801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:34.131612 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0f8f2a30-cf3c-4787-9f88-5ad55935c801 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:34.133122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0f8f2a30-cf3c-4787-9f88-5ad55935c801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:34.137168 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:34.208057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 267/531] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 20 13:23:34.480781 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8a56f-6882-42ca-95e4-e53b931863a8 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:34.596500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8a56f-6882-42ca-95e4-e53b931863a8 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:34.640869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31163ba6-c695-4c36-8c09-348f34bac7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:34.641973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163ba6-c695-4c36-8c09-348f34bac7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:34.642519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163ba6-c695-4c36-8c09-348f34bac7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:34.643083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163ba6-c695-4c36-8c09-348f34bac7f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:34.656583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31163ba6-c695-4c36-8c09-348f34bac7f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:34.663061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-31163ba6-c695-4c36-8c09-348f34bac7f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:23:34.663061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:34.663061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:34.663061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:34.663061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:34.663061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:34.663061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:34.663061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:34.663061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:34.663061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:34.663061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:34.663061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:34.663061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:34.663061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:34.663061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:34.663061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:34.663942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:34.663942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:34.663942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:34.663942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:34.663942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:34.663942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:34.663942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:34.663942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:34.663942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:34.663942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:34.663942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:34.663942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:34.663942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:34.663942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:34.663942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:34.663942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:34.664761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:34.664761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:34.664761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:34.664761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:34.664761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:34.664761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:34.664761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:34.664761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:34.664761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:34.664761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:34.664761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:23:34.664761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:34.667724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 265/532] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:23:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:34.674405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f2a30-cf3c-4787-9f88-5ad55935c801 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:34.779236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f2a30-cf3c-4787-9f88-5ad55935c801 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:34.819746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6da7c0-3e72-493a-8832-560a26f3d771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:34.820813 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6da7c0-3e72-493a-8832-560a26f3d771 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:34.821321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6da7c0-3e72-493a-8832-560a26f3d771 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:34.821793 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6da7c0-3e72-493a-8832-560a26f3d771 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:34.822681 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6da7c0-3e72-493a-8832-560a26f3d771 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:34.823218 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6da7c0-3e72-493a-8832-560a26f3d771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:34.824804 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6da7c0-3e72-493a-8832-560a26f3d771 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:34.835506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 268/533] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:23:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:34.841523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31163ba6-c695-4c36-8c09-348f34bac7f0 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:34.910232 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:34.962412 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89710d17-76cc-44f7-bf73-eb21d9195440 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:34.963087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89710d17-76cc-44f7-bf73-eb21d9195440 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:34.963566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89710d17-76cc-44f7-bf73-eb21d9195440 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:34.965357 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 269/534] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:34.970191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4a5d-4456-4d71-b30f-adab4b2cda13 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:34.970757 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4a5d-4456-4d71-b30f-adab4b2cda13 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:34.971255 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4a5d-4456-4d71-b30f-adab4b2cda13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:34.982834 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:34.985399 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31163ba6-c695-4c36-8c09-348f34bac7f0 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:35.005602 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-519e4a5d-4456-4d71-b30f-adab4b2cda13 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:35.010468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-519e4a5d-4456-4d71-b30f-adab4b2cda13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:35.026311 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185057f-c462-479f-af12-bb7c95a00ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:35.026965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185057f-c462-479f-af12-bb7c95a00ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:35.027250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185057f-c462-479f-af12-bb7c95a00ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:35.027524 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185057f-c462-479f-af12-bb7c95a00ad5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:35.055241 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185057f-c462-479f-af12-bb7c95a00ad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:35.056744 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185057f-c462-479f-af12-bb7c95a00ad5 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:35.080169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-4185057f-c462-479f-af12-bb7c95a00ad5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:35.080169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:35.080169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:35.080169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:35.080169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:35.080169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:35.080169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:35.080169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:35.080169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:35.080169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:35.080169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:35.080169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:35.080169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:35.080169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:35.080169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:35.080169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:35.081247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:35.081247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:35.081247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:35.081247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:35.081247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:35.081247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:35.081247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:35.081247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:35.081247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:35.081247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:35.081247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:35.081247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:35.081247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:35.081247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:35.081247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:35.081247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:35.081247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:35.082114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:35.082114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:35.082114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:35.087366 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 266/535] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:35.094348 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185057f-c462-479f-af12-bb7c95a00ad5 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:35.107024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 270/536] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:35.209407 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:35.214788 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185057f-c462-479f-af12-bb7c95a00ad5 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:35.265306 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881cd90-5278-47f2-9984-8d55bab508d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:35.266307 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881cd90-5278-47f2-9984-8d55bab508d1 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:35.267360 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881cd90-5278-47f2-9984-8d55bab508d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:35.267922 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881cd90-5278-47f2-9984-8d55bab508d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:35.268767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881cd90-5278-47f2-9984-8d55bab508d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:35.269288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881cd90-5278-47f2-9984-8d55bab508d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:35.270851 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881cd90-5278-47f2-9984-8d55bab508d1 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:35.288448 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 267/537] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:35.294541 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e4a5d-4456-4d71-b30f-adab4b2cda13 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:35.307750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00be1c-ab39-448c-a32a-f2a47d27c75d None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:35.309997 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00be1c-ab39-448c-a32a-f2a47d27c75d None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:35.310513 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00be1c-ab39-448c-a32a-f2a47d27c75d None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:35.313535 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 268/538] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:35.319824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da298a-5a27-4a31-bbd9-648703143b44 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:35.320369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da298a-5a27-4a31-bbd9-648703143b44 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:35.320841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da298a-5a27-4a31-bbd9-648703143b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:35.356596 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-83da298a-5a27-4a31-bbd9-648703143b44 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:35.359163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-83da298a-5a27-4a31-bbd9-648703143b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:35.481676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e4a5d-4456-4d71-b30f-adab4b2cda13 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:35.502206 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 269/539] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:35.519339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:35.530692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13714b-7dcf-4038-b132-db14ba59ca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:35.531352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13714b-7dcf-4038-b132-db14ba59ca02 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:35.531711 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13714b-7dcf-4038-b132-db14ba59ca02 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:35.531989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13714b-7dcf-4038-b132-db14ba59ca02 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:35.533684 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da298a-5a27-4a31-bbd9-648703143b44 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:35.545813 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13714b-7dcf-4038-b132-db14ba59ca02 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:35.547436 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13714b-7dcf-4038-b132-db14ba59ca02 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:35.568024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-6c13714b-7dcf-4038-b132-db14ba59ca02 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 20 13:23:35.568024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:35.568024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:35.568024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:35.568024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:35.568024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:35.568024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:35.568024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:35.568024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:35.568024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:35.568024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:35.568024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:35.568024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:35.568024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:35.568024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:35.568024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:35.568980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:35.569931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:35.569931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:35.569931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:35.569931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:35.569931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:35.569931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:35.569931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:35.569931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:35.569931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 20 13:23:35.569931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:35.573191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 271/540] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:23:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:35.581373 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13714b-7dcf-4038-b132-db14ba59ca02 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:35.672455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:35.703207 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da298a-5a27-4a31-bbd9-648703143b44 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:35.774436 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df244f7-e74d-433e-b091-9c764cbbf141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:35.775114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df244f7-e74d-433e-b091-9c764cbbf141 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:35.775393 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df244f7-e74d-433e-b091-9c764cbbf141 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:35.775664 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df244f7-e74d-433e-b091-9c764cbbf141 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:35.788375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df244f7-e74d-433e-b091-9c764cbbf141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:35.793409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-7df244f7-e74d-433e-b091-9c764cbbf141 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:35.793409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:35.793409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:35.793409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:35.793409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:35.793409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:35.793409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:35.793409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:35.793409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:35.793409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:35.793409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:35.793409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:35.793409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:35.793409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:35.793409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:35.793409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:35.794347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:35.794347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:35.794347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:35.794347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:35.794347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:35.794347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:35.794347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:35.794347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:35.794347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:35.794347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:35.794347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:35.794347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:35.794347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:35.794347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:35.794347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:35.794347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:35.795248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:35.795248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:35.795248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:35.795248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:35.795248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:35.795248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:35.795248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:35.795248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:35.795248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:35.795248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:35.795248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:35.795248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:35.795874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 270/541] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Oct 20 13:23:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:35.800927 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df244f7-e74d-433e-b091-9c764cbbf141 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:35.809341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13714b-7dcf-4038-b132-db14ba59ca02 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:35.865862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaad80d-82ef-4829-939b-79c65e31eaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:35.866402 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaad80d-82ef-4829-939b-79c65e31eaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:35.866686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaad80d-82ef-4829-939b-79c65e31eaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:35.866999 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaad80d-82ef-4829-939b-79c65e31eaa6 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:35.870365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaad80d-82ef-4829-939b-79c65e31eaa6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:35.870365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaad80d-82ef-4829-939b-79c65e31eaa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:35.870365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaad80d-82ef-4829-939b-79c65e31eaa6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:35.896680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 272/542] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Oct 20 13:23:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:35.896680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3a40e-4d0c-4b5f-b7b0-adb8d8889486 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:35.896680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3a40e-4d0c-4b5f-b7b0-adb8d8889486 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:35.896680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3a40e-4d0c-4b5f-b7b0-adb8d8889486 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:35.896680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 273/543] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:35.897148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3a40e-4d0c-4b5f-b7b0-adb8d8889486 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:35.951737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df244f7-e74d-433e-b091-9c764cbbf141 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:35.955987 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:35.988615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c889ef-331c-4a9e-8680-9f03e2c39dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:35.989295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c889ef-331c-4a9e-8680-9f03e2c39dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:35.989573 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c889ef-331c-4a9e-8680-9f03e2c39dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:35.990080 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c889ef-331c-4a9e-8680-9f03e2c39dd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:35.990495 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c889ef-331c-4a9e-8680-9f03e2c39dd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:35.990805 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c889ef-331c-4a9e-8680-9f03e2c39dd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:35.992201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c889ef-331c-4a9e-8680-9f03e2c39dd0 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:36.000044 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 271/544] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Oct 20 13:23:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:36.000820 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c889ef-331c-4a9e-8680-9f03e2c39dd0 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:36.010283 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3a40e-4d0c-4b5f-b7b0-adb8d8889486 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:36.014129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:36.045347 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72028e9-8aef-40dd-b17d-9b4037f6536b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:36.045954 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72028e9-8aef-40dd-b17d-9b4037f6536b None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:36.046241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72028e9-8aef-40dd-b17d-9b4037f6536b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:36.046511 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72028e9-8aef-40dd-b17d-9b4037f6536b None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:36.047191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72028e9-8aef-40dd-b17d-9b4037f6536b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:36.048779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72028e9-8aef-40dd-b17d-9b4037f6536b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:36.064003 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 274/545] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Oct 20 13:23:35 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:23:36.065345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efc74d-5ee2-458b-9a4a-070e6d8c8626 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:36.065636 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efc74d-5ee2-458b-9a4a-070e6d8c8626 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:36.065912 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efc74d-5ee2-458b-9a4a-070e6d8c8626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:36.085217 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c0efc74d-5ee2-458b-9a4a-070e6d8c8626 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:36.086468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c0efc74d-5ee2-458b-9a4a-070e6d8c8626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:36.114720 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c889ef-331c-4a9e-8680-9f03e2c39dd0 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:36.162731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808d29b-c8ed-4672-91a6-0cf3aad27a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:36.163835 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808d29b-c8ed-4672-91a6-0cf3aad27a01 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:36.164123 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808d29b-c8ed-4672-91a6-0cf3aad27a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:36.164399 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808d29b-c8ed-4672-91a6-0cf3aad27a01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:36.176613 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 275/546] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:36 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:36.176613 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b9460-73b4-4d9b-bd0c-3b6936753851 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:36.176613 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b9460-73b4-4d9b-bd0c-3b6936753851 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:36.176613 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b9460-73b4-4d9b-bd0c-3b6936753851 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:36.176613 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 276/547] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:36.176613 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b9460-73b4-4d9b-bd0c-3b6936753851 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:36.184160 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808d29b-c8ed-4672-91a6-0cf3aad27a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:36.185724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808d29b-c8ed-4672-91a6-0cf3aad27a01 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:36.203288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-f808d29b-c8ed-4672-91a6-0cf3aad27a01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:36.203288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:36.203288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:36.203288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:36.203288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:36.203288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:36.203288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:36.203288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:36.203288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:36.203288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:36.203288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:36.203288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:36.203288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:36.203288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:36.203288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:36.203288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:36.204634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:36.204634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:36.204634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:36.204634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:36.204634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:36.204634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:36.204634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:36.204634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:36.204634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:36.204634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:36.204634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:36.204634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:36.204634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:36.204634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:36.204634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:36.204634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:36.204634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:36.205591 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:36.205591 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:36.205591 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:36.205591 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 272/548] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:36.206488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de6534-119f-490f-9783-41ab453cdd96 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:36.206990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de6534-119f-490f-9783-41ab453cdd96 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:36.209286 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de6534-119f-490f-9783-41ab453cdd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:36.228109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-63de6534-119f-490f-9783-41ab453cdd96 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:36.229544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-63de6534-119f-490f-9783-41ab453cdd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:36.238119 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:36.307223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:36.315767 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b9460-73b4-4d9b-bd0c-3b6936753851 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:36.331756 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 273/549] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:36 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 20 13:23:36.332997 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de6534-119f-490f-9783-41ab453cdd96 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:36.355367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628efc6b-198e-41a4-a7d1-f7793785f736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:36.356003 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628efc6b-198e-41a4-a7d1-f7793785f736 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:36.356280 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628efc6b-198e-41a4-a7d1-f7793785f736 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:36.356616 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628efc6b-198e-41a4-a7d1-f7793785f736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:36.368851 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628efc6b-198e-41a4-a7d1-f7793785f736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:36.370991 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628efc6b-198e-41a4-a7d1-f7793785f736 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:36.389318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-628efc6b-198e-41a4-a7d1-f7793785f736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:36.389318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:36.389318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:36.389318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:36.389318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:36.389318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:36.389318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:36.389318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:36.389318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:36.389318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:36.389318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:36.389318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:36.389318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:36.389318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:36.389318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:36.389318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:36.390393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:36.390393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:36.390393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:36.390393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:36.390393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:36.390393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:36.390393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:36.390393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:36.390393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:36.390393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:36.390393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:36.390393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:36.390393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:36.390393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:36.390393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:36.390393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:36.390393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:36.391334 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:36.391334 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:36.391334 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:36.394668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 277/550] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:36.396469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628efc6b-198e-41a4-a7d1-f7793785f736 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:36.460355 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de6534-119f-490f-9783-41ab453cdd96 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:36.497750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73e118-82d0-4e6a-9261-be6d71c26006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:36.498470 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e118-82d0-4e6a-9261-be6d71c26006 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:36.498754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e118-82d0-4e6a-9261-be6d71c26006 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:36.499182 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e118-82d0-4e6a-9261-be6d71c26006 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:36.499833 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73e118-82d0-4e6a-9261-be6d71c26006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:36.500145 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73e118-82d0-4e6a-9261-be6d71c26006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:36.501588 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73e118-82d0-4e6a-9261-be6d71c26006 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:36.517135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 274/551] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:36.518133 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73e118-82d0-4e6a-9261-be6d71c26006 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:36.528055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:36.541019 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628efc6b-198e-41a4-a7d1-f7793785f736 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:36.574052 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:36.589164 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ca8ca-3c1b-408b-a6ee-3e68d551cf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:36.590037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ca8ca-3c1b-408b-a6ee-3e68d551cf4a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:36.590319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ca8ca-3c1b-408b-a6ee-3e68d551cf4a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:36.590593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ca8ca-3c1b-408b-a6ee-3e68d551cf4a None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:36.591301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ca8ca-3c1b-408b-a6ee-3e68d551cf4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:36.591607 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ca8ca-3c1b-408b-a6ee-3e68d551cf4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:36.593135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ca8ca-3c1b-408b-a6ee-3e68d551cf4a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:36.609638 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 278/552] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:36.611027 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ca8ca-3c1b-408b-a6ee-3e68d551cf4a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:36.634422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73e118-82d0-4e6a-9261-be6d71c26006 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:36.672712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fc2d4-22fa-4138-b09f-da38c45a494a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:36.673385 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fc2d4-22fa-4138-b09f-da38c45a494a None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:36.673721 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fc2d4-22fa-4138-b09f-da38c45a494a None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:36.673998 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fc2d4-22fa-4138-b09f-da38c45a494a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:36.684699 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fc2d4-22fa-4138-b09f-da38c45a494a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:36.690759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-9e5fc2d4-22fa-4138-b09f-da38c45a494a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:23:36.690759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:36.690759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:36.690759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:36.690759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:36.690759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:36.690759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:36.690759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:36.690759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:36.690759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:36.690759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:36.690759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:36.690759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:36.690759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:36.690759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:36.690759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:36.691707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:36.691707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:36.691707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:36.691707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:36.691707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:36.691707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:36.691707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:36.691707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:36.691707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:36.691707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:36.691707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:36.691707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:36.691707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:36.691707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:36.691707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:36.691707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:36.692520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:36.692520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:36.692520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:36.692520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:36.692520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:36.692520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:36.692520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:36.692520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:36.692520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:36.692520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:36.692520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:23:36.692520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:36.692520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 275/553] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:23:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:36.693181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fc2d4-22fa-4138-b09f-da38c45a494a None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:36.732480 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ca8ca-3c1b-408b-a6ee-3e68d551cf4a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:36.768716 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cad32-f8ac-4cce-9db3-c5b119fba94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:36.769344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cad32-f8ac-4cce-9db3-c5b119fba94c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:36.769622 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cad32-f8ac-4cce-9db3-c5b119fba94c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:36.769897 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cad32-f8ac-4cce-9db3-c5b119fba94c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:36.777179 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cad32-f8ac-4cce-9db3-c5b119fba94c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:36.778643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cad32-f8ac-4cce-9db3-c5b119fba94c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:36.789830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-2c8cad32-f8ac-4cce-9db3-c5b119fba94c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:36.789830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:36.789830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:36.789830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:36.789830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:36.789830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:36.789830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:36.789830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:36.789830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:36.789830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:36.789830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:36.789830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:36.789830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:36.789830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:36.789830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:36.790941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:36.790941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:36.790941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:36.790941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:36.790941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:36.790941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:36.790941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:36.790941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:36.790941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:36.790941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:36.790941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:36.790941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:36.790941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:36.790941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:36.790941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:36.790941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:36.790941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:36.791838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:36.791838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:36.791838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:36.791838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:36.791838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:36.791838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:36.791838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:36.791838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:36.791838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 279/554] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:36.792330 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cad32-f8ac-4cce-9db3-c5b119fba94c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:36.804310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fc2d4-22fa-4138-b09f-da38c45a494a None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:36.807959 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:36.814997 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:36.841543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf0977-2319-450e-a24f-eeb7d2471800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:36.842174 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf0977-2319-450e-a24f-eeb7d2471800 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:36.842456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf0977-2319-450e-a24f-eeb7d2471800 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:36.842731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf0977-2319-450e-a24f-eeb7d2471800 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:36.852193 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf0977-2319-450e-a24f-eeb7d2471800 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:36.853648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf0977-2319-450e-a24f-eeb7d2471800 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:36.865924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-3caf0977-2319-450e-a24f-eeb7d2471800 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 13:23:36.865924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:36.865924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:36.865924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:36.865924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:36.865924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:36.865924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:36.865924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:36.865924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:36.865924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:36.865924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:36.865924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:36.865924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:36.865924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:36.865924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:36.865924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:36.867109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:36.868260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:36.868260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:36.868260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:36.868260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:36.868260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:36.868260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:36.868260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:36.868260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:36.868260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 13:23:36.868260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:36.872523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 276/555] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Oct 20 13:23:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:36.872736 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf0977-2319-450e-a24f-eeb7d2471800 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:36.905572 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cad32-f8ac-4cce-9db3-c5b119fba94c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:36.942692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d14f55-a2e2-447b-8837-f6632a8a2d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:36.944191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d14f55-a2e2-447b-8837-f6632a8a2d92 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:36.944892 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d14f55-a2e2-447b-8837-f6632a8a2d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:36.945316 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d14f55-a2e2-447b-8837-f6632a8a2d92 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:36.946113 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d14f55-a2e2-447b-8837-f6632a8a2d92 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:36.947641 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d14f55-a2e2-447b-8837-f6632a8a2d92 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:36.971124 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 280/556] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Oct 20 13:23:36 2022] POST /identity/v3/services => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:23:36.971124 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d14f55-a2e2-447b-8837-f6632a8a2d92 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:36.991951 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf0977-2319-450e-a24f-eeb7d2471800 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:37.049062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87302db-e984-4e8d-b4c3-5b5fe62ddf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:37.050103 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87302db-e984-4e8d-b4c3-5b5fe62ddf60 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:37.050798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87302db-e984-4e8d-b4c3-5b5fe62ddf60 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:37.051340 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87302db-e984-4e8d-b4c3-5b5fe62ddf60 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:37.052826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87302db-e984-4e8d-b4c3-5b5fe62ddf60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:37.053648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87302db-e984-4e8d-b4c3-5b5fe62ddf60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:37.055506 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87302db-e984-4e8d-b4c3-5b5fe62ddf60 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:37.055812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:37.069027 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 277/557] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:23:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:37.070908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87302db-e984-4e8d-b4c3-5b5fe62ddf60 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:37.105719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d14f55-a2e2-447b-8837-f6632a8a2d92 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:37.106619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:37.148463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973b9e7-6355-47f8-9ce2-71bcff980446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:37.149059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973b9e7-6355-47f8-9ce2-71bcff980446 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:37.149334 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973b9e7-6355-47f8-9ce2-71bcff980446 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:37.149605 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973b9e7-6355-47f8-9ce2-71bcff980446 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:37.150293 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973b9e7-6355-47f8-9ce2-71bcff980446 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:37.150596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973b9e7-6355-47f8-9ce2-71bcff980446 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:37.152115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973b9e7-6355-47f8-9ce2-71bcff980446 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:37.165606 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 281/558] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:37.166709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973b9e7-6355-47f8-9ce2-71bcff980446 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:37.211929 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87302db-e984-4e8d-b4c3-5b5fe62ddf60 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:37.253716 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb1e74-df80-4710-ab64-a2269fbea300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:37.254426 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb1e74-df80-4710-ab64-a2269fbea300 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:37.254426 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb1e74-df80-4710-ab64-a2269fbea300 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:37.254710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb1e74-df80-4710-ab64-a2269fbea300 None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:37.255429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb1e74-df80-4710-ab64-a2269fbea300 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:37.255738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb1e74-df80-4710-ab64-a2269fbea300 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:37.257159 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb1e74-df80-4710-ab64-a2269fbea300 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:37.281042 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 278/559] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Oct 20 13:23:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:37.281882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb1e74-df80-4710-ab64-a2269fbea300 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:37.296151 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973b9e7-6355-47f8-9ce2-71bcff980446 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:37.335865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:37.343432 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b25eb4-e4f9-49f6-b894-16a18bcae8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:37.344309 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b25eb4-e4f9-49f6-b894-16a18bcae8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:37.344973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b25eb4-e4f9-49f6-b894-16a18bcae8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:37.345971 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b25eb4-e4f9-49f6-b894-16a18bcae8d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:37.360808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b25eb4-e4f9-49f6-b894-16a18bcae8d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:37.363182 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b25eb4-e4f9-49f6-b894-16a18bcae8d6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:37.382455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:37.383294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-56b25eb4-e4f9-49f6-b894-16a18bcae8d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:37.383294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:37.383294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:37.383294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:37.383294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:37.383294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:37.383294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:37.383294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:37.383294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:37.383294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:37.383294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:37.383294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:37.383294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:37.383294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:37.383294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:37.383294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:37.384181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:37.384181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:37.384181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:37.384181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:37.384181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:37.384181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:37.384181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:37.384181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:37.384181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:37.384181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:37.384181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:37.384181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:37.384181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:37.384181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:37.384181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:37.384181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:37.384181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:37.385046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:37.385046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:37.385046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:37.392143 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 282/560] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:37.392771 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b25eb4-e4f9-49f6-b894-16a18bcae8d6 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:37.407461 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb1e74-df80-4710-ab64-a2269fbea300 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:37.452842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d48dfe-ae4a-42aa-8399-0dc5e43a163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:37.454473 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d48dfe-ae4a-42aa-8399-0dc5e43a163a None admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:37.455349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d48dfe-ae4a-42aa-8399-0dc5e43a163a None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:37.455854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d48dfe-ae4a-42aa-8399-0dc5e43a163a None admin] PATH_INFO: `/v3/projects/c25f337a79704728adaa03f4103eef1c/users/c893e6388ed340eca17da2e279ca34a9/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:37.458762 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d48dfe-ae4a-42aa-8399-0dc5e43a163a None admin] RBAC: Authorizing `identity:create_grant(project_id=c25f337a79704728adaa03f4103eef1c, user_id=c893e6388ed340eca17da2e279ca34a9, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:37.461153 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d48dfe-ae4a-42aa-8399-0dc5e43a163a None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:37.487145 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 279/561] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:23:37 2022] PUT /identity/v3/projects/c25f337a79704728adaa03f4103eef1c/users/c893e6388ed340eca17da2e279ca34a9/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:23:37.488155 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d48dfe-ae4a-42aa-8399-0dc5e43a163a None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:37.507908 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b25eb4-e4f9-49f6-b894-16a18bcae8d6 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:37.555868 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b42968-32b0-47e5-adcf-71de234376ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:37.557074 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b42968-32b0-47e5-adcf-71de234376ff None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:37.558003 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b42968-32b0-47e5-adcf-71de234376ff None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:37.558497 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b42968-32b0-47e5-adcf-71de234376ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:37.574545 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b42968-32b0-47e5-adcf-71de234376ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:37.576622 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b42968-32b0-47e5-adcf-71de234376ff None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:37.597384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-46b42968-32b0-47e5-adcf-71de234376ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:37.597384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:37.597384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:37.597384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:37.597384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:37.597384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:37.597384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:37.597384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:37.597384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:37.597384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:37.597384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:37.597384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:37.597384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:37.597384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:37.597384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:37.597384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:37.598418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:37.598418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:37.598418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:37.598418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:37.598418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:37.598418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:37.598418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:37.598418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:37.598418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:37.598418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:37.598418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:37.598418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:37.598418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:37.598418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:37.598418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:37.598418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:37.598418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:37.599338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:37.599338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:37.599338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:37.600347 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 283/562] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:37.612027 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b42968-32b0-47e5-adcf-71de234376ff None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:37.628288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d48dfe-ae4a-42aa-8399-0dc5e43a163a None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:37.671738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046a831-b3b7-4250-8e5f-b8f212c7232e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:37.673006 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046a831-b3b7-4250-8e5f-b8f212c7232e None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:37.673525 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046a831-b3b7-4250-8e5f-b8f212c7232e None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:37.674002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046a831-b3b7-4250-8e5f-b8f212c7232e None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:37.674879 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046a831-b3b7-4250-8e5f-b8f212c7232e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:37.675564 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046a831-b3b7-4250-8e5f-b8f212c7232e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:37.677176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c046a831-b3b7-4250-8e5f-b8f212c7232e None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:37.691993 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 280/563] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:37.698171 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046a831-b3b7-4250-8e5f-b8f212c7232e None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:37.703319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:37.761303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:37.836632 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046a831-b3b7-4250-8e5f-b8f212c7232e None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:37.843331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b42968-32b0-47e5-adcf-71de234376ff None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:37.885120 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae2e46-b290-424c-bb38-b2bb2a5677a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:37.886270 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae2e46-b290-424c-bb38-b2bb2a5677a5 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:37.886768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae2e46-b290-424c-bb38-b2bb2a5677a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:37.887274 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae2e46-b290-424c-bb38-b2bb2a5677a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:37.897584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22489de-75c9-4b66-8988-bddaa4068938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:37.898198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22489de-75c9-4b66-8988-bddaa4068938 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:37.898477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22489de-75c9-4b66-8988-bddaa4068938 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:37.898750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22489de-75c9-4b66-8988-bddaa4068938 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:37.899449 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22489de-75c9-4b66-8988-bddaa4068938 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:37.899754 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22489de-75c9-4b66-8988-bddaa4068938 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:37.900278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae2e46-b290-424c-bb38-b2bb2a5677a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:37.901122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22489de-75c9-4b66-8988-bddaa4068938 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:37.902137 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae2e46-b290-424c-bb38-b2bb2a5677a5 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:37.913922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 284/564] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:37.921575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-2aae2e46-b290-424c-bb38-b2bb2a5677a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 13:23:37.921575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:37.921575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:37.921575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:37.921575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:37.921575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:37.921575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:37.921575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:37.921575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:37.921575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:37.921575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:37.921575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:37.921575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:37.921575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:37.921575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:37.921575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:37.922496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:37.923977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:37.923977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:37.923977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:37.923977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:37.923977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:37.923977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:37.923977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:37.923977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:37.923977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 13:23:37.923977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:37.926554 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 281/565] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Oct 20 13:23:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:23:37.932398 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22489de-75c9-4b66-8988-bddaa4068938 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:37.932787 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae2e46-b290-424c-bb38-b2bb2a5677a5 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:38.063730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:38.116936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:38.124047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22489de-75c9-4b66-8988-bddaa4068938 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:38.134108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae2e46-b290-424c-bb38-b2bb2a5677a5 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:38.189514 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c508fed-949b-4e54-a7be-366bfbe413e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:38.190158 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c508fed-949b-4e54-a7be-366bfbe413e1 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:38.190436 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c508fed-949b-4e54-a7be-366bfbe413e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:38.190711 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c508fed-949b-4e54-a7be-366bfbe413e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:38.199210 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c9a18-df66-4419-b4c2-5c819b423f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:38.199827 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c9a18-df66-4419-b4c2-5c819b423f3a None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:38.200107 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c9a18-df66-4419-b4c2-5c819b423f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:38.200380 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c9a18-df66-4419-b4c2-5c819b423f3a None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:38.201111 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c9a18-df66-4419-b4c2-5c819b423f3a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:38.201419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c9a18-df66-4419-b4c2-5c819b423f3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:38.202855 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c9a18-df66-4419-b4c2-5c819b423f3a None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:38.207825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c508fed-949b-4e54-a7be-366bfbe413e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:38.209285 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c508fed-949b-4e54-a7be-366bfbe413e1 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:38.230926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-5c508fed-949b-4e54-a7be-366bfbe413e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:38.230926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:38.230926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:38.230926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:38.230926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:38.230926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:38.230926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:38.230926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:38.230926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:38.230926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:38.230926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:38.230926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:38.230926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:38.230926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:38.230926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:38.231891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:38.231891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:38.231891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:38.231891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:38.231891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:38.231891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:38.231891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:38.231891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:38.231891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:38.231891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:38.231891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:38.231891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:38.231891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:38.231891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:38.231891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:38.231891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:38.231891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:38.233092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:38.233092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:38.233092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:38.233092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:38.233092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:38.233092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:38.233092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:38.233092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:38.233092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 285/566] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:38.236455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 282/567] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Oct 20 13:23:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:38.239839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c508fed-949b-4e54-a7be-366bfbe413e1 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:38.245041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c9a18-df66-4419-b4c2-5c819b423f3a None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:38.396794 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c508fed-949b-4e54-a7be-366bfbe413e1 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:38.411821 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c9a18-df66-4419-b4c2-5c819b423f3a None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:38.439780 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:38.450745 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d705a-c163-4aa9-899b-59f15b04a684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:38.451445 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d705a-c163-4aa9-899b-59f15b04a684 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:38.451798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d705a-c163-4aa9-899b-59f15b04a684 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:38.452142 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d705a-c163-4aa9-899b-59f15b04a684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:38.483694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb654fd-ee1c-494e-95f4-4c3735ded359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:38.484601 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb654fd-ee1c-494e-95f4-4c3735ded359 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:38.485033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb654fd-ee1c-494e-95f4-4c3735ded359 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:38.486011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb654fd-ee1c-494e-95f4-4c3735ded359 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:38.487058 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb654fd-ee1c-494e-95f4-4c3735ded359 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:38.487547 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb654fd-ee1c-494e-95f4-4c3735ded359 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:38.489141 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb654fd-ee1c-494e-95f4-4c3735ded359 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:38.521263 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 286/568] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:38.530516 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d705a-c163-4aa9-899b-59f15b04a684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:38.532691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d705a-c163-4aa9-899b-59f15b04a684 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:38.536008 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c47cd-e719-4035-a77e-93a72e915c6c None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:38.536542 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c47cd-e719-4035-a77e-93a72e915c6c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:38.537024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c47cd-e719-4035-a77e-93a72e915c6c None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:38.542994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 287/569] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:38.544012 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c47cd-e719-4035-a77e-93a72e915c6c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:38.599466 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:38.644454 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 283/570] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:23:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 20 13:23:38.646086 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d74bf-9aa5-4754-a1e2-2cd965bfe339 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:38.646330 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d74bf-9aa5-4754-a1e2-2cd965bfe339 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:38.646613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d74bf-9aa5-4754-a1e2-2cd965bfe339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:38.666232 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-3d6d74bf-9aa5-4754-a1e2-2cd965bfe339 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:38.667412 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c47cd-e719-4035-a77e-93a72e915c6c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:38.667528 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-3d6d74bf-9aa5-4754-a1e2-2cd965bfe339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:38.688186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:38.710597 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30ed8-4301-4c8b-af7c-b4f6ef3c9ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:38.711618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30ed8-4301-4c8b-af7c-b4f6ef3c9ed3 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:38.712146 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30ed8-4301-4c8b-af7c-b4f6ef3c9ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:38.712635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30ed8-4301-4c8b-af7c-b4f6ef3c9ed3 None admin] PATH_INFO: `/v3/projects/c25f337a79704728adaa03f4103eef1c/users/44342daa668c4516ae131d9f0160261f/roles/09686a35c48b45b49ee384e08ee11206` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:38.728621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd30ed8-4301-4c8b-af7c-b4f6ef3c9ed3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c25f337a79704728adaa03f4103eef1c, user_id=44342daa668c4516ae131d9f0160261f, role_id=09686a35c48b45b49ee384e08ee11206)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:38.730333 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd30ed8-4301-4c8b-af7c-b4f6ef3c9ed3 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:38.745066 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 284/571] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:38.746336 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d74bf-9aa5-4754-a1e2-2cd965bfe339 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:38.763110 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 288/572] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:23:38 2022] PUT /identity/v3/projects/c25f337a79704728adaa03f4103eef1c/users/44342daa668c4516ae131d9f0160261f/roles/09686a35c48b45b49ee384e08ee11206 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:23:38.902500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d74bf-9aa5-4754-a1e2-2cd965bfe339 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:38.952320 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae7e8c-2767-44e5-8596-ae5a46b63367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:38.953365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae7e8c-2767-44e5-8596-ae5a46b63367 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:38.953925 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae7e8c-2767-44e5-8596-ae5a46b63367 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:38.954502 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae7e8c-2767-44e5-8596-ae5a46b63367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:38.970461 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae7e8c-2767-44e5-8596-ae5a46b63367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:38.972594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae7e8c-2767-44e5-8596-ae5a46b63367 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:38.992062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-deae7e8c-2767-44e5-8596-ae5a46b63367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:38.992062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:38.992062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:38.992062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:38.992062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:38.992062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:38.992062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:38.992062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:38.992062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:38.992062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:38.992062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:38.992062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:38.992062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:38.992062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:38.992062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:38.992062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:38.993110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:38.993110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:38.993110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:38.993110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:38.993110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:38.993110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:38.993110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:38.993110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:38.993110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:38.993110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:38.993110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:38.993110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:38.993110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:38.993110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:38.993110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:38.993110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:38.993110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:38.993992 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:38.993992 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:38.993992 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:39.000163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 285/573] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:39.001989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30ed8-4301-4c8b-af7c-b4f6ef3c9ed3 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:39.077937 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:39.117648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30ed8-4301-4c8b-af7c-b4f6ef3c9ed3 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:39.120447 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae7e8c-2767-44e5-8596-ae5a46b63367 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:39.124779 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:39.186791 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9563a1-71cd-453e-bfbe-7e3d6dc80eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:39.187448 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9563a1-71cd-453e-bfbe-7e3d6dc80eec None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:39.187723 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9563a1-71cd-453e-bfbe-7e3d6dc80eec None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:39.187993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9563a1-71cd-453e-bfbe-7e3d6dc80eec None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:39.189237 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9563a1-71cd-453e-bfbe-7e3d6dc80eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:39.189542 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9563a1-71cd-453e-bfbe-7e3d6dc80eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:39.191041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9563a1-71cd-453e-bfbe-7e3d6dc80eec None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:39.216100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 289/574] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:39.221646 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9563a1-71cd-453e-bfbe-7e3d6dc80eec None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:39.320280 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae7e8c-2767-44e5-8596-ae5a46b63367 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:39.393622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0460817-899f-4023-ad42-ff45b5b4dd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:39.394263 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0460817-899f-4023-ad42-ff45b5b4dd17 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:39.394545 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0460817-899f-4023-ad42-ff45b5b4dd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:39.394817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0460817-899f-4023-ad42-ff45b5b4dd17 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:39.395832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0460817-899f-4023-ad42-ff45b5b4dd17 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:39.397217 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0460817-899f-4023-ad42-ff45b5b4dd17 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:39.406730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-b0460817-899f-4023-ad42-ff45b5b4dd17 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 13:23:39.406730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:39.406730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:23:39.406730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:23:39.406730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:23:39.406730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:23:39.406730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:23:39.406730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:39.406730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 13:23:39.406730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:39.406730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:39.406730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:39.406730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:39.406730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:39.406730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:39.406730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:39.406730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:39.407953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:39.407953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:39.407953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:39.407953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:39.407953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:39.407953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:39.407953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:23:39.407953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:23:39.407953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:23:39.407953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:23:39.407953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:39.407953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:39.407953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:39.407953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:39.407953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:39.407953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:39.408785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:39.408785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:39.408785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:39.408785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:39.408785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:39.408785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:39.408785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:39.408785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:39.408785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:39.408785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:39.408785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:23:39.408785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:39.408785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 13:23:39.408785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:39.408785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 286/575] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Oct 20 13:23:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:23:39.414003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0460817-899f-4023-ad42-ff45b5b4dd17 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:39.418639 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9563a1-71cd-453e-bfbe-7e3d6dc80eec None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:39.445793 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:39.463299 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8615b67-4220-4238-b27b-32bfc78ffe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:39.464028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8615b67-4220-4238-b27b-32bfc78ffe70 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:39.464369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8615b67-4220-4238-b27b-32bfc78ffe70 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:39.464703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8615b67-4220-4238-b27b-32bfc78ffe70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:39.472310 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8615b67-4220-4238-b27b-32bfc78ffe70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:39.473685 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8615b67-4220-4238-b27b-32bfc78ffe70 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:39.487439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-b8615b67-4220-4238-b27b-32bfc78ffe70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:39.487439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:39.487439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:39.487439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:39.487439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:39.487439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:39.487439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:39.487439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:39.487439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:39.487439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:39.487439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:39.487439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:39.487439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:39.487439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:39.487439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:39.488437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:39.488437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:39.488437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:39.488437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:39.488437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:39.488437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:39.488437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:39.488437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:39.488437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:39.488437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:39.488437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:39.488437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:39.488437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:39.488437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:39.488437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:39.488437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:39.488437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:39.489401 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:39.489401 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:39.489401 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:39.489401 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:39.489401 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:39.489401 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:39.489401 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:39.489401 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:39.492061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 290/576] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:23:39.493620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58333b8-380c-4b41-b5af-be2590f5939a None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:39.494161 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58333b8-380c-4b41-b5af-be2590f5939a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:39.494685 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58333b8-380c-4b41-b5af-be2590f5939a None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:39.496550 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 291/577] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:39.497457 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58333b8-380c-4b41-b5af-be2590f5939a None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:39.504647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:39.552947 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0460817-899f-4023-ad42-ff45b5b4dd17 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:39.599225 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbf4ef-ba9a-4883-b6d1-bec89f57cec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:39.600089 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbf4ef-ba9a-4883-b6d1-bec89f57cec9 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:39.600372 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbf4ef-ba9a-4883-b6d1-bec89f57cec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:39.600645 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbf4ef-ba9a-4883-b6d1-bec89f57cec9 None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:39.601631 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbf4ef-ba9a-4883-b6d1-bec89f57cec9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:39.601964 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbf4ef-ba9a-4883-b6d1-bec89f57cec9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:39.603370 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbf4ef-ba9a-4883-b6d1-bec89f57cec9 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:39.614932 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 287/578] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Oct 20 13:23:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:39.616440 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec175d6-b66e-450c-be0d-0dbfdd9a4129 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:39.616737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec175d6-b66e-450c-be0d-0dbfdd9a4129 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:39.617018 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec175d6-b66e-450c-be0d-0dbfdd9a4129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:39.624900 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58333b8-380c-4b41-b5af-be2590f5939a None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:39.639819 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-fec175d6-b66e-450c-be0d-0dbfdd9a4129 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:39.641186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-fec175d6-b66e-450c-be0d-0dbfdd9a4129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:39.664423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfb4b3-6e56-441f-a4aa-898615f25cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:39.666093 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfb4b3-6e56-441f-a4aa-898615f25cef None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:39.666579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfb4b3-6e56-441f-a4aa-898615f25cef None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:39.667095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfb4b3-6e56-441f-a4aa-898615f25cef None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:39.668142 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfb4b3-6e56-441f-a4aa-898615f25cef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:39.668678 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfb4b3-6e56-441f-a4aa-898615f25cef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:39.670421 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfb4b3-6e56-441f-a4aa-898615f25cef None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:39.684765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 292/579] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:39.686096 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfb4b3-6e56-441f-a4aa-898615f25cef None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:39.727118 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 288/580] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:39.728430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec175d6-b66e-450c-be0d-0dbfdd9a4129 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:39.759419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:39.855377 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:39.863684 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfb4b3-6e56-441f-a4aa-898615f25cef None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:39.922363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec175d6-b66e-450c-be0d-0dbfdd9a4129 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:39.961153 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9be77-1856-4909-9129-d9671f071ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:39.962199 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9be77-1856-4909-9129-d9671f071ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:39.962679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9be77-1856-4909-9129-d9671f071ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:39.963191 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9be77-1856-4909-9129-d9671f071ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:39.963637 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a847e31-9ccd-4200-b4d1-bd14fe5ae45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:39.964249 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a847e31-9ccd-4200-b4d1-bd14fe5ae45a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:39.964527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a847e31-9ccd-4200-b4d1-bd14fe5ae45a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:39.964777 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9be77-1856-4909-9129-d9671f071ab5 None admin] RBAC: Adding query filter params (role.id=9c0f227afc2e4a0aa404780de229488c, scope.project.id=c25f337a79704728adaa03f4103eef1c, user.id=674c5b25932a41309428ba6c6c72ed02) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:39.964880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a847e31-9ccd-4200-b4d1-bd14fe5ae45a None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:39.965383 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9be77-1856-4909-9129-d9671f071ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:39.965497 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a847e31-9ccd-4200-b4d1-bd14fe5ae45a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:39.965694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a847e31-9ccd-4200-b4d1-bd14fe5ae45a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:39.967075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a847e31-9ccd-4200-b4d1-bd14fe5ae45a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:39.967692 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9be77-1856-4909-9129-d9671f071ab5 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:39.975391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 289/581] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:23:39 2022] GET /identity/v3/role_assignments?user.id=674c5b25932a41309428ba6c6c72ed02&scope.project.id=c25f337a79704728adaa03f4103eef1c&role.id=9c0f227afc2e4a0aa404780de229488c => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:39.979634 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 293/582] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Oct 20 13:23:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:39.986158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9be77-1856-4909-9129-d9671f071ab5 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:40.099909 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579afc61-a832-4ab6-a13e-a2e4f7d5277a None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:40.100110 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579afc61-a832-4ab6-a13e-a2e4f7d5277a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:40.100360 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579afc61-a832-4ab6-a13e-a2e4f7d5277a None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:40.101958 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 294/583] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:40.107734 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7a4d8-853d-4fa1-a9d6-22fab459a35d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:40.108034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7a4d8-853d-4fa1-a9d6-22fab459a35d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:40.108292 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f7a4d8-853d-4fa1-a9d6-22fab459a35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:40.108680 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9be77-1856-4909-9129-d9671f071ab5 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:40.128187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-e1f7a4d8-853d-4fa1-a9d6-22fab459a35d None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:40.129419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e1f7a4d8-853d-4fa1-a9d6-22fab459a35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:40.139204 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:40.150631 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf3038-c221-4dd3-81b9-5c692025373b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:40.151900 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf3038-c221-4dd3-81b9-5c692025373b None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:40.152286 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf3038-c221-4dd3-81b9-5c692025373b None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:40.152663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acf3038-c221-4dd3-81b9-5c692025373b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:40.153493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf3038-c221-4dd3-81b9-5c692025373b None admin] RBAC: Adding query filter params (interface=public, service_id=ebab6bb587fa40a99abe4ba6f42e10b3, region_id=RegionOne) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:40.153967 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf3038-c221-4dd3-81b9-5c692025373b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:40.155546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acf3038-c221-4dd3-81b9-5c692025373b None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:40.164788 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 290/584] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Oct 20 13:23:39 2022] GET /identity/v3/endpoints?service_id=ebab6bb587fa40a99abe4ba6f42e10b3&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:40.165891 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf3038-c221-4dd3-81b9-5c692025373b None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:40.218996 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 295/585] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 13:23:40.218996 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7a4d8-853d-4fa1-a9d6-22fab459a35d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:40.280885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:40.302456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acf3038-c221-4dd3-81b9-5c692025373b None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:40.339648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68072eae-3d8e-41e0-9d89-d30343a9935b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:40.340285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68072eae-3d8e-41e0-9d89-d30343a9935b None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:40.340565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68072eae-3d8e-41e0-9d89-d30343a9935b None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:40.340833 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68072eae-3d8e-41e0-9d89-d30343a9935b None admin] PATH_INFO: `/v3/services/network` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:40.341422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68072eae-3d8e-41e0-9d89-d30343a9935b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:40.342896 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68072eae-3d8e-41e0-9d89-d30343a9935b None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:40.352649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-68072eae-3d8e-41e0-9d89-d30343a9935b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 13:23:40.352649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:40.352649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:23:40.352649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:23:40.352649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:23:40.352649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:23:40.352649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:23:40.352649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:40.352649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 13:23:40.352649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:40.352649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:40.352649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:40.352649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:40.352649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:40.352649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:40.352649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:40.352649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:40.353710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:40.353710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:40.353710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:40.353710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:40.353710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:40.353710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:40.353710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:23:40.353710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:23:40.353710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:23:40.353710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:23:40.353710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:40.353710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:40.353710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:40.353710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:40.353710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:40.353710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:40.354578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:40.354578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:40.354578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:40.354578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:40.354578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:40.354578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:40.354578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:40.354578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:40.354578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:40.354578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:40.354578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:23:40.354578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:40.354578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 13:23:40.354578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:40.360954 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 291/586] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:40 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:40.363800 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f7a4d8-853d-4fa1-a9d6-22fab459a35d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:40.367155 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68072eae-3d8e-41e0-9d89-d30343a9935b None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:40.403935 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751f6af-058c-40af-8836-169e0b7b7372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:40.405355 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751f6af-058c-40af-8836-169e0b7b7372 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:40.405840 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751f6af-058c-40af-8836-169e0b7b7372 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:40.406330 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751f6af-058c-40af-8836-169e0b7b7372 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:40.407358 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751f6af-058c-40af-8836-169e0b7b7372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:40.408979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751f6af-058c-40af-8836-169e0b7b7372 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:40.419396 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 296/587] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Oct 20 13:23:40 2022] GET /identity/v3/services => generated 772 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:40.478283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:40.554008 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68072eae-3d8e-41e0-9d89-d30343a9935b None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:40.561275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751f6af-058c-40af-8836-169e0b7b7372 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:40.604289 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e22890-c4b8-450b-95fe-6d0d507a52dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:40.604910 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e22890-c4b8-450b-95fe-6d0d507a52dd None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:40.605190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e22890-c4b8-450b-95fe-6d0d507a52dd None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:40.605460 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e22890-c4b8-450b-95fe-6d0d507a52dd None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:40.606222 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e22890-c4b8-450b-95fe-6d0d507a52dd None admin] RBAC: Adding query filter params (name=network) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:40.606525 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e22890-c4b8-450b-95fe-6d0d507a52dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:40.607938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e22890-c4b8-450b-95fe-6d0d507a52dd None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:40.619892 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 292/588] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Oct 20 13:23:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:40.627603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e22890-c4b8-450b-95fe-6d0d507a52dd None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:40.697765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751f6af-058c-40af-8836-169e0b7b7372 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:40.700286 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:40.737967 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe3d5f-c94a-4db5-bf6b-7783f0050430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:40.739005 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe3d5f-c94a-4db5-bf6b-7783f0050430 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:40.739599 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe3d5f-c94a-4db5-bf6b-7783f0050430 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:40.740095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe3d5f-c94a-4db5-bf6b-7783f0050430 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:40.751485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe3d5f-c94a-4db5-bf6b-7783f0050430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:40.757797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-1dbe3d5f-c94a-4db5-bf6b-7783f0050430 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:23:40.757797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:40.757797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:40.757797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:40.757797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:40.757797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:40.757797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:40.757797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:40.757797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:40.757797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:40.757797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:40.757797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:40.757797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:40.757797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:40.757797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:40.757797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:40.758750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:40.758750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:40.758750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:40.758750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:40.758750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:40.758750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:40.758750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:40.758750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:40.758750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:40.758750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:40.758750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:40.758750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:40.758750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:40.758750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:40.758750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:40.758750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:40.759653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:40.759653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:40.759653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:40.759653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:40.759653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:40.759653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:40.759653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:40.759653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:40.759653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:40.759653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:40.759653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:23:40.759653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:40.761038 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e22890-c4b8-450b-95fe-6d0d507a52dd None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:40.762113 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 297/589] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:23:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:23:40.769830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe3d5f-c94a-4db5-bf6b-7783f0050430 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:40.801580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:40.827530 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc2d6f-dabc-41bb-b874-58a29ebaf141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:40.828323 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc2d6f-dabc-41bb-b874-58a29ebaf141 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:40.830299 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc2d6f-dabc-41bb-b874-58a29ebaf141 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:40.830651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc2d6f-dabc-41bb-b874-58a29ebaf141 None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:40.831392 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc2d6f-dabc-41bb-b874-58a29ebaf141 None admin] RBAC: Adding query filter params (type=network) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:40.832481 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc2d6f-dabc-41bb-b874-58a29ebaf141 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:40.834698 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc2d6f-dabc-41bb-b874-58a29ebaf141 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:40.847489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 293/590] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Oct 20 13:23:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:40.853122 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc2d6f-dabc-41bb-b874-58a29ebaf141 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:40.972738 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe3d5f-c94a-4db5-bf6b-7783f0050430 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:41.037784 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc2d6f-dabc-41bb-b874-58a29ebaf141 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:41.039502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d41db8-a371-4ba2-854b-bc49f3e95077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:41.040445 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d41db8-a371-4ba2-854b-bc49f3e95077 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:41.042271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d41db8-a371-4ba2-854b-bc49f3e95077 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:41.042626 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d41db8-a371-4ba2-854b-bc49f3e95077 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:41.043399 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d41db8-a371-4ba2-854b-bc49f3e95077 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:41.045344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d41db8-a371-4ba2-854b-bc49f3e95077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:41.047519 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d41db8-a371-4ba2-854b-bc49f3e95077 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:41.068054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 298/591] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:23:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:41.074408 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d41db8-a371-4ba2-854b-bc49f3e95077 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:41.098506 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac75a72-417f-478b-9a57-1847c970c330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:41.099180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac75a72-417f-478b-9a57-1847c970c330 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:41.099540 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac75a72-417f-478b-9a57-1847c970c330 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:41.099891 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac75a72-417f-478b-9a57-1847c970c330 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:41.100671 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac75a72-417f-478b-9a57-1847c970c330 None admin] RBAC: Adding query filter params (interface=public, service_id=8964f320bdb144c8b5049215b02a4bac, region_id=RegionOne) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:41.101056 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac75a72-417f-478b-9a57-1847c970c330 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:41.102493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac75a72-417f-478b-9a57-1847c970c330 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:41.108028 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 294/592] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Oct 20 13:23:40 2022] GET /identity/v3/endpoints?service_id=8964f320bdb144c8b5049215b02a4bac&interface=public®ion_id=RegionOne => generated 194 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:41.116180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac75a72-417f-478b-9a57-1847c970c330 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:41.139327 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:41.208482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:41.254687 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d41db8-a371-4ba2-854b-bc49f3e95077 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:41.312551 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac75a72-417f-478b-9a57-1847c970c330 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:41.330281 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91485b1d-9c47-499d-ba43-3850df571c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:41.331059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91485b1d-9c47-499d-ba43-3850df571c2d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:41.331338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91485b1d-9c47-499d-ba43-3850df571c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:41.331608 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91485b1d-9c47-499d-ba43-3850df571c2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:41.345928 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91485b1d-9c47-499d-ba43-3850df571c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:41.347798 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91485b1d-9c47-499d-ba43-3850df571c2d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:41.353740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13184d-afcf-419c-ba20-d0232dd4ad5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:41.354619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13184d-afcf-419c-ba20-d0232dd4ad5a None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:41.355081 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13184d-afcf-419c-ba20-d0232dd4ad5a None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:41.355540 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13184d-afcf-419c-ba20-d0232dd4ad5a None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:41.356437 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13184d-afcf-419c-ba20-d0232dd4ad5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:41.357940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13184d-afcf-419c-ba20-d0232dd4ad5a None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:41.370979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-91485b1d-9c47-499d-ba43-3850df571c2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:41.370979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:41.370979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:41.370979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:41.370979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:41.370979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:41.370979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:41.370979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:41.370979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:41.370979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:41.370979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:41.370979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:41.370979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:41.370979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:41.370979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:41.370979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:41.372029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:41.372029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:41.372029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:41.372029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:41.372029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:41.372029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:41.372029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:41.372029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:41.372029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:41.372029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:41.372029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:41.372029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:41.372029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:41.372029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:41.372029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:41.372029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:41.372029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:41.372898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:41.372898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:41.372898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:41.372898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 299/593] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:41.372898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccc8fb-7312-44f4-baa5-c98bd7f9bc7f None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:41.372898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccc8fb-7312-44f4-baa5-c98bd7f9bc7f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:41.372898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccc8fb-7312-44f4-baa5-c98bd7f9bc7f None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:41.373303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 300/594] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:41.373747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 295/595] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Oct 20 13:23:41 2022] GET /identity/v3/services => generated 772 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:41.373914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccc8fb-7312-44f4-baa5-c98bd7f9bc7f None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:41.386260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b59a3-8492-4ab8-b8f5-f31efec700e8 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:41.386822 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b59a3-8492-4ab8-b8f5-f31efec700e8 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:41.387346 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b59a3-8492-4ab8-b8f5-f31efec700e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:41.422814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-e57b59a3-8492-4ab8-b8f5-f31efec700e8 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:41.424454 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e57b59a3-8492-4ab8-b8f5-f31efec700e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:41.489406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:41.539725 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccc8fb-7312-44f4-baa5-c98bd7f9bc7f None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:41.567272 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 296/596] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:41.600274 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc17d19-1676-4612-bbce-79a0fa8b10ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:41.600894 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc17d19-1676-4612-bbce-79a0fa8b10ad None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:41.601173 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc17d19-1676-4612-bbce-79a0fa8b10ad None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:41.601443 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc17d19-1676-4612-bbce-79a0fa8b10ad None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:41.602158 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc17d19-1676-4612-bbce-79a0fa8b10ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:41.602463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc17d19-1676-4612-bbce-79a0fa8b10ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:41.604115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc17d19-1676-4612-bbce-79a0fa8b10ad None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:41.624440 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 301/597] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:41.630943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b59a3-8492-4ab8-b8f5-f31efec700e8 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:41.678628 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:41.739707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b59a3-8492-4ab8-b8f5-f31efec700e8 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:41.775920 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f90f8-1479-4027-9317-0c0984fbc362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:41.776554 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f90f8-1479-4027-9317-0c0984fbc362 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:41.776834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f90f8-1479-4027-9317-0c0984fbc362 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:41.777105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f90f8-1479-4027-9317-0c0984fbc362 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:41.785177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f90f8-1479-4027-9317-0c0984fbc362 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:41.786615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f90f8-1479-4027-9317-0c0984fbc362 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:41.799083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-dd2f90f8-1479-4027-9317-0c0984fbc362 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 20 13:23:41.799083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:41.799083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:41.799083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:41.799083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:41.799083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:41.799083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:41.799083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:41.799083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:41.799083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:41.799083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:41.799083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:41.799083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:41.799083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:41.799083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:41.799083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:41.800230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:41.801432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:41.801432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:41.801432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:41.801432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:41.801432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:41.801432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:41.801432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:41.801432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:41.801432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 20 13:23:41.801432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:41.801432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 297/598] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:23:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:41.806317 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc17d19-1676-4612-bbce-79a0fa8b10ad None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:41.897443 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f90f8-1479-4027-9317-0c0984fbc362 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:41.958713 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc17d19-1676-4612-bbce-79a0fa8b10ad None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:42.019330 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c1adb-c3ba-4232-88ac-1c4bd4bcf7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:42.019942 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c1adb-c3ba-4232-88ac-1c4bd4bcf7ad None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:42.020223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c1adb-c3ba-4232-88ac-1c4bd4bcf7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:42.020528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c1adb-c3ba-4232-88ac-1c4bd4bcf7ad None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:42.021226 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c1adb-c3ba-4232-88ac-1c4bd4bcf7ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:42.021532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c1adb-c3ba-4232-88ac-1c4bd4bcf7ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:42.022969 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c1adb-c3ba-4232-88ac-1c4bd4bcf7ad None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:42.040460 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:42.040982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:42.047256 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f90f8-1479-4027-9317-0c0984fbc362 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:42.063354 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 302/599] 10.222.0.36 () {56 vars in 1135 bytes} [Thu Oct 20 13:23:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:42.064293 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c1adb-c3ba-4232-88ac-1c4bd4bcf7ad None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:42.132864 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef9453-725c-452c-94a6-de497e683cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:42.133724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9453-725c-452c-94a6-de497e683cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:42.134178 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9453-725c-452c-94a6-de497e683cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:42.134591 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9453-725c-452c-94a6-de497e683cd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:42.155404 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef9453-725c-452c-94a6-de497e683cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:42.166486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-9bef9453-725c-452c-94a6-de497e683cd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:42.166486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:42.166486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:42.166486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:42.166486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:42.166486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:42.166486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:42.166486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:42.166486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:42.166486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:42.166486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:42.166486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:42.166486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:42.166486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:42.166486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:42.166486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:42.167663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:42.167663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:42.167663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:42.167663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:42.167663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:42.167663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:42.167663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:42.167663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:42.167663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:42.167663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:42.167663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:42.167663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:42.167663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:42.167663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:42.167663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:42.167663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:42.168685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:42.168685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:42.168685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:42.168685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:42.168685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:42.168685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:42.168685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:42.168685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:42.168685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:42.168685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:42.168685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:23:42.168685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:42.174417 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 298/600] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Oct 20 13:23:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:23:42.184824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef9453-725c-452c-94a6-de497e683cd2 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:42.247952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c1adb-c3ba-4232-88ac-1c4bd4bcf7ad None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:42.320844 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391125d-e3c3-4062-a1d1-82ed9249e528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:42.321760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391125d-e3c3-4062-a1d1-82ed9249e528 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:42.322309 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391125d-e3c3-4062-a1d1-82ed9249e528 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:42.322712 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391125d-e3c3-4062-a1d1-82ed9249e528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:42.346822 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef9453-725c-452c-94a6-de497e683cd2 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:42.408183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:42.420774 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f573592-3d79-4d47-89db-6b95b9901ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:42.421651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f573592-3d79-4d47-89db-6b95b9901ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:42.421997 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f573592-3d79-4d47-89db-6b95b9901ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:42.422341 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f573592-3d79-4d47-89db-6b95b9901ab4 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:42.423544 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391125d-e3c3-4062-a1d1-82ed9249e528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:42.423780 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f573592-3d79-4d47-89db-6b95b9901ab4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:42.424189 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f573592-3d79-4d47-89db-6b95b9901ab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:42.425457 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391125d-e3c3-4062-a1d1-82ed9249e528 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:42.425765 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f573592-3d79-4d47-89db-6b95b9901ab4 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:42.435161 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 299/601] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Oct 20 13:23:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:42.450991 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f573592-3d79-4d47-89db-6b95b9901ab4 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:42.490776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:42.592509 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f573592-3d79-4d47-89db-6b95b9901ab4 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:42.632978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fea4b5-e906-445b-95da-92fb0426d862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:42.633678 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fea4b5-e906-445b-95da-92fb0426d862 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:42.633967 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fea4b5-e906-445b-95da-92fb0426d862 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:42.634251 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fea4b5-e906-445b-95da-92fb0426d862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:42.649294 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fea4b5-e906-445b-95da-92fb0426d862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:42.650791 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fea4b5-e906-445b-95da-92fb0426d862 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:42.662082 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 303/602] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:23:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 13:23:42.668965 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391125d-e3c3-4062-a1d1-82ed9249e528 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:42.670357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-c2fea4b5-e906-445b-95da-92fb0426d862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:42.670357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:42.670357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:42.670357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:42.670357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:42.670357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:42.670357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:42.670357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:42.670357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:42.670357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:42.670357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:42.670357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:42.670357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:42.670357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:42.670357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:42.670357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:42.671483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:42.671483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:42.671483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:42.671483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:42.671483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:42.671483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:42.671483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:42.671483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:42.671483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:42.671483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:42.671483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:42.671483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:42.671483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:42.671483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:42.671483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:42.671483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:42.671483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:42.672640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:42.672640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:42.672640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:42.674736 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 300/603] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:42.681612 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fea4b5-e906-445b-95da-92fb0426d862 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:42.780407 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:42.823207 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fea4b5-e906-445b-95da-92fb0426d862 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:42.842937 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:42.850138 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391125d-e3c3-4062-a1d1-82ed9249e528 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:42.864645 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6be1c-b3a9-4dbd-a087-79a6886e5602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:42.865495 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6be1c-b3a9-4dbd-a087-79a6886e5602 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:42.865973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6be1c-b3a9-4dbd-a087-79a6886e5602 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:42.866486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6be1c-b3a9-4dbd-a087-79a6886e5602 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:42.868810 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6be1c-b3a9-4dbd-a087-79a6886e5602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:42.869305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6be1c-b3a9-4dbd-a087-79a6886e5602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:42.870832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6be1c-b3a9-4dbd-a087-79a6886e5602 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:42.886310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 301/604] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:42.888235 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4eb565-1335-4366-9ef6-5a98e07562a7 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:42.888741 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4eb565-1335-4366-9ef6-5a98e07562a7 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:42.889235 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4eb565-1335-4366-9ef6-5a98e07562a7 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:42.895119 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 302/605] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:42.896258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4eb565-1335-4366-9ef6-5a98e07562a7 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:42.901217 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c36b9-858f-480e-95ee-25055d7d1df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:42.901903 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c36b9-858f-480e-95ee-25055d7d1df4 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:42.902187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c36b9-858f-480e-95ee-25055d7d1df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:42.902456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c36b9-858f-480e-95ee-25055d7d1df4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:42.913828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c36b9-858f-480e-95ee-25055d7d1df4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:42.915622 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3c36b9-858f-480e-95ee-25055d7d1df4 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:42.933086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-ee3c36b9-858f-480e-95ee-25055d7d1df4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:42.933086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:42.933086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:42.933086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:42.933086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:42.933086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:42.933086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:42.933086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:42.933086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:42.933086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:42.933086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:42.933086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:42.933086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:42.933086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:42.933086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:42.933086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:42.934135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:42.934135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:42.934135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:42.934135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:42.934135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:42.934135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:42.934135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:42.934135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:42.934135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:42.934135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:42.934135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:42.934135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:42.934135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:42.934135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:42.934135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:42.934135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:42.934135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:42.935709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:42.935709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:42.935709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:42.935709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 304/606] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:42.935709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccad88-c117-45b0-9d69-bfd82e5f49fd None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:42.936006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccad88-c117-45b0-9d69-bfd82e5f49fd None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:42.936006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccad88-c117-45b0-9d69-bfd82e5f49fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:42.955890 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d9ccad88-c117-45b0-9d69-bfd82e5f49fd None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:42.957095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d9ccad88-c117-45b0-9d69-bfd82e5f49fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:43.009527 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4eb565-1335-4366-9ef6-5a98e07562a7 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:43.032982 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 305/607] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:43.034224 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4ab90-8c43-480d-9a72-55781fb3ac7a None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:43.034506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4ab90-8c43-480d-9a72-55781fb3ac7a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:43.034775 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4ab90-8c43-480d-9a72-55781fb3ac7a None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:43.039059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 306/608] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:43.039059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4ab90-8c43-480d-9a72-55781fb3ac7a None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:43.060117 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e7a9e-9f85-42a2-a96a-fba4c6e0aa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:43.070974 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e7a9e-9f85-42a2-a96a-fba4c6e0aa00 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:43.070974 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e7a9e-9f85-42a2-a96a-fba4c6e0aa00 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:43.070974 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e7a9e-9f85-42a2-a96a-fba4c6e0aa00 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:43.070974 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e7a9e-9f85-42a2-a96a-fba4c6e0aa00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:43.071398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e7a9e-9f85-42a2-a96a-fba4c6e0aa00 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:43.071944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:43.085650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-ec7e7a9e-9f85-42a2-a96a-fba4c6e0aa00 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 13:23:43.085650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:43.085650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:43.085650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:43.085650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:43.085650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:43.085650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:43.085650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:43.085650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:43.085650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:43.085650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:43.085650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:43.085650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:43.085650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:43.085650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:43.085650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:43.086863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:43.088087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:43.088087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:43.088087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:43.088087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:43.088087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:43.088087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:43.088087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:43.088087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:43.088087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 13:23:43.088087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:43.094984 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 303/609] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Oct 20 13:23:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:43.094984 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fbaa8-4fa1-4136-acbd-ed669c4aa5fa None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:43.094984 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fbaa8-4fa1-4136-acbd-ed669c4aa5fa None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:43.094984 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fbaa8-4fa1-4136-acbd-ed669c4aa5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:43.113250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-b16fbaa8-4fa1-4136-acbd-ed669c4aa5fa None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:43.114694 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b16fbaa8-4fa1-4136-acbd-ed669c4aa5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:43.133511 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:43.161527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4ab90-8c43-480d-9a72-55781fb3ac7a None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:43.191888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 304/610] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:43.193131 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fbaa8-4fa1-4136-acbd-ed669c4aa5fa None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:43.202067 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88e86f-44d6-423e-b11b-8527e4d538a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:43.202804 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88e86f-44d6-423e-b11b-8527e4d538a2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:43.203179 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88e86f-44d6-423e-b11b-8527e4d538a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:43.203551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88e86f-44d6-423e-b11b-8527e4d538a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:43.205506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88e86f-44d6-423e-b11b-8527e4d538a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:43.205919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88e86f-44d6-423e-b11b-8527e4d538a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:43.208156 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88e86f-44d6-423e-b11b-8527e4d538a2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:43.222319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 307/611] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:43.228023 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88e86f-44d6-423e-b11b-8527e4d538a2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:43.348096 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fbaa8-4fa1-4136-acbd-ed669c4aa5fa None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:43.383656 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:43.396520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52c8a1-a322-4eae-9484-029a07c424bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:43.397212 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52c8a1-a322-4eae-9484-029a07c424bc None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:43.397721 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52c8a1-a322-4eae-9484-029a07c424bc None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:43.398255 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b52c8a1-a322-4eae-9484-029a07c424bc None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:43.399405 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52c8a1-a322-4eae-9484-029a07c424bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:43.399780 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52c8a1-a322-4eae-9484-029a07c424bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:43.401266 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b52c8a1-a322-4eae-9484-029a07c424bc None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:43.402545 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88e86f-44d6-423e-b11b-8527e4d538a2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:43.426520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 305/612] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Oct 20 13:23:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:43.427585 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52c8a1-a322-4eae-9484-029a07c424bc None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:43.446190 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb411bc-8fa0-4fdf-8cd9-e993a137010a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:43.446872 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb411bc-8fa0-4fdf-8cd9-e993a137010a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:43.447251 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb411bc-8fa0-4fdf-8cd9-e993a137010a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:43.447628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb411bc-8fa0-4fdf-8cd9-e993a137010a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:43.455314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb411bc-8fa0-4fdf-8cd9-e993a137010a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:43.456982 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb411bc-8fa0-4fdf-8cd9-e993a137010a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:43.459046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:43.470905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-5eb411bc-8fa0-4fdf-8cd9-e993a137010a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:43.470905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:43.470905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:43.470905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:43.470905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:43.470905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:43.470905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:43.470905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:43.470905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:43.470905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:43.470905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:43.470905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:43.470905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:43.470905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:43.470905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:43.471859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:43.471859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:43.471859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:43.471859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:43.471859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:43.471859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:43.471859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:43.471859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:43.471859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:43.471859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:43.471859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:43.471859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:43.471859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:43.471859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:43.471859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:43.471859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:43.471859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:43.472766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:43.472766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:43.472766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:43.472766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:43.472766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:43.472766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:43.472766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:43.472766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:43.477017 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 308/613] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:43.477921 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb411bc-8fa0-4fdf-8cd9-e993a137010a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:43.541839 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b52c8a1-a322-4eae-9484-029a07c424bc None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:43.580399 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887067b-253b-4fb4-bf14-7366def89afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:43.581036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887067b-253b-4fb4-bf14-7366def89afe None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:43.581316 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887067b-253b-4fb4-bf14-7366def89afe None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:43.581584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887067b-253b-4fb4-bf14-7366def89afe None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:43.582167 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887067b-253b-4fb4-bf14-7366def89afe None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:43.583604 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887067b-253b-4fb4-bf14-7366def89afe None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:43.588674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb411bc-8fa0-4fdf-8cd9-e993a137010a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:43.592708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-6887067b-253b-4fb4-bf14-7366def89afe None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 13:23:43.592708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:43.592708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:23:43.592708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:23:43.592708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:23:43.592708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:23:43.592708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:23:43.592708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:43.592708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 13:23:43.592708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:43.592708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:43.592708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:43.592708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:43.592708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:43.592708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:43.592708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:43.593976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:43.593976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:43.593976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:43.593976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:43.593976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:43.593976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:43.593976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:43.593976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:23:43.593976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:23:43.593976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:23:43.593976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:23:43.593976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:43.593976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:43.593976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:43.593976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:43.593976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:43.593976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:43.596127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:43.596127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:43.596127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:43.596127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:43.596127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:43.596127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:43.596127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:43.596127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:43.596127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:43.596127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:43.596127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:23:43.596127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:43.596127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 13:23:43.596127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:43.596127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 306/614] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Oct 20 13:23:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:43.596920 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887067b-253b-4fb4-bf14-7366def89afe None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:43.631614 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231043cc-d19c-40c9-b789-1eee20855a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:43.632317 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231043cc-d19c-40c9-b789-1eee20855a47 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:43.632587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231043cc-d19c-40c9-b789-1eee20855a47 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:43.632861 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231043cc-d19c-40c9-b789-1eee20855a47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:43.645529 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:43.702754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887067b-253b-4fb4-bf14-7366def89afe None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:43.707552 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:43.710797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231043cc-d19c-40c9-b789-1eee20855a47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:43.713359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231043cc-d19c-40c9-b789-1eee20855a47 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:43.742103 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb3351-be61-4b30-ae84-213d0ebfecb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:43.742708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb3351-be61-4b30-ae84-213d0ebfecb7 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:43.743011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb3351-be61-4b30-ae84-213d0ebfecb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:43.743288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb3351-be61-4b30-ae84-213d0ebfecb7 None admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:43.744013 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb3351-be61-4b30-ae84-213d0ebfecb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:43.744317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb3351-be61-4b30-ae84-213d0ebfecb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:43.745739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb3351-be61-4b30-ae84-213d0ebfecb7 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:43.758351 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 307/615] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:43.759196 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb3351-be61-4b30-ae84-213d0ebfecb7 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:43.828087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 309/616] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:23:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 13:23:43.833588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231043cc-d19c-40c9-b789-1eee20855a47 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:43.876530 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb3351-be61-4b30-ae84-213d0ebfecb7 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:43.885712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:43.913704 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae751666-0ab9-43fa-ba8c-37d3932a6389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:43.914342 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae751666-0ab9-43fa-ba8c-37d3932a6389 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:43.914624 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae751666-0ab9-43fa-ba8c-37d3932a6389 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:43.915176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae751666-0ab9-43fa-ba8c-37d3932a6389 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:43.915838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae751666-0ab9-43fa-ba8c-37d3932a6389 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:43.917139 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae751666-0ab9-43fa-ba8c-37d3932a6389 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:43.926489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-ae751666-0ab9-43fa-ba8c-37d3932a6389 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 13:23:43.926489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:43.926489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:23:43.926489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:23:43.926489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:23:43.926489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:23:43.926489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:23:43.926489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:43.926489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 13:23:43.926489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:43.926489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:43.926489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:43.926489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:43.926489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:43.926489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:43.926489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:43.926489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:43.927679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:43.927679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:43.927679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:43.927679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:43.927679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:43.927679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:43.927679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:23:43.927679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:23:43.927679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:23:43.927679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:23:43.927679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:43.927679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:43.927679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:43.927679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:43.927679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:43.927679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:43.928580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:43.928580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:43.928580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:43.928580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:43.928580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:43.928580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:43.928580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:43.928580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:43.928580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:43.928580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:43.928580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:23:43.928580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:43.928580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 20 13:23:43.928580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:43.928580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 308/617] 10.222.0.36 () {56 vars in 1129 bytes} [Thu Oct 20 13:23:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:43.929356 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae751666-0ab9-43fa-ba8c-37d3932a6389 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:43.940422 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:43.944629 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231043cc-d19c-40c9-b789-1eee20855a47 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:43.980708 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b8219-60d4-4735-ab4f-a8f46e3c2e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:43.981553 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b8219-60d4-4735-ab4f-a8f46e3c2e5d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:43.982305 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b8219-60d4-4735-ab4f-a8f46e3c2e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:43.982587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b8219-60d4-4735-ab4f-a8f46e3c2e5d None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:43.983570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b8219-60d4-4735-ab4f-a8f46e3c2e5d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:43.983880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b8219-60d4-4735-ab4f-a8f46e3c2e5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:43.986000 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b8219-60d4-4735-ab4f-a8f46e3c2e5d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:43.991610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 310/618] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Oct 20 13:23:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:43.992682 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b8219-60d4-4735-ab4f-a8f46e3c2e5d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:44.045979 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae751666-0ab9-43fa-ba8c-37d3932a6389 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:44.079822 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22807c91-cd2a-43ac-9679-82d496b0824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:44.080425 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22807c91-cd2a-43ac-9679-82d496b0824d None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:44.080701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22807c91-cd2a-43ac-9679-82d496b0824d None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:44.080971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22807c91-cd2a-43ac-9679-82d496b0824d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:44.081688 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22807c91-cd2a-43ac-9679-82d496b0824d None admin] RBAC: Adding query filter params (role.id=9c0f227afc2e4a0aa404780de229488c, scope.project.id=c25f337a79704728adaa03f4103eef1c, user.id=c893e6388ed340eca17da2e279ca34a9) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:44.082020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22807c91-cd2a-43ac-9679-82d496b0824d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:44.083479 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22807c91-cd2a-43ac-9679-82d496b0824d None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:44.096702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 309/619] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:23:43 2022] GET /identity/v3/role_assignments?user.id=c893e6388ed340eca17da2e279ca34a9&scope.project.id=c25f337a79704728adaa03f4103eef1c&role.id=9c0f227afc2e4a0aa404780de229488c => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:44.096702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22807c91-cd2a-43ac-9679-82d496b0824d None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:44.120940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b8219-60d4-4735-ab4f-a8f46e3c2e5d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:44.135097 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:44.160693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181c523-6b74-4a4b-ae79-d546b4925065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:44.161336 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181c523-6b74-4a4b-ae79-d546b4925065 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:44.161613 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181c523-6b74-4a4b-ae79-d546b4925065 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:44.161886 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181c523-6b74-4a4b-ae79-d546b4925065 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:44.174208 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181c523-6b74-4a4b-ae79-d546b4925065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:44.175725 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181c523-6b74-4a4b-ae79-d546b4925065 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:44.191934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-a181c523-6b74-4a4b-ae79-d546b4925065 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:44.191934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:44.191934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:44.191934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:44.191934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:44.191934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:44.191934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:44.191934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:44.191934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:44.191934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:44.191934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:44.191934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:44.191934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:44.191934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:44.191934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:44.191934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:44.192972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:44.192972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:44.192972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:44.192972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:44.192972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:44.192972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:44.192972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:44.192972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:44.192972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:44.192972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:44.192972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:44.192972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:44.192972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:44.192972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:44.192972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:44.192972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:44.192972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:44.193860 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:44.193860 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:44.193860 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:44.197967 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 311/620] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:44.198771 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181c523-6b74-4a4b-ae79-d546b4925065 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:44.216574 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:44.222370 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22807c91-cd2a-43ac-9679-82d496b0824d None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:44.261398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c871209-02a0-4718-8402-7883ce7bc0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:44.261947 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c871209-02a0-4718-8402-7883ce7bc0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:44.262224 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c871209-02a0-4718-8402-7883ce7bc0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:44.262958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c871209-02a0-4718-8402-7883ce7bc0b0 None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:44.263653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c871209-02a0-4718-8402-7883ce7bc0b0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:44.264059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c871209-02a0-4718-8402-7883ce7bc0b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:44.265493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c871209-02a0-4718-8402-7883ce7bc0b0 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:44.270471 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 310/621] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Oct 20 13:23:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:44.271722 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b95855-438b-40f4-a8a3-751cc4f7e68f None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:44.272011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b95855-438b-40f4-a8a3-751cc4f7e68f None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:44.272283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b95855-438b-40f4-a8a3-751cc4f7e68f None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:44.273503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 311/622] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:44.277576 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b95855-438b-40f4-a8a3-751cc4f7e68f None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:44.320632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181c523-6b74-4a4b-ae79-d546b4925065 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:44.357476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec24eb5-9972-41da-8658-8e815423a1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:44.358425 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec24eb5-9972-41da-8658-8e815423a1fb None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:44.358709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec24eb5-9972-41da-8658-8e815423a1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:44.359323 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec24eb5-9972-41da-8658-8e815423a1fb None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:44.360687 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec24eb5-9972-41da-8658-8e815423a1fb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:44.361056 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec24eb5-9972-41da-8658-8e815423a1fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:44.362940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec24eb5-9972-41da-8658-8e815423a1fb None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:44.370379 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 312/623] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Oct 20 13:23:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:44.371385 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec24eb5-9972-41da-8658-8e815423a1fb None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:44.391078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b95855-438b-40f4-a8a3-751cc4f7e68f None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:44.412506 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:44.435822 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5647c05-af8f-4c54-bfc4-e2941e8a77bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:44.436970 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5647c05-af8f-4c54-bfc4-e2941e8a77bc None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:44.437741 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5647c05-af8f-4c54-bfc4-e2941e8a77bc None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:44.438913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5647c05-af8f-4c54-bfc4-e2941e8a77bc None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:44.440212 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5647c05-af8f-4c54-bfc4-e2941e8a77bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:44.440746 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5647c05-af8f-4c54-bfc4-e2941e8a77bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:44.443485 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5647c05-af8f-4c54-bfc4-e2941e8a77bc None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:44.467867 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 312/624] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:44.468940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e1728-34bd-42fa-8fa7-930189ed5ea3 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:44.469785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e1728-34bd-42fa-8fa7-930189ed5ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:44.471217 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e1728-34bd-42fa-8fa7-930189ed5ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:44.472088 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:44.496331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-419e1728-34bd-42fa-8fa7-930189ed5ea3 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:44.497461 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-419e1728-34bd-42fa-8fa7-930189ed5ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:44.507013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec24eb5-9972-41da-8658-8e815423a1fb None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:44.549120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9692e-fd58-4d32-87b6-bdc61d486574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:44.549765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9692e-fd58-4d32-87b6-bdc61d486574 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:44.550927 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9692e-fd58-4d32-87b6-bdc61d486574 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:44.551231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9692e-fd58-4d32-87b6-bdc61d486574 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:44.551873 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9692e-fd58-4d32-87b6-bdc61d486574 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:44.552180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9692e-fd58-4d32-87b6-bdc61d486574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:44.553569 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9692e-fd58-4d32-87b6-bdc61d486574 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:44.563490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 313/625] 10.222.0.36 () {56 vars in 1124 bytes} [Thu Oct 20 13:23:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:44.563935 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9692e-fd58-4d32-87b6-bdc61d486574 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:44.599743 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 313/626] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:44.600758 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e1728-34bd-42fa-8fa7-930189ed5ea3 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:44.729874 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9692e-fd58-4d32-87b6-bdc61d486574 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:44.775465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:44.785244 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2da9e-3581-40ab-bd13-35bd46420ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:44.785881 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2da9e-3581-40ab-bd13-35bd46420ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:44.786159 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2da9e-3581-40ab-bd13-35bd46420ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:44.786430 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2da9e-3581-40ab-bd13-35bd46420ea4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:44.798591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2da9e-3581-40ab-bd13-35bd46420ea4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:44.800123 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e2da9e-3581-40ab-bd13-35bd46420ea4 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:44.803142 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e1728-34bd-42fa-8fa7-930189ed5ea3 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:44.825169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-14e2da9e-3581-40ab-bd13-35bd46420ea4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:44.825169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:44.825169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:44.825169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:44.825169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:44.825169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:44.825169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:44.825169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:44.825169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:44.825169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:44.825169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:44.825169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:44.825169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:44.825169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:44.825169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:44.826102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:44.826102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:44.826102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:44.826102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:44.826102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:44.826102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:44.826102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:44.826102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:44.826102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:44.826102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:44.826102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:44.826102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:44.826102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:44.826102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:44.826102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:44.826102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:44.826102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:44.827013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:44.827013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:44.827013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:44.827013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:44.827013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:44.827013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:44.827013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:44.827013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:44.835809 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 314/627] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:44.839650 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2da9e-3581-40ab-bd13-35bd46420ea4 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:44.847285 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:44.885201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b2554-10a1-4e93-9915-3be28f0daeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:44.885543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b2554-10a1-4e93-9915-3be28f0daeb9 None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:44.885820 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b2554-10a1-4e93-9915-3be28f0daeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:44.886090 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b2554-10a1-4e93-9915-3be28f0daeb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:44.886863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b2554-10a1-4e93-9915-3be28f0daeb9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:44.888693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b2554-10a1-4e93-9915-3be28f0daeb9 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:44.913473 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 314/628] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:23:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:23:44.919015 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b2554-10a1-4e93-9915-3be28f0daeb9 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:45.028725 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2da9e-3581-40ab-bd13-35bd46420ea4 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:45.074454 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b2554-10a1-4e93-9915-3be28f0daeb9 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:45.093472 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666aca11-854d-48e4-9f0f-843c7561d709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:45.094086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aca11-854d-48e4-9f0f-843c7561d709 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:45.094882 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aca11-854d-48e4-9f0f-843c7561d709 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:45.095175 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aca11-854d-48e4-9f0f-843c7561d709 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:45.095889 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666aca11-854d-48e4-9f0f-843c7561d709 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:45.096190 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666aca11-854d-48e4-9f0f-843c7561d709 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:45.098158 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666aca11-854d-48e4-9f0f-843c7561d709 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:45.112825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 315/629] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:45.118584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666aca11-854d-48e4-9f0f-843c7561d709 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:45.156526 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a663233-ba7a-497e-b083-7e4e53aa33a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:45.157864 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a663233-ba7a-497e-b083-7e4e53aa33a9 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:45.158142 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a663233-ba7a-497e-b083-7e4e53aa33a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:45.158414 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a663233-ba7a-497e-b083-7e4e53aa33a9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:45.159088 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a663233-ba7a-497e-b083-7e4e53aa33a9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:45.161892 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a663233-ba7a-497e-b083-7e4e53aa33a9 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:45.172504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-2a663233-ba7a-497e-b083-7e4e53aa33a9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 13:23:45.172504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:45.172504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:23:45.172504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:23:45.172504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:23:45.172504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:23:45.172504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:23:45.172504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:45.172504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 13:23:45.172504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:45.172504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:45.172504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:45.172504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:45.172504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:45.172504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:45.172504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:45.172504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:45.173794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:45.173794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:45.173794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:45.173794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:45.173794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:45.173794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:45.173794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:23:45.173794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:23:45.173794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:23:45.173794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:23:45.173794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:45.173794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:45.173794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:45.173794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:45.173794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:45.173794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:45.174613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:45.174613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:45.174613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:45.174613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:45.174613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:45.174613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:45.174613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:45.174613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:45.174613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:45.174613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:45.174613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:23:45.174613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:45.174613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 20 13:23:45.174613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:45.174613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 315/630] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:44 2022] GET /identity/v3/services/network => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:45.183933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a663233-ba7a-497e-b083-7e4e53aa33a9 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:45.197081 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:45.207350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:45.256609 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666aca11-854d-48e4-9f0f-843c7561d709 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:45.299926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44bd78-867a-4330-9563-69402950a197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:45.300920 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44bd78-867a-4330-9563-69402950a197 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:45.301395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44bd78-867a-4330-9563-69402950a197 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:45.301879 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44bd78-867a-4330-9563-69402950a197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:45.302820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44bd78-867a-4330-9563-69402950a197 None admin] RBAC: Adding query filter params (role.id=09686a35c48b45b49ee384e08ee11206, scope.project.id=c25f337a79704728adaa03f4103eef1c, user.id=44342daa668c4516ae131d9f0160261f) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:45.303365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44bd78-867a-4330-9563-69402950a197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:45.303701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a663233-ba7a-497e-b083-7e4e53aa33a9 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:45.305363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44bd78-867a-4330-9563-69402950a197 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:45.313861 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 316/631] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:23:45 2022] GET /identity/v3/role_assignments?user.id=44342daa668c4516ae131d9f0160261f&scope.project.id=c25f337a79704728adaa03f4103eef1c&role.id=09686a35c48b45b49ee384e08ee11206 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:45.347602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999192f7-e6c3-48f6-a96f-c8b87ebdf1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:45.348179 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999192f7-e6c3-48f6-a96f-c8b87ebdf1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:45.348465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999192f7-e6c3-48f6-a96f-c8b87ebdf1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:45.348745 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999192f7-e6c3-48f6-a96f-c8b87ebdf1f3 None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:45.349391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999192f7-e6c3-48f6-a96f-c8b87ebdf1f3 None admin] RBAC: Adding query filter params (name=network) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:45.349705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999192f7-e6c3-48f6-a96f-c8b87ebdf1f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:45.351116 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999192f7-e6c3-48f6-a96f-c8b87ebdf1f3 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:45.356641 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 316/632] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Oct 20 13:23:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:45.363201 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44bd78-867a-4330-9563-69402950a197 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:45.546624 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44bd78-867a-4330-9563-69402950a197 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:45.581607 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:45.595713 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eddd0c-877f-4b06-ac19-3b34d0461b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:45.596344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eddd0c-877f-4b06-ac19-3b34d0461b53 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:45.596623 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eddd0c-877f-4b06-ac19-3b34d0461b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:45.596894 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eddd0c-877f-4b06-ac19-3b34d0461b53 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:45.597527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eddd0c-877f-4b06-ac19-3b34d0461b53 None admin] RBAC: Adding query filter params (type=network) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:45.597896 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eddd0c-877f-4b06-ac19-3b34d0461b53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:45.599226 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eddd0c-877f-4b06-ac19-3b34d0461b53 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:45.604813 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 317/633] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Oct 20 13:23:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:45.610681 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999192f7-e6c3-48f6-a96f-c8b87ebdf1f3 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:45.697799 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:45.735097 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999192f7-e6c3-48f6-a96f-c8b87ebdf1f3 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:45.771603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fbf0f-307f-4153-931e-a77b3e0b4009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:45.772218 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fbf0f-307f-4153-931e-a77b3e0b4009 None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:45.772494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fbf0f-307f-4153-931e-a77b3e0b4009 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:45.772766 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fbf0f-307f-4153-931e-a77b3e0b4009 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:45.773451 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fbf0f-307f-4153-931e-a77b3e0b4009 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:45.774824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fbf0f-307f-4153-931e-a77b3e0b4009 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:45.800368 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 317/634] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:23:45 2022] POST /identity/v3/endpoints => generated 337 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:23:46.502736 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf477b-7d88-4f5d-827c-453c623e2bfc None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:46.503285 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf477b-7d88-4f5d-827c-453c623e2bfc None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:46.503562 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf477b-7d88-4f5d-827c-453c623e2bfc None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:46.505278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 318/635] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:46.511118 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa386a55-5819-48ce-a45d-3a81bb956e0f None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:46.511538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa386a55-5819-48ce-a45d-3a81bb956e0f None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:46.511955 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa386a55-5819-48ce-a45d-3a81bb956e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:46.532269 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-fa386a55-5819-48ce-a45d-3a81bb956e0f None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:46.533471 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-fa386a55-5819-48ce-a45d-3a81bb956e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:46.610123 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 318/636] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:46.767105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dbba9-eee5-49ef-a4d1-84eb04c9e18c None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:46.767413 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dbba9-eee5-49ef-a4d1-84eb04c9e18c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:46.767611 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783dbba9-eee5-49ef-a4d1-84eb04c9e18c None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:46.769089 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 319/637] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:46.774294 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf7d36-14fc-45b3-a698-d0133ecbfc57 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:46.774747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf7d36-14fc-45b3-a698-d0133ecbfc57 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:46.774924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf7d36-14fc-45b3-a698-d0133ecbfc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:46.794191 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-e5bf7d36-14fc-45b3-a698-d0133ecbfc57 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:46.795679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e5bf7d36-14fc-45b3-a698-d0133ecbfc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:46.842641 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:46.865386 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 319/638] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:46.894550 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dbba9-eee5-49ef-a4d1-84eb04c9e18c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:47.000768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783dbba9-eee5-49ef-a4d1-84eb04c9e18c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:47.036146 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55650ebc-91be-4a84-a4ef-4e98522eab02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:47.037100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55650ebc-91be-4a84-a4ef-4e98522eab02 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:47.037574 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55650ebc-91be-4a84-a4ef-4e98522eab02 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:47.038038 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55650ebc-91be-4a84-a4ef-4e98522eab02 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:47.038884 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55650ebc-91be-4a84-a4ef-4e98522eab02 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:47.040747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55650ebc-91be-4a84-a4ef-4e98522eab02 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:47.052570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-55650ebc-91be-4a84-a4ef-4e98522eab02 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 13:23:47.052570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:47.052570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:23:47.052570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:23:47.052570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:23:47.052570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:23:47.052570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:23:47.052570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:47.052570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 13:23:47.052570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:47.052570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:47.052570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:47.052570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:47.052570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:47.052570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:47.052570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:47.052570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:47.053628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:47.053628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:47.053628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:47.053628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:47.053628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:47.053628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:47.053628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:23:47.053628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:23:47.053628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:23:47.053628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:23:47.053628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:47.053628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:47.053628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:47.053628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:47.053628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:47.053628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:47.054442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:47.054442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:47.054442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:47.054442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:47.054442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:47.054442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:47.054442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:47.054442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:47.054442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:47.054442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:47.054442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:23:47.054442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:47.054442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 13:23:47.054442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:47.057215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 320/639] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Oct 20 13:23:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:47.063091 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf7d36-14fc-45b3-a698-d0133ecbfc57 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:47.164153 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55650ebc-91be-4a84-a4ef-4e98522eab02 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:47.168478 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf7d36-14fc-45b3-a698-d0133ecbfc57 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:47.205278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905fb5c-c6a3-473f-81da-ab51fd12548c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:47.205893 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905fb5c-c6a3-473f-81da-ab51fd12548c None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:47.206177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905fb5c-c6a3-473f-81da-ab51fd12548c None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:47.206450 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905fb5c-c6a3-473f-81da-ab51fd12548c None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:47.207125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905fb5c-c6a3-473f-81da-ab51fd12548c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:47.207432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905fb5c-c6a3-473f-81da-ab51fd12548c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:47.208799 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905fb5c-c6a3-473f-81da-ab51fd12548c None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:47.213522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 320/640] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Oct 20 13:23:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:47.219534 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905fb5c-c6a3-473f-81da-ab51fd12548c None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:47.224747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:47.267491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:47.284478 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55650ebc-91be-4a84-a4ef-4e98522eab02 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:47.322461 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1870902-97a9-4426-b884-bdc8ec37b263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:47.323023 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1870902-97a9-4426-b884-bdc8ec37b263 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:47.323308 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1870902-97a9-4426-b884-bdc8ec37b263 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:47.323580 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1870902-97a9-4426-b884-bdc8ec37b263 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:47.324243 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1870902-97a9-4426-b884-bdc8ec37b263 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:47.325639 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1870902-97a9-4426-b884-bdc8ec37b263 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:47.340366 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905fb5c-c6a3-473f-81da-ab51fd12548c None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:47.345477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 321/641] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Oct 20 13:23:47 2022] POST /identity/v3/services => generated 269 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:23:47.408594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6afe5c-c29c-4642-829d-8da11b6f5c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:47.409310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6afe5c-c29c-4642-829d-8da11b6f5c9c None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:47.409595 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6afe5c-c29c-4642-829d-8da11b6f5c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:47.409869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6afe5c-c29c-4642-829d-8da11b6f5c9c None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:47.410590 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6afe5c-c29c-4642-829d-8da11b6f5c9c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:47.410899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6afe5c-c29c-4642-829d-8da11b6f5c9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:47.412427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6afe5c-c29c-4642-829d-8da11b6f5c9c None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:47.418793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 321/642] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Oct 20 13:23:47 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:47.497919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1ea95-d3aa-4b69-9528-f03fd5857a2a None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:47.498260 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1ea95-d3aa-4b69-9528-f03fd5857a2a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:47.498467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1ea95-d3aa-4b69-9528-f03fd5857a2a None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:47.500818 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 322/643] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:47.506908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d152c-f250-43be-b2ec-58c6dee7b597 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:47.507258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d152c-f250-43be-b2ec-58c6dee7b597 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:47.507496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d152c-f250-43be-b2ec-58c6dee7b597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:47.529737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-4e6d152c-f250-43be-b2ec-58c6dee7b597 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:47.531012 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-4e6d152c-f250-43be-b2ec-58c6dee7b597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:47.615908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 322/644] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:47 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:47.890767 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1ea95-d3aa-4b69-9528-f03fd5857a2a None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:48.006551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1ea95-d3aa-4b69-9528-f03fd5857a2a None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:48.021561 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:48.043860 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e24169-dcbe-4e16-8ed0-5b45c4ffda9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:48.044565 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e24169-dcbe-4e16-8ed0-5b45c4ffda9a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:48.045037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e24169-dcbe-4e16-8ed0-5b45c4ffda9a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:48.045495 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e24169-dcbe-4e16-8ed0-5b45c4ffda9a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:48.046347 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e24169-dcbe-4e16-8ed0-5b45c4ffda9a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:48.048226 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e24169-dcbe-4e16-8ed0-5b45c4ffda9a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:48.049159 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd1ccf-a985-448a-9fc7-f93a53617cb7 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:48.049598 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd1ccf-a985-448a-9fc7-f93a53617cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:48.049761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd1ccf-a985-448a-9fc7-f93a53617cb7 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:48.051286 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 323/645] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:48.056176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14252834-cb9c-48c0-8089-82efd0cfe715 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:48.056457 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14252834-cb9c-48c0-8089-82efd0cfe715 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:48.056734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14252834-cb9c-48c0-8089-82efd0cfe715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:48.057462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-11e24169-dcbe-4e16-8ed0-5b45c4ffda9a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 13:23:48.057462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:48.057462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:23:48.057462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:23:48.057462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:23:48.057462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:23:48.057462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:23:48.057462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:48.057462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 13:23:48.057462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:48.057462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:48.057462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:48.057462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:48.057462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:48.057462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:48.057462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:48.057462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:48.058405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:48.058405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:48.058405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:48.058405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:48.058405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:48.058405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:48.058405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:23:48.058405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:23:48.058405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:23:48.058405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:23:48.058405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:48.058405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:48.058405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:48.058405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:48.058405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:48.058405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:48.059914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:48.059914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:48.059914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:48.059914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:48.059914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:48.059914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:48.059914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:48.059914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:48.059914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:48.059914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:48.059914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:23:48.059914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:48.059914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 13:23:48.059914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:48.059914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 323/646] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Oct 20 13:23:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:48.064983 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e24169-dcbe-4e16-8ed0-5b45c4ffda9a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:48.076461 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-14252834-cb9c-48c0-8089-82efd0cfe715 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:48.077961 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-14252834-cb9c-48c0-8089-82efd0cfe715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:48.113997 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:48.171509 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 324/647] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:48 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:48.177619 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e24169-dcbe-4e16-8ed0-5b45c4ffda9a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:48.213881 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2c224-b198-4239-89d2-86a78e0423bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:48.214488 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2c224-b198-4239-89d2-86a78e0423bc None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:48.214766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2c224-b198-4239-89d2-86a78e0423bc None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:48.215066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2c224-b198-4239-89d2-86a78e0423bc None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:48.215700 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2c224-b198-4239-89d2-86a78e0423bc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:48.216002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2c224-b198-4239-89d2-86a78e0423bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:48.217365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2c224-b198-4239-89d2-86a78e0423bc None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:48.222867 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 324/648] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Oct 20 13:23:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:48.228223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14252834-cb9c-48c0-8089-82efd0cfe715 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:48.340203 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14252834-cb9c-48c0-8089-82efd0cfe715 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:48.376691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3ddc4-8959-4852-94b4-754c0041469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:48.377304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3ddc4-8959-4852-94b4-754c0041469d None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:48.377644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3ddc4-8959-4852-94b4-754c0041469d None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:48.377920 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3ddc4-8959-4852-94b4-754c0041469d None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:48.378547 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3ddc4-8959-4852-94b4-754c0041469d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:48.378853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3ddc4-8959-4852-94b4-754c0041469d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:48.380246 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3ddc4-8959-4852-94b4-754c0041469d None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:48.385167 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 325/649] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Oct 20 13:23:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:48.447974 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2c224-b198-4239-89d2-86a78e0423bc None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:48.502357 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:48.567124 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2c224-b198-4239-89d2-86a78e0423bc None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:48.603451 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2b9c0-b4f0-4b60-a967-2d4dbdee6342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:48.604230 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2b9c0-b4f0-4b60-a967-2d4dbdee6342 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:48.604511 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2b9c0-b4f0-4b60-a967-2d4dbdee6342 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:48.604786 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2b9c0-b4f0-4b60-a967-2d4dbdee6342 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:48.616089 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2b9c0-b4f0-4b60-a967-2d4dbdee6342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:48.622047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-adf2b9c0-b4f0-4b60-a967-2d4dbdee6342 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 13:23:48.622047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:48.622047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:48.622047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:48.622047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:48.622047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:48.622047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:48.622047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:48.622047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:48.622047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:48.622047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:48.622047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:48.622047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:48.622047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:48.622047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:48.622047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:48.623010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:48.623010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:48.623010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:48.623010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:48.623010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:48.623010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:48.623010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:48.623010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:48.623010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:48.623010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:48.623010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:48.623010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:48.623010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:48.623010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:48.623010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:48.623010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:48.623854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:48.623854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:48.623854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:48.623854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:48.623854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:48.623854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:48.623854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:48.623854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:48.623854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:48.623854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:48.623854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 13:23:48.623854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:48.623854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 325/650] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Oct 20 13:23:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:48.632231 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3ddc4-8959-4852-94b4-754c0041469d None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:48.661198 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:48.740405 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3ddc4-8959-4852-94b4-754c0041469d None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:48.776618 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d71fd-a351-45de-971f-27bf3dd58757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:48.777232 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d71fd-a351-45de-971f-27bf3dd58757 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:48.777513 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d71fd-a351-45de-971f-27bf3dd58757 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:48.777787 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d71fd-a351-45de-971f-27bf3dd58757 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:48.778451 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d71fd-a351-45de-971f-27bf3dd58757 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:48.778753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d71fd-a351-45de-971f-27bf3dd58757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:48.780163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d71fd-a351-45de-971f-27bf3dd58757 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:48.789085 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 326/651] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Oct 20 13:23:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:48.794649 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2b9c0-b4f0-4b60-a967-2d4dbdee6342 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:48.911327 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2b9c0-b4f0-4b60-a967-2d4dbdee6342 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:48.913576 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:48.950020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe3430-5eb5-4b17-b456-ef2395d4e9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:48.951040 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe3430-5eb5-4b17-b456-ef2395d4e9ef None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:48.951552 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe3430-5eb5-4b17-b456-ef2395d4e9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:48.952017 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe3430-5eb5-4b17-b456-ef2395d4e9ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:48.962993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe3430-5eb5-4b17-b456-ef2395d4e9ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:48.964644 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe3430-5eb5-4b17-b456-ef2395d4e9ef None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:48.979586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-e6fe3430-5eb5-4b17-b456-ef2395d4e9ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:48.979586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:48.979586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:48.979586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:48.979586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:48.979586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:48.979586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:48.979586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:48.979586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:48.979586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:48.979586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:48.979586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:48.979586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:48.979586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:48.979586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:48.979586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:48.980506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:48.980506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:48.980506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:48.980506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:48.980506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:48.980506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:48.980506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:48.980506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:48.980506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:48.980506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:48.980506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:48.980506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:48.980506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:48.980506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:48.980506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:48.980506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:48.980506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:48.981377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:48.981377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:48.981377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:48.983465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 326/652] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:48.989876 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d71fd-a351-45de-971f-27bf3dd58757 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:49.083794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:49.099234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d71fd-a351-45de-971f-27bf3dd58757 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:49.139136 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f0d6c-1780-4b5c-9bf9-d3ac977a5cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:49.139754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f0d6c-1780-4b5c-9bf9-d3ac977a5cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:49.140034 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f0d6c-1780-4b5c-9bf9-d3ac977a5cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:49.140311 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f0d6c-1780-4b5c-9bf9-d3ac977a5cb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:49.141477 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f0d6c-1780-4b5c-9bf9-d3ac977a5cb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:49.141788 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f0d6c-1780-4b5c-9bf9-d3ac977a5cb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:49.143179 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f0d6c-1780-4b5c-9bf9-d3ac977a5cb6 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:49.155879 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 327/653] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:49.161564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe3430-5eb5-4b17-b456-ef2395d4e9ef None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:49.270407 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe3430-5eb5-4b17-b456-ef2395d4e9ef None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:49.306032 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e09c7-f7b0-4a54-a22e-794319b81455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:49.307165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e09c7-f7b0-4a54-a22e-794319b81455 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:49.307659 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e09c7-f7b0-4a54-a22e-794319b81455 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:49.308139 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e09c7-f7b0-4a54-a22e-794319b81455 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:49.317104 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e09c7-f7b0-4a54-a22e-794319b81455 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:49.318795 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e09c7-f7b0-4a54-a22e-794319b81455 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:49.330618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-308e09c7-f7b0-4a54-a22e-794319b81455 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 13:23:49.330618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:49.330618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:49.330618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:49.330618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:49.330618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:49.330618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:49.330618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:49.330618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:49.330618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:49.330618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:49.330618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:49.330618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:49.330618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:49.330618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:49.330618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:49.331596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:49.332502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:49.332502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:49.332502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:49.332502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:49.332502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:49.332502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:49.332502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:49.332502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:49.332502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 13:23:49.332502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:49.335081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 327/654] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Oct 20 13:23:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:49.341127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f0d6c-1780-4b5c-9bf9-d3ac977a5cb6 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:49.449420 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f0d6c-1780-4b5c-9bf9-d3ac977a5cb6 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:49.484935 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d88f88-74a3-4f5f-867a-6919ca313cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:49.485548 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d88f88-74a3-4f5f-867a-6919ca313cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:49.485832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d88f88-74a3-4f5f-867a-6919ca313cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:49.486107 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d88f88-74a3-4f5f-867a-6919ca313cc5 None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:49.486830 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d88f88-74a3-4f5f-867a-6919ca313cc5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:49.487165 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d88f88-74a3-4f5f-867a-6919ca313cc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:49.488585 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d88f88-74a3-4f5f-867a-6919ca313cc5 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:49.506797 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 328/655] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Oct 20 13:23:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:49.512463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e09c7-f7b0-4a54-a22e-794319b81455 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:49.531028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:49.627292 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e09c7-f7b0-4a54-a22e-794319b81455 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:49.665271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc02506-9aa4-4239-b9b7-a71de6b21857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:49.665902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc02506-9aa4-4239-b9b7-a71de6b21857 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:49.666204 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc02506-9aa4-4239-b9b7-a71de6b21857 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:49.666447 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc02506-9aa4-4239-b9b7-a71de6b21857 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:49.677690 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc02506-9aa4-4239-b9b7-a71de6b21857 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:49.679152 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc02506-9aa4-4239-b9b7-a71de6b21857 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:49.694105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-efc02506-9aa4-4239-b9b7-a71de6b21857 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:49.694105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:49.694105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:49.694105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:49.694105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:49.694105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:49.694105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:49.694105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:49.694105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:49.694105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:49.694105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:49.694105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:49.694105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:49.694105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:49.694105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:49.694105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:49.695057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:49.695057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:49.695057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:49.695057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:49.695057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:49.695057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:49.695057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:49.695057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:49.695057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:49.695057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:49.695057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:49.695057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:49.695057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:49.695057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:49.695057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:49.695057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:49.695057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:49.695959 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:49.695959 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:49.695959 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:49.695959 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 328/656] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:49.702260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d88f88-74a3-4f5f-867a-6919ca313cc5 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:49.714588 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:49.719028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf54fa5-b363-4fb1-87aa-8999d2d8e828 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:49.719374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf54fa5-b363-4fb1-87aa-8999d2d8e828 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:49.719565 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf54fa5-b363-4fb1-87aa-8999d2d8e828 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:49.721294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 329/657] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:23:49.727500 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2665ba-ea0d-46f8-9a55-9c2d571e30e5 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:49.728109 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2665ba-ea0d-46f8-9a55-9c2d571e30e5 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:49.728590 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2665ba-ea0d-46f8-9a55-9c2d571e30e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:49.747507 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-9b2665ba-ea0d-46f8-9a55-9c2d571e30e5 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:49.748779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9b2665ba-ea0d-46f8-9a55-9c2d571e30e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:49.813560 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d88f88-74a3-4f5f-867a-6919ca313cc5 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:49.817078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:49.825494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 330/658] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:49 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 13:23:49.826838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcbe91-9867-4bc8-9f48-77b2ab7014b0 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:49.827146 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcbe91-9867-4bc8-9f48-77b2ab7014b0 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:49.827415 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcbe91-9867-4bc8-9f48-77b2ab7014b0 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:49.833500 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 331/659] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:49.834664 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beceb25d-bb9f-469f-9a4d-96cb490659a3 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:49.834941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beceb25d-bb9f-469f-9a4d-96cb490659a3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:49.835239 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beceb25d-bb9f-469f-9a4d-96cb490659a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:49.858163 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-beceb25d-bb9f-469f-9a4d-96cb490659a3 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:49.860006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-beceb25d-bb9f-469f-9a4d-96cb490659a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:49.862377 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ae4da-44bb-411e-91b9-a249caec53a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:49.863009 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ae4da-44bb-411e-91b9-a249caec53a6 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:49.863289 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ae4da-44bb-411e-91b9-a249caec53a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:49.863556 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7ae4da-44bb-411e-91b9-a249caec53a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:49.864407 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ae4da-44bb-411e-91b9-a249caec53a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:49.864715 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ae4da-44bb-411e-91b9-a249caec53a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:49.866091 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7ae4da-44bb-411e-91b9-a249caec53a6 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:49.894053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 329/660] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:49.894880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ae4da-44bb-411e-91b9-a249caec53a6 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:49.947336 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 332/661] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:49 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:49.970087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:50.009403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7ae4da-44bb-411e-91b9-a249caec53a6 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:50.044567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5d3f0-f500-47fa-80c3-72a1c2637a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:50.045479 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5d3f0-f500-47fa-80c3-72a1c2637a44 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:50.045940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5d3f0-f500-47fa-80c3-72a1c2637a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:50.046392 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5d3f0-f500-47fa-80c3-72a1c2637a44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:50.053872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5d3f0-f500-47fa-80c3-72a1c2637a44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:50.055518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5d3f0-f500-47fa-80c3-72a1c2637a44 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:50.067151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-2dd5d3f0-f500-47fa-80c3-72a1c2637a44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:50.067151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:50.067151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:50.067151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:50.067151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:50.067151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:50.067151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:50.067151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:50.067151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:50.067151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:50.067151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:50.067151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:50.067151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:50.067151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:50.067151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:50.068041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:50.068041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:50.068041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:50.068041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:50.068041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:50.068041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:50.068041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:50.068041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:50.068041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:50.068041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:50.068041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:50.068041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:50.068041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:50.068041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:50.068041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:50.068041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:50.068041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:50.068917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:50.068917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:50.068917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:50.068917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:50.068917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:50.068917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:50.068917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:50.068917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:50.070993 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 330/662] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:50.079603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beceb25d-bb9f-469f-9a4d-96cb490659a3 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:50.129755 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5d3f0-f500-47fa-80c3-72a1c2637a44 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:50.187105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beceb25d-bb9f-469f-9a4d-96cb490659a3 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:50.221409 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:50.226477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624a298-fb73-4f84-8909-c3f4731afba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:50.227323 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624a298-fb73-4f84-8909-c3f4731afba8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:50.227747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624a298-fb73-4f84-8909-c3f4731afba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:50.228161 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0624a298-fb73-4f84-8909-c3f4731afba8 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:50.229114 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624a298-fb73-4f84-8909-c3f4731afba8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:50.229632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624a298-fb73-4f84-8909-c3f4731afba8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:50.231295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0624a298-fb73-4f84-8909-c3f4731afba8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:50.241529 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5d3f0-f500-47fa-80c3-72a1c2637a44 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:50.244822 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 333/663] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:50.245700 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624a298-fb73-4f84-8909-c3f4731afba8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:50.270740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:50.280157 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae47c3b-a130-41f0-a7f8-c40456908028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:50.280796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae47c3b-a130-41f0-a7f8-c40456908028 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:50.281076 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae47c3b-a130-41f0-a7f8-c40456908028 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:50.281413 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae47c3b-a130-41f0-a7f8-c40456908028 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:50.282217 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae47c3b-a130-41f0-a7f8-c40456908028 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:50.283610 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae47c3b-a130-41f0-a7f8-c40456908028 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:50.292747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-8ae47c3b-a130-41f0-a7f8-c40456908028 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 13:23:50.292747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:50.292747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:23:50.292747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:23:50.292747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:23:50.292747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:23:50.292747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:23:50.292747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:50.292747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 13:23:50.292747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:50.292747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:50.292747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:50.292747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:50.292747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:50.292747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:50.292747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:50.293705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:50.293705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:50.293705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:50.293705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:50.293705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:50.293705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:50.293705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:50.293705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:23:50.293705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:23:50.293705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:23:50.293705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:23:50.293705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:50.293705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:50.293705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:50.293705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:50.293705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:50.293705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:50.294665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:50.294665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:50.294665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:50.294665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:50.294665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:50.294665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:50.294665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:50.294665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:50.294665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:50.294665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:50.294665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:23:50.294665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:50.294665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 13:23:50.294665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:50.296219 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 331/664] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Oct 20 13:23:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:23:50.296593 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae47c3b-a130-41f0-a7f8-c40456908028 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:50.358869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0624a298-fb73-4f84-8909-c3f4731afba8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:50.394855 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a0336-d4ea-4693-81b7-7a908fca4cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:50.395503 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a0336-d4ea-4693-81b7-7a908fca4cf7 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:50.396184 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a0336-d4ea-4693-81b7-7a908fca4cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:50.396472 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3a0336-d4ea-4693-81b7-7a908fca4cf7 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:50.397130 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a0336-d4ea-4693-81b7-7a908fca4cf7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:50.398486 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3a0336-d4ea-4693-81b7-7a908fca4cf7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:50.409992 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae47c3b-a130-41f0-a7f8-c40456908028 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:50.423054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 334/665] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Oct 20 13:23:50 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:23:50.423054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a0336-d4ea-4693-81b7-7a908fca4cf7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:50.470364 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899ebe5-e67a-49ca-9fbc-aa5a0273cf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:50.471567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899ebe5-e67a-49ca-9fbc-aa5a0273cf3f None admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:50.471982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899ebe5-e67a-49ca-9fbc-aa5a0273cf3f None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:50.472360 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899ebe5-e67a-49ca-9fbc-aa5a0273cf3f None admin] PATH_INFO: `/v3/projects/c25f337a79704728adaa03f4103eef1c/users/44342daa668c4516ae131d9f0160261f/roles/248eca0e6d1f475aa038270f567786ba` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:50.476100 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899ebe5-e67a-49ca-9fbc-aa5a0273cf3f None admin] RBAC: Authorizing `identity:create_grant(project_id=c25f337a79704728adaa03f4103eef1c, user_id=44342daa668c4516ae131d9f0160261f, role_id=248eca0e6d1f475aa038270f567786ba)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:50.478120 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899ebe5-e67a-49ca-9fbc-aa5a0273cf3f None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:50.495768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:50.501537 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 332/666] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:23:50 2022] PUT /identity/v3/projects/c25f337a79704728adaa03f4103eef1c/users/44342daa668c4516ae131d9f0160261f/roles/248eca0e6d1f475aa038270f567786ba => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:23:50.574625 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3a0336-d4ea-4693-81b7-7a908fca4cf7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:50.619693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d74fc8-7068-4270-a3a6-270ec3c78264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:50.620347 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d74fc8-7068-4270-a3a6-270ec3c78264 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:50.620693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d74fc8-7068-4270-a3a6-270ec3c78264 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:50.620972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d74fc8-7068-4270-a3a6-270ec3c78264 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:50.621647 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d74fc8-7068-4270-a3a6-270ec3c78264 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:50.622004 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d74fc8-7068-4270-a3a6-270ec3c78264 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:50.623498 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d74fc8-7068-4270-a3a6-270ec3c78264 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:50.629587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 335/667] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Oct 20 13:23:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:50.635453 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899ebe5-e67a-49ca-9fbc-aa5a0273cf3f None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:50.705805 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:50.722714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87094c3d-9de7-4cda-9f12-7b2c451013ad None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:50.723019 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87094c3d-9de7-4cda-9f12-7b2c451013ad None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:50.723296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87094c3d-9de7-4cda-9f12-7b2c451013ad None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:50.724787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 336/668] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:23:50.730135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b2049-5916-4407-8438-caca43d18ad1 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:50.730426 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b2049-5916-4407-8438-caca43d18ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:50.730701 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b2049-5916-4407-8438-caca43d18ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:50.766365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-651b2049-5916-4407-8438-caca43d18ad1 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:50.768021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-651b2049-5916-4407-8438-caca43d18ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:50.772142 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899ebe5-e67a-49ca-9fbc-aa5a0273cf3f None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:50.809536 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ee594-38e5-4d0d-b742-cad2f3d1fd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:50.810180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ee594-38e5-4d0d-b742-cad2f3d1fd5d None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:50.810461 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ee594-38e5-4d0d-b742-cad2f3d1fd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:50.810735 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ee594-38e5-4d0d-b742-cad2f3d1fd5d None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:50.811403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ee594-38e5-4d0d-b742-cad2f3d1fd5d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:50.811708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ee594-38e5-4d0d-b742-cad2f3d1fd5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:50.813356 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ee594-38e5-4d0d-b742-cad2f3d1fd5d None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:50.819137 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 333/669] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Oct 20 13:23:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:50.826842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ee594-38e5-4d0d-b742-cad2f3d1fd5d None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:50.867494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 337/670] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:50 2022] POST /identity/v3/auth/tokens => generated 1373 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:50.945932 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ee594-38e5-4d0d-b742-cad2f3d1fd5d None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:50.960638 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:50.984044 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649feff-5f88-4f74-83bd-a74f81a81feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:50.984638 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649feff-5f88-4f74-83bd-a74f81a81feb None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:50.985050 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649feff-5f88-4f74-83bd-a74f81a81feb None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:50.985318 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649feff-5f88-4f74-83bd-a74f81a81feb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:50.986080 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649feff-5f88-4f74-83bd-a74f81a81feb None admin] RBAC: Adding query filter params (interface=public, service_id=ccb6ccbaa3044ccd8cb7555e8e86d76c, region_id=RegionOne) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:50.986388 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649feff-5f88-4f74-83bd-a74f81a81feb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:50.987849 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649feff-5f88-4f74-83bd-a74f81a81feb None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:50.993337 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 334/671] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Oct 20 13:23:50 2022] GET /identity/v3/endpoints?service_id=ccb6ccbaa3044ccd8cb7555e8e86d76c&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:50.998894 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b2049-5916-4407-8438-caca43d18ad1 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:51.047927 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:51.105976 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b2049-5916-4407-8438-caca43d18ad1 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:51.139280 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649feff-5f88-4f74-83bd-a74f81a81feb None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:51.141822 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc162b-7707-477a-9c3a-f3cbefe31f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:51.142465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc162b-7707-477a-9c3a-f3cbefe31f2c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:51.142716 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc162b-7707-477a-9c3a-f3cbefe31f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:51.143013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc162b-7707-477a-9c3a-f3cbefe31f2c None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:51.143621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc162b-7707-477a-9c3a-f3cbefe31f2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:51.144991 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc162b-7707-477a-9c3a-f3cbefe31f2c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:51.151129 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 338/672] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Oct 20 13:23:50 2022] GET /identity/v3/services => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:23:51.262192 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649feff-5f88-4f74-83bd-a74f81a81feb None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:51.301869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad12d6-0bc7-49b8-baf2-d51b7174328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:51.302503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad12d6-0bc7-49b8-baf2-d51b7174328f None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:51.302778 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad12d6-0bc7-49b8-baf2-d51b7174328f None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:51.303084 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad12d6-0bc7-49b8-baf2-d51b7174328f None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:51.303757 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad12d6-0bc7-49b8-baf2-d51b7174328f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:51.305142 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad12d6-0bc7-49b8-baf2-d51b7174328f None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:51.327198 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 335/673] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Oct 20 13:23:51 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:23:52.711816 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0fb1b-c874-40af-a0f5-e492050a8fa4 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:52.712569 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0fb1b-c874-40af-a0f5-e492050a8fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:52.713107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0fb1b-c874-40af-a0f5-e492050a8fa4 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:52.714718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 339/674] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:52.721071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08eef-7c96-41ad-86fb-aeebabcc1e64 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:52.721545 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08eef-7c96-41ad-86fb-aeebabcc1e64 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:52.721634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08eef-7c96-41ad-86fb-aeebabcc1e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:52.740516 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-b4d08eef-7c96-41ad-86fb-aeebabcc1e64 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:52.741714 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b4d08eef-7c96-41ad-86fb-aeebabcc1e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:52.753868 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b5bd1-4938-4902-9c21-8b936173a5e6 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:52.754274 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b5bd1-4938-4902-9c21-8b936173a5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:52.754432 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b5bd1-4938-4902-9c21-8b936173a5e6 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:52.756126 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 340/675] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:23:52.760899 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd96620-d31e-428c-b00d-64f0e49a1ff9 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:52.761184 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd96620-d31e-428c-b00d-64f0e49a1ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:52.761456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd96620-d31e-428c-b00d-64f0e49a1ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:52.773938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:52.783718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-3bd96620-d31e-428c-b00d-64f0e49a1ff9 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:52.784914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3bd96620-d31e-428c-b00d-64f0e49a1ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:52.835700 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 336/676] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:52.867538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 341/677] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:53.118313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d08eef-7c96-41ad-86fb-aeebabcc1e64 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:53.140612 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd96620-d31e-428c-b00d-64f0e49a1ff9 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:53.180466 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:53.231067 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d08eef-7c96-41ad-86fb-aeebabcc1e64 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:53.258128 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd96620-d31e-428c-b00d-64f0e49a1ff9 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:53.277066 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37979b-9485-42ff-9d9b-8867c27b1ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:53.277985 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37979b-9485-42ff-9d9b-8867c27b1ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:53.278570 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37979b-9485-42ff-9d9b-8867c27b1ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:53.279019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37979b-9485-42ff-9d9b-8867c27b1ec7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:53.279880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37979b-9485-42ff-9d9b-8867c27b1ec7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:53.282187 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37979b-9485-42ff-9d9b-8867c27b1ec7 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:53.292958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-fd37979b-9485-42ff-9d9b-8867c27b1ec7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 13:23:53.292958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:53.292958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:23:53.292958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:23:53.292958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:23:53.292958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:23:53.292958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:23:53.292958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:53.292958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 13:23:53.292958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:53.292958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:53.292958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:53.292958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:53.292958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:53.292958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:53.292958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:53.292958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:53.294244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:53.294244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:53.294244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:53.294244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:53.294244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:53.294244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:53.294244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:23:53.294244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:23:53.294244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:23:53.294244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:23:53.294244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:53.294244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:53.294244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:53.294244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:53.294244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:53.294244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:53.295304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:53.295304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:53.295304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:53.295304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:53.295304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:53.295304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:53.295304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:53.295304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:53.295304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:53.295304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:53.295304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:23:53.295304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:53.295304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 13:23:53.295304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:53.298211 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 337/678] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Oct 20 13:23:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:53.304508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37979b-9485-42ff-9d9b-8867c27b1ec7 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:53.306362 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4893478-fcef-40b6-9e71-4e7c780bf59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:53.307029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4893478-fcef-40b6-9e71-4e7c780bf59c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:53.307310 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4893478-fcef-40b6-9e71-4e7c780bf59c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:53.307576 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4893478-fcef-40b6-9e71-4e7c780bf59c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:53.322015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4893478-fcef-40b6-9e71-4e7c780bf59c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:23:53.328717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f4893478-fcef-40b6-9e71-4e7c780bf59c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 13:23:53.328717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:53.328717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:53.328717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:53.328717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:53.328717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:53.328717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:53.328717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:53.328717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:53.328717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:53.328717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:53.328717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:53.328717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:23:53.328717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:23:53.328717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:23:53.328717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:23:53.329780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:23:53.329780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:23:53.329780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:23:53.329780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:23:53.329780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:53.329780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:53.329780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:53.329780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:53.329780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:53.329780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:53.329780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:53.329780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:53.329780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:53.329780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:53.329780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:53.329780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:53.330603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:53.330603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:53.330603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:53.330603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:53.330603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:23:53.330603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:23:53.330603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:23:53.330603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:23:53.330603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:23:53.330603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:23:53.330603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 13:23:53.330603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:53.335027 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 342/679] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Oct 20 13:23:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:23:53.340372 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4893478-fcef-40b6-9e71-4e7c780bf59c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:53.341539 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:53.418329 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37979b-9485-42ff-9d9b-8867c27b1ec7 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:53.452829 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:53.457159 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bcc016-09fb-47f3-9fc1-d6035067fb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:53.457775 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcc016-09fb-47f3-9fc1-d6035067fb12 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:53.458060 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcc016-09fb-47f3-9fc1-d6035067fb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:53.458340 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bcc016-09fb-47f3-9fc1-d6035067fb12 None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:53.459006 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcc016-09fb-47f3-9fc1-d6035067fb12 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:53.459326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcc016-09fb-47f3-9fc1-d6035067fb12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:53.460701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bcc016-09fb-47f3-9fc1-d6035067fb12 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:53.461487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4893478-fcef-40b6-9e71-4e7c780bf59c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:53.465614 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 338/680] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Oct 20 13:23:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:53.468253 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2df1a-d446-4276-aec6-39730786511b None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:53.469199 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2df1a-d446-4276-aec6-39730786511b None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:53.469544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2df1a-d446-4276-aec6-39730786511b None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:53.474971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 339/681] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:53.475799 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2df1a-d446-4276-aec6-39730786511b None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:53.504695 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7961e36b-fbc4-4bde-a2fc-b76da4899e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:53.505492 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e36b-fbc4-4bde-a2fc-b76da4899e01 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:53.505604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e36b-fbc4-4bde-a2fc-b76da4899e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:53.505850 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7961e36b-fbc4-4bde-a2fc-b76da4899e01 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:53.506498 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961e36b-fbc4-4bde-a2fc-b76da4899e01 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:53.506805 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961e36b-fbc4-4bde-a2fc-b76da4899e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:53.508205 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7961e36b-fbc4-4bde-a2fc-b76da4899e01 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:53.522467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 343/682] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Oct 20 13:23:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:53.522467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44183320-01ad-4c2e-bef9-c9eaba722d57 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:53.522467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44183320-01ad-4c2e-bef9-c9eaba722d57 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:53.522467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44183320-01ad-4c2e-bef9-c9eaba722d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:53.542800 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-44183320-01ad-4c2e-bef9-c9eaba722d57 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:53.544134 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-44183320-01ad-4c2e-bef9-c9eaba722d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:53.585840 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:53.598063 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2df1a-d446-4276-aec6-39730786511b None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:53.618080 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 344/683] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:53.628133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44183320-01ad-4c2e-bef9-c9eaba722d57 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:53.635070 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6dff8-058f-4504-87ab-ee8e52db0358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:53.635746 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6dff8-058f-4504-87ab-ee8e52db0358 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:53.636029 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6dff8-058f-4504-87ab-ee8e52db0358 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:53.636305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6dff8-058f-4504-87ab-ee8e52db0358 None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:53.636938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6dff8-058f-4504-87ab-ee8e52db0358 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:53.637302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6dff8-058f-4504-87ab-ee8e52db0358 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:53.638683 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6dff8-058f-4504-87ab-ee8e52db0358 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:53.649974 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 340/684] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Oct 20 13:23:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:53.650913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6dff8-058f-4504-87ab-ee8e52db0358 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:53.723623 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:53.739715 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44183320-01ad-4c2e-bef9-c9eaba722d57 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:53.761725 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6dff8-058f-4504-87ab-ee8e52db0358 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:53.776897 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f24d40-b671-43b2-b652-7de5d2afa7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:53.777521 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f24d40-b671-43b2-b652-7de5d2afa7ca None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:53.777803 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f24d40-b671-43b2-b652-7de5d2afa7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:53.778083 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f24d40-b671-43b2-b652-7de5d2afa7ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:53.788423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f24d40-b671-43b2-b652-7de5d2afa7ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:53.790135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f24d40-b671-43b2-b652-7de5d2afa7ca None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:53.798141 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f0122b-6401-41a2-99c2-a9144620d5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:53.798750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0122b-6401-41a2-99c2-a9144620d5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:53.799058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0122b-6401-41a2-99c2-a9144620d5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:53.799351 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0122b-6401-41a2-99c2-a9144620d5a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:53.800443 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0122b-6401-41a2-99c2-a9144620d5a9 None admin] RBAC: Adding query filter params (interface=public, service_id=ec2561d28e60447ebb78fd994489c512, region_id=RegionOne) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:53.800803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0122b-6401-41a2-99c2-a9144620d5a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:53.802559 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f0122b-6401-41a2-99c2-a9144620d5a9 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:53.807783 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 341/685] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Oct 20 13:23:53 2022] GET /identity/v3/endpoints?service_id=ec2561d28e60447ebb78fd994489c512&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:53.808941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edefef8-ac7e-496c-830e-a25309ddce07 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:53.809225 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edefef8-ac7e-496c-830e-a25309ddce07 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:53.809502 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edefef8-ac7e-496c-830e-a25309ddce07 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:53.810648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-79f24d40-b671-43b2-b652-7de5d2afa7ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:53.810648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:53.810648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:53.810648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:53.810648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:53.810648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:53.810648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:53.810648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:53.810648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:53.810648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:53.810648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:53.810648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:53.810648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:53.810648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:53.810648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:53.810648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:53.811758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:53.811758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:53.811758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:53.811758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:53.811758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:53.811758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:53.811758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:53.811758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:53.811758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:53.811758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:53.811758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:53.811758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:53.811758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:53.811758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:53.811758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:53.811758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:53.811758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:53.813855 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:53.813855 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:53.813855 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:53.814040 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 342/686] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:53.819500 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 345/687] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:53.819714 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edefef8-ac7e-496c-830e-a25309ddce07 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:53.819886 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75e2a-bc1b-40e7-b458-bc67141c6d4d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:53.819886 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75e2a-bc1b-40e7-b458-bc67141c6d4d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:53.819886 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75e2a-bc1b-40e7-b458-bc67141c6d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:53.838855 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d1b75e2a-bc1b-40e7-b458-bc67141c6d4d None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:53.839361 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:53.840087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d1b75e2a-bc1b-40e7-b458-bc67141c6d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:53.914360 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 346/688] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:53.915508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b75e2a-bc1b-40e7-b458-bc67141c6d4d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:53.938490 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edefef8-ac7e-496c-830e-a25309ddce07 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:53.975995 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8323b0f-4f81-4531-b7b9-c60bfb380635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:53.976862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8323b0f-4f81-4531-b7b9-c60bfb380635 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:53.977326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8323b0f-4f81-4531-b7b9-c60bfb380635 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:53.977807 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8323b0f-4f81-4531-b7b9-c60bfb380635 None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:53.978424 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8323b0f-4f81-4531-b7b9-c60bfb380635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:53.979816 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8323b0f-4f81-4531-b7b9-c60bfb380635 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:53.998977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 343/689] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Oct 20 13:23:53 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:23:53.998977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8323b0f-4f81-4531-b7b9-c60bfb380635 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:54.009510 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:54.051344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b75e2a-bc1b-40e7-b458-bc67141c6d4d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:54.092641 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ec6f9-bc0a-4de7-9982-f9f37254d566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:54.093328 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ec6f9-bc0a-4de7-9982-f9f37254d566 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:54.094145 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ec6f9-bc0a-4de7-9982-f9f37254d566 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:54.094608 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ec6f9-bc0a-4de7-9982-f9f37254d566 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:54.095302 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ec6f9-bc0a-4de7-9982-f9f37254d566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:54.095608 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ec6f9-bc0a-4de7-9982-f9f37254d566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:54.096996 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ec6f9-bc0a-4de7-9982-f9f37254d566 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:54.110884 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 347/690] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:54.114234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:54.116613 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ec6f9-bc0a-4de7-9982-f9f37254d566 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:54.140320 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8323b0f-4f81-4531-b7b9-c60bfb380635 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:54.190549 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32a704-5dc7-40cf-9e38-2310525e7b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:54.191218 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a704-5dc7-40cf-9e38-2310525e7b9b None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:54.191496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a704-5dc7-40cf-9e38-2310525e7b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:54.191764 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a704-5dc7-40cf-9e38-2310525e7b9b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:54.193031 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32a704-5dc7-40cf-9e38-2310525e7b9b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:54.193713 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32a704-5dc7-40cf-9e38-2310525e7b9b None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:54.205022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-ed32a704-5dc7-40cf-9e38-2310525e7b9b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 13:23:54.205022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:54.205022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:23:54.205022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:23:54.205022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:23:54.205022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:23:54.205022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:23:54.205022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:54.205022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 13:23:54.205022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:54.205022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:54.205022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:54.205022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:54.205022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:54.205022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:54.205022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:54.206158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:54.206158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:54.206158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:54.206158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:54.206158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:54.206158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:54.206158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:54.206158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:23:54.206158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:23:54.206158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:23:54.206158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:23:54.206158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:54.206158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:54.206158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:54.206158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:54.206158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:54.206158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:54.207285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:54.207285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:54.207285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:54.207285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:54.207285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:54.207285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:54.207285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:54.207285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:54.207285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:54.207285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:54.207285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:23:54.207285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:54.207285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 20 13:23:54.207285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:54.207285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 344/691] 10.222.0.36 () {56 vars in 1132 bytes} [Thu Oct 20 13:23:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:54.208229 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32a704-5dc7-40cf-9e38-2310525e7b9b None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:54.239432 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ec6f9-bc0a-4de7-9982-f9f37254d566 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:54.268290 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:54.277969 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843db0b2-821e-4a7c-ab35-237b2020d2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:54.278598 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843db0b2-821e-4a7c-ab35-237b2020d2be None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:54.278879 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843db0b2-821e-4a7c-ab35-237b2020d2be None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:54.279182 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843db0b2-821e-4a7c-ab35-237b2020d2be None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:54.287884 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843db0b2-821e-4a7c-ab35-237b2020d2be None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:54.289320 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843db0b2-821e-4a7c-ab35-237b2020d2be None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:54.302028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-843db0b2-821e-4a7c-ab35-237b2020d2be None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 13:23:54.302028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:54.302028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:54.302028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:54.302028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:54.302028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:54.302028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:54.302028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:54.302028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:54.302028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:54.302028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:54.302028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:54.302028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:23:54.302028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:23:54.302028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:23:54.302028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:54.303029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:54.303950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:54.303950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:54.303950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:23:54.303950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:23:54.303950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:23:54.303950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:23:54.303950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:23:54.303950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:23:54.303950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 20 13:23:54.303950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:54.308029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 348/692] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Oct 20 13:23:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:23:54.308639 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843db0b2-821e-4a7c-ab35-237b2020d2be None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:54.317872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32a704-5dc7-40cf-9e38-2310525e7b9b None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:54.353328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95decc51-558d-49ed-9934-39031d89ace6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:54.353959 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95decc51-558d-49ed-9934-39031d89ace6 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:54.354236 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95decc51-558d-49ed-9934-39031d89ace6 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:54.354516 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95decc51-558d-49ed-9934-39031d89ace6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:54.355130 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95decc51-558d-49ed-9934-39031d89ace6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:54.356505 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95decc51-558d-49ed-9934-39031d89ace6 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:54.366406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-95decc51-558d-49ed-9934-39031d89ace6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 13:23:54.366406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:54.366406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:23:54.366406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:23:54.366406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:23:54.366406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:23:54.366406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:23:54.366406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:54.366406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 13:23:54.366406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:54.366406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:54.366406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:54.366406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:54.366406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:54.366406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:54.366406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:54.366406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:54.367577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:54.367577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:54.367577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:54.367577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:54.367577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:54.367577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:54.367577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:23:54.367577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:23:54.367577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:23:54.367577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:23:54.367577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:54.367577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:54.367577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:54.367577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:54.367577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:54.367577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:54.368455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:54.368455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:54.368455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:54.368455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:54.368455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:54.368455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:54.368455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:54.368455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:54.368455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:54.368455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:54.368455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:23:54.368455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:54.368455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 13:23:54.368455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:54.368455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 345/693] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Oct 20 13:23:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:54.369269 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95decc51-558d-49ed-9934-39031d89ace6 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:54.384032 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:54.424271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843db0b2-821e-4a7c-ab35-237b2020d2be None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:54.460605 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a06dcd-c516-4d21-a5e6-08bb5a618f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:54.461478 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a06dcd-c516-4d21-a5e6-08bb5a618f2d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:54.461905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a06dcd-c516-4d21-a5e6-08bb5a618f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:54.462324 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a06dcd-c516-4d21-a5e6-08bb5a618f2d None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:54.463145 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a06dcd-c516-4d21-a5e6-08bb5a618f2d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:54.463496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a06dcd-c516-4d21-a5e6-08bb5a618f2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:54.464899 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a06dcd-c516-4d21-a5e6-08bb5a618f2d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:54.475034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 349/694] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Oct 20 13:23:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:54.475964 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a06dcd-c516-4d21-a5e6-08bb5a618f2d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:54.478797 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95decc51-558d-49ed-9934-39031d89ace6 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:54.513083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0343bb0-ee5c-408f-9c78-5cdecbf22276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:54.513612 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0343bb0-ee5c-408f-9c78-5cdecbf22276 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:54.513887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0343bb0-ee5c-408f-9c78-5cdecbf22276 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:54.514154 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0343bb0-ee5c-408f-9c78-5cdecbf22276 None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:54.514888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0343bb0-ee5c-408f-9c78-5cdecbf22276 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:54.515209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0343bb0-ee5c-408f-9c78-5cdecbf22276 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:54.517147 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0343bb0-ee5c-408f-9c78-5cdecbf22276 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:54.538987 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:54.540379 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 346/695] 10.222.0.36 () {56 vars in 1149 bytes} [Thu Oct 20 13:23:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:54.541280 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0343bb0-ee5c-408f-9c78-5cdecbf22276 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:54.591257 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a06dcd-c516-4d21-a5e6-08bb5a618f2d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:54.613758 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:54.628514 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6d3b5-c5b2-448c-866d-5ce400a51b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:54.629153 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6d3b5-c5b2-448c-866d-5ce400a51b1e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:54.629434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6d3b5-c5b2-448c-866d-5ce400a51b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:54.629768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6d3b5-c5b2-448c-866d-5ce400a51b1e None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:54.630423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6d3b5-c5b2-448c-866d-5ce400a51b1e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:54.630731 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6d3b5-c5b2-448c-866d-5ce400a51b1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:54.632135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6d3b5-c5b2-448c-866d-5ce400a51b1e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:54.637220 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 350/696] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Oct 20 13:23:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:54.638066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6d3b5-c5b2-448c-866d-5ce400a51b1e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:54.653451 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0343bb0-ee5c-408f-9c78-5cdecbf22276 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:54.690930 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347fa5c-f877-4093-ad8c-348ad1a9798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:54.691855 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347fa5c-f877-4093-ad8c-348ad1a9798d None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:54.692320 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347fa5c-f877-4093-ad8c-348ad1a9798d None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:54.692777 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347fa5c-f877-4093-ad8c-348ad1a9798d None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:54.693723 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347fa5c-f877-4093-ad8c-348ad1a9798d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:54.694211 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347fa5c-f877-4093-ad8c-348ad1a9798d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:54.695945 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a347fa5c-f877-4093-ad8c-348ad1a9798d None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:54.701504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 347/697] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Oct 20 13:23:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:54.702616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347fa5c-f877-4093-ad8c-348ad1a9798d None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:54.752781 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6d3b5-c5b2-448c-866d-5ce400a51b1e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:54.771663 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:54.792884 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413bdf6-0ab5-4777-bfe7-844c697da01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:54.793588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413bdf6-0ab5-4777-bfe7-844c697da01e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:54.793949 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413bdf6-0ab5-4777-bfe7-844c697da01e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:54.794296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413bdf6-0ab5-4777-bfe7-844c697da01e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:54.814702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347fa5c-f877-4093-ad8c-348ad1a9798d None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:54.849168 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:54.854860 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead5bf6-5cb1-422f-8f60-7ac20c0625e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:54.856232 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead5bf6-5cb1-422f-8f60-7ac20c0625e5 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:54.856513 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead5bf6-5cb1-422f-8f60-7ac20c0625e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:54.856836 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead5bf6-5cb1-422f-8f60-7ac20c0625e5 None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:54.857470 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead5bf6-5cb1-422f-8f60-7ac20c0625e5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:54.857778 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead5bf6-5cb1-422f-8f60-7ac20c0625e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:54.859323 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead5bf6-5cb1-422f-8f60-7ac20c0625e5 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:54.869662 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 348/698] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Oct 20 13:23:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:54.869662 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead5bf6-5cb1-422f-8f60-7ac20c0625e5 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:54.873925 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413bdf6-0ab5-4777-bfe7-844c697da01e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:54.876017 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413bdf6-0ab5-4777-bfe7-844c697da01e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:54.982918 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead5bf6-5cb1-422f-8f60-7ac20c0625e5 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:54.990125 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 351/699] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:23:54 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 13:23:54.990863 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413bdf6-0ab5-4777-bfe7-844c697da01e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:55.007695 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:55.023429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef251c2-6378-4206-9987-462f186a5d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:55.023982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef251c2-6378-4206-9987-462f186a5d82 None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:55.024271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef251c2-6378-4206-9987-462f186a5d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:55.024548 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef251c2-6378-4206-9987-462f186a5d82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:55.025214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef251c2-6378-4206-9987-462f186a5d82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:55.026587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef251c2-6378-4206-9987-462f186a5d82 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:55.048048 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 349/700] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:23:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:23:55.048860 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef251c2-6378-4206-9987-462f186a5d82 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:55.113350 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:55.135027 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413bdf6-0ab5-4777-bfe7-844c697da01e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:55.188574 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078196df-789c-415d-a1c6-f500d7e87680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:55.189205 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078196df-789c-415d-a1c6-f500d7e87680 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:55.189488 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078196df-789c-415d-a1c6-f500d7e87680 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:55.189766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078196df-789c-415d-a1c6-f500d7e87680 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:55.190496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078196df-789c-415d-a1c6-f500d7e87680 None admin] RBAC: Adding query filter params (interface=public, service_id=2f7907a37917444bb5f369819dfba224, region_id=RegionOne) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:55.190811 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078196df-789c-415d-a1c6-f500d7e87680 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:55.192265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078196df-789c-415d-a1c6-f500d7e87680 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:55.193605 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef251c2-6378-4206-9987-462f186a5d82 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:55.206708 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 352/701] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Oct 20 13:23:54 2022] GET /identity/v3/endpoints?service_id=2f7907a37917444bb5f369819dfba224&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:55.207743 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078196df-789c-415d-a1c6-f500d7e87680 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:55.241189 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b62aa-1938-40ad-9d4c-5b915162aa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:55.241952 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b62aa-1938-40ad-9d4c-5b915162aa7f None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:55.242228 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b62aa-1938-40ad-9d4c-5b915162aa7f None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:55.242508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b62aa-1938-40ad-9d4c-5b915162aa7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:55.253918 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b62aa-1938-40ad-9d4c-5b915162aa7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:55.255408 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b62aa-1938-40ad-9d4c-5b915162aa7f None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:55.271430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-170b62aa-1938-40ad-9d4c-5b915162aa7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:55.271430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:55.271430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:55.271430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:55.271430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:55.271430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:55.271430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:55.271430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:55.271430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:55.271430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:55.271430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:55.271430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:55.271430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:23:55.271430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:23:55.271430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:23:55.271430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:23:55.272546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:55.272546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:55.272546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:55.272546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:55.272546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:55.272546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:55.272546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:55.272546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:55.272546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:55.272546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:55.272546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:55.272546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:55.272546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:55.272546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:55.272546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:55.272546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:55.272546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:23:55.273424 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:23:55.273424 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:23:55.273424 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:55.273424 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 350/702] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:55.279064 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b62aa-1938-40ad-9d4c-5b915162aa7f None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:55.309157 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:55.338703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078196df-789c-415d-a1c6-f500d7e87680 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:55.378824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20882c44-a80b-4466-8cd1-03d15aea56ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:55.379544 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20882c44-a80b-4466-8cd1-03d15aea56ea None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:55.379994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20882c44-a80b-4466-8cd1-03d15aea56ea None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:55.380267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20882c44-a80b-4466-8cd1-03d15aea56ea None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:55.380869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20882c44-a80b-4466-8cd1-03d15aea56ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:55.382359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20882c44-a80b-4466-8cd1-03d15aea56ea None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:55.389974 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 353/703] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Oct 20 13:23:55 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:23:55.408448 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:55.412167 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b62aa-1938-40ad-9d4c-5b915162aa7f None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:55.452467 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb8c3c-55a9-4707-b7a5-41f2f14c3c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:55.453242 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb8c3c-55a9-4707-b7a5-41f2f14c3c42 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:55.453506 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb8c3c-55a9-4707-b7a5-41f2f14c3c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:55.453775 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb8c3c-55a9-4707-b7a5-41f2f14c3c42 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:55.454434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb8c3c-55a9-4707-b7a5-41f2f14c3c42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:55.454766 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb8c3c-55a9-4707-b7a5-41f2f14c3c42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:55.456197 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb8c3c-55a9-4707-b7a5-41f2f14c3c42 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:55.474805 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 351/704] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:55.476254 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20882c44-a80b-4466-8cd1-03d15aea56ea None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:55.587642 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20882c44-a80b-4466-8cd1-03d15aea56ea None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:55.627445 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa868a-297f-428a-b8d9-71ce03cb1fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:55.628074 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa868a-297f-428a-b8d9-71ce03cb1fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:55.628347 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa868a-297f-428a-b8d9-71ce03cb1fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:55.628613 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa868a-297f-428a-b8d9-71ce03cb1fa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:55.635548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa868a-297f-428a-b8d9-71ce03cb1fa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:55.636981 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa868a-297f-428a-b8d9-71ce03cb1fa9 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:55.639541 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:55.649476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-c8aa868a-297f-428a-b8d9-71ce03cb1fa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:55.649476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:55.649476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:55.649476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:55.649476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:55.649476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:55.649476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:55.649476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:55.649476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:55.649476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:55.649476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:55.649476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:55.649476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:23:55.649476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:23:55.649476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:23:55.650416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:23:55.650416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:55.650416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:55.650416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:55.650416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:55.650416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:55.650416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:55.650416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:55.650416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:55.650416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:55.650416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:55.650416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:55.650416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:55.650416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:55.650416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:55.650416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:55.650416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:55.651359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:23:55.651359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:23:55.651359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:23:55.651359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:23:55.651359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:23:55.651359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:23:55.651359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:23:55.651359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:55.651814 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 354/705] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:55.657434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb8c3c-55a9-4707-b7a5-41f2f14c3c42 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:55.766008 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb8c3c-55a9-4707-b7a5-41f2f14c3c42 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:55.803020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82a7df-5a19-45f8-85cd-87e533b0c7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:55.803989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82a7df-5a19-45f8-85cd-87e533b0c7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:55.804469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82a7df-5a19-45f8-85cd-87e533b0c7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:55.804956 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82a7df-5a19-45f8-85cd-87e533b0c7d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:55.805827 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82a7df-5a19-45f8-85cd-87e533b0c7d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:55.806304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82a7df-5a19-45f8-85cd-87e533b0c7d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:55.807949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82a7df-5a19-45f8-85cd-87e533b0c7d9 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:55.821553 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 352/706] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:23:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:55.828704 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa868a-297f-428a-b8d9-71ce03cb1fa9 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:55.944899 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa868a-297f-428a-b8d9-71ce03cb1fa9 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:55.982886 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394d0e0f-cba2-4336-bef6-f19f1d3ce25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:55.983525 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d0e0f-cba2-4336-bef6-f19f1d3ce25e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:55.983799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d0e0f-cba2-4336-bef6-f19f1d3ce25e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:55.984090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d0e0f-cba2-4336-bef6-f19f1d3ce25e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:55.985264 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d0e0f-cba2-4336-bef6-f19f1d3ce25e None admin] RBAC: Adding query filter params (role.id=248eca0e6d1f475aa038270f567786ba, scope.project.id=c25f337a79704728adaa03f4103eef1c, user.id=44342daa668c4516ae131d9f0160261f) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:55.985580 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d0e0f-cba2-4336-bef6-f19f1d3ce25e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:55.987034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394d0e0f-cba2-4336-bef6-f19f1d3ce25e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:55.993339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 355/707] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:23:55 2022] GET /identity/v3/role_assignments?user.id=44342daa668c4516ae131d9f0160261f&scope.project.id=c25f337a79704728adaa03f4103eef1c&role.id=248eca0e6d1f475aa038270f567786ba => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:56.249058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b10cfe-6892-44b6-9b9c-02fe345c02fc None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:56.250250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b10cfe-6892-44b6-9b9c-02fe345c02fc None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:56.250740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b10cfe-6892-44b6-9b9c-02fe345c02fc None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:56.252611 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 353/708] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:56.258041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949ae1-8ab2-40f5-8135-f4a17b62d54c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:56.258563 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949ae1-8ab2-40f5-8135-f4a17b62d54c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:56.259120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf949ae1-8ab2-40f5-8135-f4a17b62d54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:56.277694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-bf949ae1-8ab2-40f5-8135-f4a17b62d54c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:56.279232 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-bf949ae1-8ab2-40f5-8135-f4a17b62d54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:56.339283 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:56.349303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 356/709] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 13:23:56.619541 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b10cfe-6892-44b6-9b9c-02fe345c02fc None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:56.643085 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:56.732090 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b10cfe-6892-44b6-9b9c-02fe345c02fc None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:56.768366 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e5b8f-7bfd-4d98-843b-9637b2df26ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:56.769063 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e5b8f-7bfd-4d98-843b-9637b2df26ee None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:56.769343 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e5b8f-7bfd-4d98-843b-9637b2df26ee None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:56.769617 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e5b8f-7bfd-4d98-843b-9637b2df26ee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:56.770256 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e5b8f-7bfd-4d98-843b-9637b2df26ee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:56.771701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e5b8f-7bfd-4d98-843b-9637b2df26ee None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:56.782011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-d93e5b8f-7bfd-4d98-843b-9637b2df26ee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 13:23:56.782011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:56.782011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:23:56.782011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:23:56.782011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:23:56.782011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:23:56.782011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:23:56.782011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:56.782011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 13:23:56.782011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:56.782011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:56.782011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:56.782011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:56.782011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:56.782011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:56.782011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:56.782011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:56.783262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:56.783262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:56.783262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:56.783262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:56.783262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:56.783262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:56.783262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:23:56.783262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:23:56.783262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:23:56.783262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:23:56.783262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:56.783262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:56.783262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:56.783262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:56.783262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:56.783262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:56.784093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:56.784093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:56.784093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:56.784093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:56.784093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:56.784093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:56.784093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:56.784093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:56.784093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:56.784093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:56.784093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:23:56.784093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:56.784093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 13:23:56.784093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:56.784093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 354/710] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Oct 20 13:23:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:56.789381 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf949ae1-8ab2-40f5-8135-f4a17b62d54c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:56.890221 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf949ae1-8ab2-40f5-8135-f4a17b62d54c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:56.927141 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e4cce-1b85-40a4-8de3-d37147c2eea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:56.927758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e4cce-1b85-40a4-8de3-d37147c2eea4 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:56.928038 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e4cce-1b85-40a4-8de3-d37147c2eea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:56.928312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e4cce-1b85-40a4-8de3-d37147c2eea4 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:56.928938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e4cce-1b85-40a4-8de3-d37147c2eea4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:56.929243 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e4cce-1b85-40a4-8de3-d37147c2eea4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:56.930596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e4cce-1b85-40a4-8de3-d37147c2eea4 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:56.935704 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 357/711] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Oct 20 13:23:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:56.941993 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e5b8f-7bfd-4d98-843b-9637b2df26ee None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:57.034428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:57.051334 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e5b8f-7bfd-4d98-843b-9637b2df26ee None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:57.094650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c630eea-3d13-48a9-b83a-0d440efa06dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:57.095284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c630eea-3d13-48a9-b83a-0d440efa06dd None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:57.095565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c630eea-3d13-48a9-b83a-0d440efa06dd None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:57.095830 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c630eea-3d13-48a9-b83a-0d440efa06dd None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:57.096447 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c630eea-3d13-48a9-b83a-0d440efa06dd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:57.096744 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c630eea-3d13-48a9-b83a-0d440efa06dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:57.098095 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c630eea-3d13-48a9-b83a-0d440efa06dd None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:57.103375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 355/712] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Oct 20 13:23:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:57.108898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e4cce-1b85-40a4-8de3-d37147c2eea4 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:57.172417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:57.217524 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e4cce-1b85-40a4-8de3-d37147c2eea4 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:57.256965 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f0a9a-7cec-4c68-948c-3d40fadb0858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:57.257586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f0a9a-7cec-4c68-948c-3d40fadb0858 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:57.257864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f0a9a-7cec-4c68-948c-3d40fadb0858 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:57.258195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f0a9a-7cec-4c68-948c-3d40fadb0858 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:57.258871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f0a9a-7cec-4c68-948c-3d40fadb0858 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:57.260349 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f0a9a-7cec-4c68-948c-3d40fadb0858 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:57.286245 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 358/713] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:23:57 2022] POST /identity/v3/endpoints => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:23:57.335235 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9ca8d-90bf-466b-85e2-80b831e88eca None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:57.335534 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9ca8d-90bf-466b-85e2-80b831e88eca None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:57.335784 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9ca8d-90bf-466b-85e2-80b831e88eca None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:57.337453 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 356/714] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:57.343240 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c714f-ae6a-40b5-aabb-204ec0b35885 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:57.343778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c714f-ae6a-40b5-aabb-204ec0b35885 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:57.344081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c714f-ae6a-40b5-aabb-204ec0b35885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:57.365887 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-837c714f-ae6a-40b5-aabb-204ec0b35885 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:57.367319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-837c714f-ae6a-40b5-aabb-204ec0b35885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:57.455389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 359/715] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:57.731186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9ca8d-90bf-466b-85e2-80b831e88eca None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:57.765251 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148bd84-87cc-414a-8b39-3a185800d49e None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:57.766633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148bd84-87cc-414a-8b39-3a185800d49e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:57.767146 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148bd84-87cc-414a-8b39-3a185800d49e None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:57.768903 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 360/716] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:57.774164 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c372921-3138-4b5e-a2dd-3dc08aaf908d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:57.774714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c372921-3138-4b5e-a2dd-3dc08aaf908d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:57.775253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c372921-3138-4b5e-a2dd-3dc08aaf908d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:57.794125 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-8c372921-3138-4b5e-a2dd-3dc08aaf908d None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:57.795683 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8c372921-3138-4b5e-a2dd-3dc08aaf908d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:57.834444 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:57.858362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a9ca8d-90bf-466b-85e2-80b831e88eca None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:57.871324 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 361/717] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 13:23:57.907309 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87861a20-3b8d-478b-abe5-8c644adc2f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:57.907956 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87861a20-3b8d-478b-abe5-8c644adc2f1e None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:57.908239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87861a20-3b8d-478b-abe5-8c644adc2f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:57.908511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87861a20-3b8d-478b-abe5-8c644adc2f1e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:57.909095 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87861a20-3b8d-478b-abe5-8c644adc2f1e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:57.910521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87861a20-3b8d-478b-abe5-8c644adc2f1e None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:57.920214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-87861a20-3b8d-478b-abe5-8c644adc2f1e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 13:23:57.920214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:57.920214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:23:57.920214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:23:57.920214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:23:57.920214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:23:57.920214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:23:57.920214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:57.920214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 13:23:57.920214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:57.920214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:57.920214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:57.920214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:57.920214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:57.920214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:57.920214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:57.920214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:57.921213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:57.921213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:57.921213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:57.921213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:57.921213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:57.921213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:57.921213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:23:57.921213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:23:57.921213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:23:57.921213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:23:57.921213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:57.921213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:57.921213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:57.921213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:57.921213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:57.921213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:57.922898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:57.922898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:57.922898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:57.922898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:57.922898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:57.922898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:57.922898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:57.922898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:57.922898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:57.922898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:57.922898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:23:57.922898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:57.922898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 13:23:57.922898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:57.922898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 357/718] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:23:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:57.927950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c372921-3138-4b5e-a2dd-3dc08aaf908d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:58.031512 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c372921-3138-4b5e-a2dd-3dc08aaf908d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:58.067911 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c8159-c524-458b-b86e-2bb73ad4bf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:58.068533 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c8159-c524-458b-b86e-2bb73ad4bf58 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:58.068811 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c8159-c524-458b-b86e-2bb73ad4bf58 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:58.069083 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c8159-c524-458b-b86e-2bb73ad4bf58 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:58.069712 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c8159-c524-458b-b86e-2bb73ad4bf58 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:58.070014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c8159-c524-458b-b86e-2bb73ad4bf58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:58.071407 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c8159-c524-458b-b86e-2bb73ad4bf58 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:58.076524 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 362/719] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Oct 20 13:23:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:58.083054 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87861a20-3b8d-478b-abe5-8c644adc2f1e None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:58.099100 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:58.167405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c8159-c524-458b-b86e-2bb73ad4bf58 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:58.197867 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87861a20-3b8d-478b-abe5-8c644adc2f1e None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:58.209034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:58.248432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e8edf-34e7-44b1-82f9-71323cdf90b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:58.249962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e8edf-34e7-44b1-82f9-71323cdf90b7 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:58.250525 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e8edf-34e7-44b1-82f9-71323cdf90b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:58.251311 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e8edf-34e7-44b1-82f9-71323cdf90b7 None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:58.252169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e8edf-34e7-44b1-82f9-71323cdf90b7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:58.252852 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e8edf-34e7-44b1-82f9-71323cdf90b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:58.255617 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e8edf-34e7-44b1-82f9-71323cdf90b7 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:58.261810 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 358/720] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Oct 20 13:23:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:58.297345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c8159-c524-458b-b86e-2bb73ad4bf58 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:58.316335 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e0d4-6a95-4dd1-9b97-915bfcc3fa15 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:58.316668 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e0d4-6a95-4dd1-9b97-915bfcc3fa15 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:58.316889 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e0d4-6a95-4dd1-9b97-915bfcc3fa15 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:58.318529 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 359/721] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:23:58.327090 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c28a0-eadc-4cee-9b84-ac487eec68e0 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:58.327391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c28a0-eadc-4cee-9b84-ac487eec68e0 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:58.327646 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c28a0-eadc-4cee-9b84-ac487eec68e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:58.339469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96034eea-d866-4483-88be-ebcf07a45116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:58.340120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96034eea-d866-4483-88be-ebcf07a45116 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:58.340400 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96034eea-d866-4483-88be-ebcf07a45116 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:58.340673 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96034eea-d866-4483-88be-ebcf07a45116 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:58.341269 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96034eea-d866-4483-88be-ebcf07a45116 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:58.342677 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96034eea-d866-4483-88be-ebcf07a45116 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:58.351005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-a41c28a0-eadc-4cee-9b84-ac487eec68e0 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:58.352289 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a41c28a0-eadc-4cee-9b84-ac487eec68e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:58.353135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-96034eea-d866-4483-88be-ebcf07a45116 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 13:23:58.353135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:58.353135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:23:58.353135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:23:58.353135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:23:58.353135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:23:58.353135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:23:58.353135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:58.353135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 13:23:58.353135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:58.353135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:58.353135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:58.353135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:58.353135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:58.353135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:58.353135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:58.353135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:58.354066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:58.354066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:58.354066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:58.354066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:58.354066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:58.354066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:58.354066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:23:58.354066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:23:58.354066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:23:58.354066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:23:58.354066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:58.354066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:58.354066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:58.354066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:58.354066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:58.354066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:58.354902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:58.354902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:58.354902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:58.354902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:58.354902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:58.354902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:58.354902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:58.354902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:58.354902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:58.354902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:58.354902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:23:58.354902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:58.354902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 20 13:23:58.354902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:23:58.354902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 363/722] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Oct 20 13:23:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:23:58.360690 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96034eea-d866-4483-88be-ebcf07a45116 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:58.451372 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 360/723] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 13:23:58.477266 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:58.480933 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96034eea-d866-4483-88be-ebcf07a45116 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:58.518099 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690aafd-b5d6-4386-8289-6db064e9eca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:58.518719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690aafd-b5d6-4386-8289-6db064e9eca8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:58.519027 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690aafd-b5d6-4386-8289-6db064e9eca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:58.519304 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690aafd-b5d6-4386-8289-6db064e9eca8 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:58.519941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690aafd-b5d6-4386-8289-6db064e9eca8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:58.520248 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690aafd-b5d6-4386-8289-6db064e9eca8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:58.521615 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690aafd-b5d6-4386-8289-6db064e9eca8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:58.527015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 364/724] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Oct 20 13:23:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:58.533162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c28a0-eadc-4cee-9b84-ac487eec68e0 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:58.542365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:58.639430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c28a0-eadc-4cee-9b84-ac487eec68e0 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:58.676329 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d45060-af60-46ac-87e5-1d2bc90e02c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:58.677279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d45060-af60-46ac-87e5-1d2bc90e02c4 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:58.677755 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d45060-af60-46ac-87e5-1d2bc90e02c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:58.678209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d45060-af60-46ac-87e5-1d2bc90e02c4 None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:58.679040 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d45060-af60-46ac-87e5-1d2bc90e02c4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:58.679556 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d45060-af60-46ac-87e5-1d2bc90e02c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:58.681166 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d45060-af60-46ac-87e5-1d2bc90e02c4 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:58.686888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 361/725] 10.222.0.36 () {56 vars in 1114 bytes} [Thu Oct 20 13:23:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:23:58.694934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690aafd-b5d6-4386-8289-6db064e9eca8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:58.728482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d45060-af60-46ac-87e5-1d2bc90e02c4 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:58.803206 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:58.807382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690aafd-b5d6-4386-8289-6db064e9eca8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:58.846002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d45060-af60-46ac-87e5-1d2bc90e02c4 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:58.852476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cb1ec-8963-4277-8140-b0e6833fc86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:58.853333 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb1ec-8963-4277-8140-b0e6833fc86b None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:58.853796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb1ec-8963-4277-8140-b0e6833fc86b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:58.854272 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb1ec-8963-4277-8140-b0e6833fc86b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:58.855160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cb1ec-8963-4277-8140-b0e6833fc86b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:58.856701 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cb1ec-8963-4277-8140-b0e6833fc86b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:58.888873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6957d-533b-487f-9c49-9b2337aa7d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:58.889628 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6957d-533b-487f-9c49-9b2337aa7d4f None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:58.889906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6957d-533b-487f-9c49-9b2337aa7d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:58.890702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6957d-533b-487f-9c49-9b2337aa7d4f None admin] PATH_INFO: `/v3/services/image` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:58.891539 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6957d-533b-487f-9c49-9b2337aa7d4f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:58.893144 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6957d-533b-487f-9c49-9b2337aa7d4f None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:58.893613 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 365/726] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:23:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:23:58.903201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-b0b6957d-533b-487f-9c49-9b2337aa7d4f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 13:23:58.903201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:58.903201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:23:58.903201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:23:58.903201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:23:58.903201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:23:58.903201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:23:58.903201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:58.903201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 13:23:58.903201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:58.903201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:23:58.903201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:58.903201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:23:58.903201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:23:58.903201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:23:58.903201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:23:58.903201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:23:58.904419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:23:58.904419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:23:58.904419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:23:58.904419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:23:58.904419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:23:58.904419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:23:58.904419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:23:58.904419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:23:58.904419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:23:58.904419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:23:58.904419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:23:58.904419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:23:58.904419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:23:58.904419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:23:58.904419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:23:58.904419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:23:58.905278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:23:58.905278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:23:58.905278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:23:58.905278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:23:58.905278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:23:58.905278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:23:58.905278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:23:58.905278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:23:58.905278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:23:58.905278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:23:58.905278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:23:58.905278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:23:58.905278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 13:23:58.905278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:23:58.908680 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 362/727] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Oct 20 13:23:58 2022] GET /identity/v3/services/image => generated 86 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:23:58.915081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cb1ec-8963-4277-8140-b0e6833fc86b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:58.937067 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:59.043636 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cb1ec-8963-4277-8140-b0e6833fc86b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:59.082849 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421ac48-6d8c-4470-84f6-caa85249b8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:59.083107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421ac48-6d8c-4470-84f6-caa85249b8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:59.083351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421ac48-6d8c-4470-84f6-caa85249b8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:59.083624 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421ac48-6d8c-4470-84f6-caa85249b8d6 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:59.084262 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421ac48-6d8c-4470-84f6-caa85249b8d6 None admin] RBAC: Adding query filter params (name=image) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:59.084560 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421ac48-6d8c-4470-84f6-caa85249b8d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:59.085940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4421ac48-6d8c-4470-84f6-caa85249b8d6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:59.091399 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 366/728] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:59.097806 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6957d-533b-487f-9c49-9b2337aa7d4f None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:23:59.207940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6957d-533b-487f-9c49-9b2337aa7d4f None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:23:59.245368 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b718a-c199-4778-b674-1e497ad7248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:23:59.246002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b718a-c199-4778-b674-1e497ad7248c None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:59.246286 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b718a-c199-4778-b674-1e497ad7248c None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:59.246627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b718a-c199-4778-b674-1e497ad7248c None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:59.247325 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b718a-c199-4778-b674-1e497ad7248c None admin] RBAC: Adding query filter params (type=image) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:23:59.247690 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b718a-c199-4778-b674-1e497ad7248c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:23:59.249223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b718a-c199-4778-b674-1e497ad7248c None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:23:59.251492 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:23:59.256484 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 363/729] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:23:59 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:23:59.601414 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b1a24-f0e7-413d-8f58-39ca2a6fd676 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:59.601800 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b1a24-f0e7-413d-8f58-39ca2a6fd676 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:59.601994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b1a24-f0e7-413d-8f58-39ca2a6fd676 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:59.603624 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 367/730] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:23:59.608975 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb8732-f030-424e-ac14-5f05f0a4b943 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:23:59.609280 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb8732-f030-424e-ac14-5f05f0a4b943 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:23:59.609538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb8732-f030-424e-ac14-5f05f0a4b943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:23:59.628234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-45eb8732-f030-424e-ac14-5f05f0a4b943 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:23:59.629433 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-45eb8732-f030-424e-ac14-5f05f0a4b943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:23:59.700877 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 364/731] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:23:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:23:59.977054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b1a24-f0e7-413d-8f58-39ca2a6fd676 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:00.061736 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:00.087254 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b1a24-f0e7-413d-8f58-39ca2a6fd676 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:00.127528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bbd3c-18fd-47d8-abe6-5ace78c4fc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:00.128508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bbd3c-18fd-47d8-abe6-5ace78c4fc2a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:00.128992 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bbd3c-18fd-47d8-abe6-5ace78c4fc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:00.129468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bbd3c-18fd-47d8-abe6-5ace78c4fc2a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:00.130247 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bbd3c-18fd-47d8-abe6-5ace78c4fc2a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:00.131847 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bbd3c-18fd-47d8-abe6-5ace78c4fc2a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:00.141864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-cd6bbd3c-18fd-47d8-abe6-5ace78c4fc2a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 13:24:00.141864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:00.141864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:24:00.141864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:24:00.141864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:24:00.141864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:24:00.141864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:24:00.141864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:24:00.141864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 13:24:00.141864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:00.141864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:24:00.141864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:00.141864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:00.141864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:00.141864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:00.141864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:00.141864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:00.142885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:00.142885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:00.142885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:00.142885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:00.142885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:00.142885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:00.142885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:24:00.142885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:24:00.142885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:24:00.142885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:24:00.142885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:00.142885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:00.142885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:00.142885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:00.142885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:00.142885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:00.143746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:00.143746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:00.143746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:00.143746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:00.143746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:00.143746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:00.143746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:00.143746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:00.143746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:00.143746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:00.143746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:24:00.143746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:24:00.143746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 13:24:00.143746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:00.146526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 368/732] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Oct 20 13:23:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:00.152256 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb8732-f030-424e-ac14-5f05f0a4b943 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:00.258326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb8732-f030-424e-ac14-5f05f0a4b943 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:00.286331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:00.296088 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f8964-13b3-4fe4-9130-fbe53a63207a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:00.296759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8964-13b3-4fe4-9130-fbe53a63207a None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:00.297040 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8964-13b3-4fe4-9130-fbe53a63207a None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:00.297316 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8964-13b3-4fe4-9130-fbe53a63207a None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:00.297948 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f8964-13b3-4fe4-9130-fbe53a63207a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:00.298255 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f8964-13b3-4fe4-9130-fbe53a63207a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:00.299662 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f8964-13b3-4fe4-9130-fbe53a63207a None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:00.304899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 365/733] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Oct 20 13:24:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:00.310289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bbd3c-18fd-47d8-abe6-5ace78c4fc2a None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:00.414787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bbd3c-18fd-47d8-abe6-5ace78c4fc2a None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:00.450691 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02418a01-6efc-439a-9632-6bf4cf634843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:00.451710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02418a01-6efc-439a-9632-6bf4cf634843 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:00.452217 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02418a01-6efc-439a-9632-6bf4cf634843 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:00.453328 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02418a01-6efc-439a-9632-6bf4cf634843 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:00.454198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02418a01-6efc-439a-9632-6bf4cf634843 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:00.454716 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02418a01-6efc-439a-9632-6bf4cf634843 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:00.456294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02418a01-6efc-439a-9632-6bf4cf634843 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:00.462020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 369/734] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Oct 20 13:24:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:00.467632 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f8964-13b3-4fe4-9130-fbe53a63207a None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:00.576213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f8964-13b3-4fe4-9130-fbe53a63207a None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:00.611240 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439f638-6943-4e64-b49a-6a3b142742f9 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:00.611869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439f638-6943-4e64-b49a-6a3b142742f9 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:00.612387 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7439f638-6943-4e64-b49a-6a3b142742f9 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:00.614292 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 370/735] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:00.618813 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad92c8-c53c-4949-b232-fe30e1051314 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:00.619294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad92c8-c53c-4949-b232-fe30e1051314 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:00.619778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad92c8-c53c-4949-b232-fe30e1051314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:00.623159 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0f586-e55d-42d7-b53e-2143cc5c0399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:00.623782 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0f586-e55d-42d7-b53e-2143cc5c0399 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:00.624066 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0f586-e55d-42d7-b53e-2143cc5c0399 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:00.624342 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0f586-e55d-42d7-b53e-2143cc5c0399 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:00.625609 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0f586-e55d-42d7-b53e-2143cc5c0399 None admin] RBAC: Adding query filter params (interface=admin, service_id=ec2561d28e60447ebb78fd994489c512, region_id=RegionOne) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:00.625925 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0f586-e55d-42d7-b53e-2143cc5c0399 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:00.627310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0f586-e55d-42d7-b53e-2143cc5c0399 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:00.633125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 366/736] 10.222.0.36 () {56 vars in 1249 bytes} [Thu Oct 20 13:24:00 2022] GET /identity/v3/endpoints?service_id=ec2561d28e60447ebb78fd994489c512&interface=admin®ion_id=RegionOne => generated 193 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:00.635494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:00.638327 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0f586-e55d-42d7-b53e-2143cc5c0399 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:00.644068 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-67ad92c8-c53c-4949-b232-fe30e1051314 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:00.645540 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-67ad92c8-c53c-4949-b232-fe30e1051314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:00.711067 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:00.734019 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 371/737] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:00.747232 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0f586-e55d-42d7-b53e-2143cc5c0399 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:00.784297 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5e26a-6e12-47b0-906d-10e0aa473250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:00.785195 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5e26a-6e12-47b0-906d-10e0aa473250 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:00.785626 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5e26a-6e12-47b0-906d-10e0aa473250 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:00.786058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5e26a-6e12-47b0-906d-10e0aa473250 None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:00.786802 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5e26a-6e12-47b0-906d-10e0aa473250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:00.788332 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5e26a-6e12-47b0-906d-10e0aa473250 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:00.795158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 367/738] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Oct 20 13:24:00 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:24:01.017084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad92c8-c53c-4949-b232-fe30e1051314 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:01.122823 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad92c8-c53c-4949-b232-fe30e1051314 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:01.162686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5f1e3-cc94-4956-ab62-ceb16c9d70fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:01.163714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5f1e3-cc94-4956-ab62-ceb16c9d70fd None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:01.164216 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5f1e3-cc94-4956-ab62-ceb16c9d70fd None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:01.164978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5f1e3-cc94-4956-ab62-ceb16c9d70fd None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:01.165878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5f1e3-cc94-4956-ab62-ceb16c9d70fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:01.167470 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5f1e3-cc94-4956-ab62-ceb16c9d70fd None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:01.172667 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:01.187785 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 372/739] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Oct 20 13:24:01 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:24:01.240233 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822cd20-7a92-4186-a41c-3a5643b89cc7 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:01.240769 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822cd20-7a92-4186-a41c-3a5643b89cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:01.240769 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822cd20-7a92-4186-a41c-3a5643b89cc7 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:01.242516 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 368/740] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:01.248564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1ae26-ac83-474e-ae96-ddb401960e79 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:01.248919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1ae26-ac83-474e-ae96-ddb401960e79 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:01.249204 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1ae26-ac83-474e-ae96-ddb401960e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:01.271037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-b5c1ae26-ac83-474e-ae96-ddb401960e79 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:01.272257 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b5c1ae26-ac83-474e-ae96-ddb401960e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:01.362677 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 373/741] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:01.530476 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18af06-522c-4530-bd44-8d5550600218 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:01.531332 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18af06-522c-4530-bd44-8d5550600218 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:01.531598 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18af06-522c-4530-bd44-8d5550600218 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:01.533213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 369/742] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:01.538595 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb215f0c-36b9-4fe4-86da-ea568707e543 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:01.538887 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb215f0c-36b9-4fe4-86da-ea568707e543 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:01.539201 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb215f0c-36b9-4fe4-86da-ea568707e543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:01.558086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-eb215f0c-36b9-4fe4-86da-ea568707e543 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:01.559330 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-eb215f0c-36b9-4fe4-86da-ea568707e543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:01.634659 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 374/743] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:01.649804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18af06-522c-4530-bd44-8d5550600218 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:01.757479 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18af06-522c-4530-bd44-8d5550600218 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:01.788176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:01.795161 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711b40b-12c8-49e5-a057-0a12a1c52f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:01.796039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711b40b-12c8-49e5-a057-0a12a1c52f12 None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:01.797975 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711b40b-12c8-49e5-a057-0a12a1c52f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:01.798484 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711b40b-12c8-49e5-a057-0a12a1c52f12 None admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:01.799391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711b40b-12c8-49e5-a057-0a12a1c52f12 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:01.801035 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2711b40b-12c8-49e5-a057-0a12a1c52f12 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:01.803891 dv-cinder-862136-1-smb devstack@keystone.service[81426]: WARNING keystone.server.flask.common [None req-2711b40b-12c8-49e5-a057-0a12a1c52f12 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 20 13:24:01.824036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.sql.core [None req-2711b40b-12c8-49e5-a057-0a12a1c52f12 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 20 13:24:01.824036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 13:24:01.824036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [parameters: {'id': '91c72c8cd53b49719511b26f6fa863d3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 20 13:24:01.824036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81426) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 13:24:01.841813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-2711b40b-12c8-49e5-a057-0a12a1c52f12 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 91c72c8cd53b49719511b26f6fa863d3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 91c72c8cd53b49719511b26f6fa863d3. Oct 20 13:24:01.841813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:01.841813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 13:24:01.841813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 13:24:01.841813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 13:24:01.841813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 13:24:01.841813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 13:24:01.841813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 13:24:01.841813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 13:24:01.841813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application conn.query(q) Oct 20 13:24:01.841813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 13:24:01.841813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 13:24:01.841813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application result.read() Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 20 13:24:01.842642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 20 13:24:01.843653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 13:24:01.843653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application next(self.gen) Oct 20 13:24:01.843653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 20 13:24:01.843653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application yield resource Oct 20 13:24:01.843653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 13:24:01.843653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application next(self.gen) Oct 20 13:24:01.843653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 20 13:24:01.843653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 13:24:01.843653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 13:24:01.843653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 13:24:01.843653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 13:24:01.843653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise self.value Oct 20 13:24:01.843653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 20 13:24:01.843653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 13:24:01.843653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 20 13:24:01.843653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application session.commit() Oct 20 13:24:01.843653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 13:24:01.844552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 13:24:01.844552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 13:24:01.844552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 13:24:01.844552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 13:24:01.844552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self.session.flush() Oct 20 13:24:01.844552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 13:24:01.844552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 13:24:01.844552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 13:24:01.844552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 13:24:01.844552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 13:24:01.844552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application compat.raise_( Oct 20 13:24:01.844552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 13:24:01.844552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception Oct 20 13:24:01.844552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 13:24:01.844552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 13:24:01.844552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 13:24:01.844552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 13:24:01.846239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 13:24:01.846239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 13:24:01.846239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 13:24:01.846239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 13:24:01.846239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 20 13:24:01.846239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 20 13:24:01.846239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 13:24:01.846239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 13:24:01.846239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 13:24:01.846239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 13:24:01.846239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 13:24:01.846239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 13:24:01.846239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 13:24:01.846239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 13:24:01.846239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 13:24:01.847058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 13:24:01.847058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 13:24:01.847058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception Oct 20 13:24:01.847058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 13:24:01.847058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 13:24:01.847058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 13:24:01.847058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 13:24:01.847058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 13:24:01.847058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 13:24:01.847058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 13:24:01.847058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application conn.query(q) Oct 20 13:24:01.847058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 13:24:01.847058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 13:24:01.847058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 13:24:01.847058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application result.read() Oct 20 13:24:01.847058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 13:24:01.847058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 13:24:01.847938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 13:24:01.847938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 13:24:01.847938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 13:24:01.847938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 13:24:01.847938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 13:24:01.847938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 13:24:01.847938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 20 13:24:01.847938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 13:24:01.847938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [parameters: {'id': '91c72c8cd53b49719511b26f6fa863d3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 20 13:24:01.847938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 13:24:01.847938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:01.847938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:24:01.847938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:01.847938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:01.847938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 20 13:24:01.848731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 20 13:24:01.848731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 13:24:01.848731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 13:24:01.848731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 20 13:24:01.848731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:01.848731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:24:01.848731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:01.848731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:01.848731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:01.848731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:01.848731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:01.848731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:01.848731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:01.848731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:01.848731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:01.848731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:01.848731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:01.850926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:01.850926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 20 13:24:01.850926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 20 13:24:01.850926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:01.850926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:01.850926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 20 13:24:01.850926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 20 13:24:01.850926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 91c72c8cd53b49719511b26f6fa863d3. Oct 20 13:24:01.850926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:01.853833 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 370/744] 10.222.0.36 () {60 vars in 1140 bytes} [Thu Oct 20 13:24:01 2022] POST /identity/v3/projects => generated 262 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:01.860846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb215f0c-36b9-4fe4-86da-ea568707e543 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:01.919919 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711b40b-12c8-49e5-a057-0a12a1c52f12 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:01.922137 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:01.975695 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb215f0c-36b9-4fe4-86da-ea568707e543 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:02.055656 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2711b40b-12c8-49e5-a057-0a12a1c52f12 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:02.095308 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31937ba-95a3-4190-a054-1fd5a84f950a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:02.096113 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31937ba-95a3-4190-a054-1fd5a84f950a None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:02.096498 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31937ba-95a3-4190-a054-1fd5a84f950a None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:02.096873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31937ba-95a3-4190-a054-1fd5a84f950a None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:02.097658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31937ba-95a3-4190-a054-1fd5a84f950a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:02.099401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31937ba-95a3-4190-a054-1fd5a84f950a None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:02.128010 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 371/745] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Oct 20 13:24:01 2022] POST /identity/v3/services => generated 242 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:24:02.153991 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31245d-7c74-4f5a-9411-54175b16dfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:02.154706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31245d-7c74-4f5a-9411-54175b16dfc5 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:02.154922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31245d-7c74-4f5a-9411-54175b16dfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:02.155228 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31245d-7c74-4f5a-9411-54175b16dfc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:02.164710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31245d-7c74-4f5a-9411-54175b16dfc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:02.166253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31245d-7c74-4f5a-9411-54175b16dfc5 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:02.179796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-9b31245d-7c74-4f5a-9411-54175b16dfc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:24:02.179796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:02.179796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:02.179796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:02.179796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:02.179796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:02.179796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:02.179796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:02.179796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:02.179796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:02.179796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:02.179796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:02.179796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:24:02.179796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:24:02.179796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:24:02.180746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:24:02.180746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:02.180746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:02.180746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:02.180746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:02.180746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:02.180746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:02.180746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:02.180746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:02.180746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:02.180746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:02.180746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:02.180746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:02.180746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:02.180746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:02.180746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:02.180746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:02.181633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:24:02.181633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:24:02.181633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:24:02.181633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:24:02.181633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:24:02.181633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:24:02.181633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:24:02.181633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:02.181633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 375/746] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:02.187500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31937ba-95a3-4190-a054-1fd5a84f950a None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:02.231565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:02.313547 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31937ba-95a3-4190-a054-1fd5a84f950a None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:02.353654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f3465-0389-4381-9679-b50285671dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:02.354635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f3465-0389-4381-9679-b50285671dec None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:02.355181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f3465-0389-4381-9679-b50285671dec None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:02.355661 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f3465-0389-4381-9679-b50285671dec None admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:02.356525 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f3465-0389-4381-9679-b50285671dec None admin] RBAC: Adding query filter params (name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:02.357053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f3465-0389-4381-9679-b50285671dec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:02.358741 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f3465-0389-4381-9679-b50285671dec None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:02.378375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 372/747] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Oct 20 13:24:02 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:03.099796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c98043-c6f3-4555-aeb9-044a78ae1a91 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:03.100134 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c98043-c6f3-4555-aeb9-044a78ae1a91 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:03.100419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c98043-c6f3-4555-aeb9-044a78ae1a91 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:03.102012 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 376/748] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:03.107665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05783-6b0a-4d07-8ec1-1faa2fcc1a3a None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:03.107958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05783-6b0a-4d07-8ec1-1faa2fcc1a3a None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:03.108392 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05783-6b0a-4d07-8ec1-1faa2fcc1a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:03.129964 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-dad05783-6b0a-4d07-8ec1-1faa2fcc1a3a None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:03.131514 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-dad05783-6b0a-4d07-8ec1-1faa2fcc1a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:03.203064 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 373/749] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:03 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:03.397362 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705790f-8885-4ce8-ba6c-86f85ba30c98 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:03.397859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705790f-8885-4ce8-ba6c-86f85ba30c98 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:03.397859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705790f-8885-4ce8-ba6c-86f85ba30c98 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:03.399424 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 377/750] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:03.404584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68ec1f-2320-4c9a-b4e4-c377582ef7d6 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:03.404990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68ec1f-2320-4c9a-b4e4-c377582ef7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:03.405176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68ec1f-2320-4c9a-b4e4-c377582ef7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:03.424912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-6b68ec1f-2320-4c9a-b4e4-c377582ef7d6 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:03.426081 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6b68ec1f-2320-4c9a-b4e4-c377582ef7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:03.446703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:03.487673 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705790f-8885-4ce8-ba6c-86f85ba30c98 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:03.494510 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 374/751] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:03 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:03.596162 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705790f-8885-4ce8-ba6c-86f85ba30c98 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:03.605961 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:03.632756 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8db9b5-f432-4aae-bc61-130c150a76cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:03.633386 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8db9b5-f432-4aae-bc61-130c150a76cc None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:03.633666 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8db9b5-f432-4aae-bc61-130c150a76cc None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:03.633937 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8db9b5-f432-4aae-bc61-130c150a76cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:03.634515 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8db9b5-f432-4aae-bc61-130c150a76cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:03.635906 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8db9b5-f432-4aae-bc61-130c150a76cc None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:03.645231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-bd8db9b5-f432-4aae-bc61-130c150a76cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 13:24:03.645231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:03.645231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:24:03.645231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:24:03.645231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:24:03.645231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:24:03.645231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:24:03.645231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:24:03.645231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 13:24:03.645231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:03.645231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:24:03.645231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:03.645231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:03.645231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:03.645231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:03.645231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:03.645231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:03.646441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:03.646441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:03.646441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:03.646441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:03.646441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:03.646441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:03.646441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:24:03.646441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:24:03.646441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:24:03.646441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:24:03.646441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:03.646441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:03.646441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:03.646441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:03.646441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:03.646441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:03.647548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:03.647548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:03.647548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:03.647548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:03.647548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:03.647548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:03.647548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:03.647548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:03.647548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:03.647548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:03.647548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:24:03.647548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:24:03.647548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 20 13:24:03.647548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:03.647548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 378/752] 10.222.0.36 () {56 vars in 1126 bytes} [Thu Oct 20 13:24:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:03.654625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68ec1f-2320-4c9a-b4e4-c377582ef7d6 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:03.760414 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68ec1f-2320-4c9a-b4e4-c377582ef7d6 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:03.766721 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8db9b5-f432-4aae-bc61-130c150a76cc None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:03.807059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfdb16-a64b-40fc-aacd-b5bdccc48f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:03.808046 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfdb16-a64b-40fc-aacd-b5bdccc48f98 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:03.808626 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfdb16-a64b-40fc-aacd-b5bdccc48f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:03.809132 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfdb16-a64b-40fc-aacd-b5bdccc48f98 None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:03.810141 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfdb16-a64b-40fc-aacd-b5bdccc48f98 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:03.810646 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfdb16-a64b-40fc-aacd-b5bdccc48f98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:03.813078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfdb16-a64b-40fc-aacd-b5bdccc48f98 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:03.818883 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 375/753] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Oct 20 13:24:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:03.825021 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfdb16-a64b-40fc-aacd-b5bdccc48f98 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:03.849773 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:03.915432 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8db9b5-f432-4aae-bc61-130c150a76cc None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:03.946126 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfdb16-a64b-40fc-aacd-b5bdccc48f98 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:03.964324 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff4c50-81a8-459e-b266-732e66c7979b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:03.965626 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff4c50-81a8-459e-b266-732e66c7979b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:03.966128 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff4c50-81a8-459e-b266-732e66c7979b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:03.966621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff4c50-81a8-459e-b266-732e66c7979b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:03.967431 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff4c50-81a8-459e-b266-732e66c7979b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:03.970622 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff4c50-81a8-459e-b266-732e66c7979b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:03.982864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-9fff4c50-81a8-459e-b266-732e66c7979b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 13:24:03.982864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:03.982864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:24:03.982864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:24:03.982864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:24:03.982864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:24:03.982864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:24:03.982864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:24:03.982864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 13:24:03.982864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:03.982864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:24:03.982864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:03.982864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:03.982864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:03.982864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:03.982864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:03.982864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:03.984532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:03.984532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:03.984532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:03.984532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:03.984532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:03.984532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:03.984532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:24:03.984532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:24:03.984532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:24:03.984532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:24:03.984532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:03.984532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:03.984532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:03.984532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:03.984532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:03.984532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:03.985374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:03.985374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:03.985374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:03.985374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:03.985374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:03.985374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:03.985374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:03.985374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:03.985374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:03.985374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:03.985374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:24:03.985374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:24:03.985374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 13:24:03.985374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:03.986114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd7520-4194-4b7f-8586-5adef0f169e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:03.986114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd7520-4194-4b7f-8586-5adef0f169e9 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:03.986114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd7520-4194-4b7f-8586-5adef0f169e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:03.986114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd7520-4194-4b7f-8586-5adef0f169e9 None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:03.986389 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd7520-4194-4b7f-8586-5adef0f169e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:03.986389 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd7520-4194-4b7f-8586-5adef0f169e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:03.987096 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd7520-4194-4b7f-8586-5adef0f169e9 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:03.989446 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 379/754] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:24:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:24:03.998981 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 376/755] 10.222.0.36 () {56 vars in 1122 bytes} [Thu Oct 20 13:24:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:04.000743 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd7520-4194-4b7f-8586-5adef0f169e9 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:04.001038 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff4c50-81a8-459e-b266-732e66c7979b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:04.050381 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:04.096654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:04.115345 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd7520-4194-4b7f-8586-5adef0f169e9 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:04.141578 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff4c50-81a8-459e-b266-732e66c7979b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:04.165657 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4155e-6189-4171-b03d-d89e95d177f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:04.166847 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4155e-6189-4171-b03d-d89e95d177f4 None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:04.167739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4155e-6189-4171-b03d-d89e95d177f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:04.168488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4155e-6189-4171-b03d-d89e95d177f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:04.169637 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4155e-6189-4171-b03d-d89e95d177f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:04.172458 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4155e-6189-4171-b03d-d89e95d177f4 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:04.178644 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551070ae-ed66-4056-89ec-329f6703cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:04.179275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551070ae-ed66-4056-89ec-329f6703cd7d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:04.179592 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551070ae-ed66-4056-89ec-329f6703cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:04.179920 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551070ae-ed66-4056-89ec-329f6703cd7d None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:04.180671 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551070ae-ed66-4056-89ec-329f6703cd7d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:04.180849 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551070ae-ed66-4056-89ec-329f6703cd7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:04.182376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551070ae-ed66-4056-89ec-329f6703cd7d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:04.192990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 380/756] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Oct 20 13:24:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:04.194264 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551070ae-ed66-4056-89ec-329f6703cd7d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:04.197091 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 377/757] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:24:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:24:04.317349 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:04.321108 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551070ae-ed66-4056-89ec-329f6703cd7d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:04.369517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b07d9b-1f7d-426d-a179-3a3f10fd0a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:04.370124 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b07d9b-1f7d-426d-a179-3a3f10fd0a04 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:04.370442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b07d9b-1f7d-426d-a179-3a3f10fd0a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:04.370713 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b07d9b-1f7d-426d-a179-3a3f10fd0a04 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:04.371373 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b07d9b-1f7d-426d-a179-3a3f10fd0a04 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:04.371674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b07d9b-1f7d-426d-a179-3a3f10fd0a04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:04.373226 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b07d9b-1f7d-426d-a179-3a3f10fd0a04 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:04.385049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 381/758] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Oct 20 13:24:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:04.386883 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4155e-6189-4171-b03d-d89e95d177f4 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:04.497977 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91392c-b2b0-4af3-aace-935fad413648 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:04.498477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91392c-b2b0-4af3-aace-935fad413648 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:04.498477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91392c-b2b0-4af3-aace-935fad413648 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:04.500709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 382/759] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:24:04.504102 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4155e-6189-4171-b03d-d89e95d177f4 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:04.506003 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffd4f7-22cc-4697-830e-aed562c53178 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:04.506285 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffd4f7-22cc-4697-830e-aed562c53178 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:04.506555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffd4f7-22cc-4697-830e-aed562c53178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:04.525831 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-cfffd4f7-22cc-4697-830e-aed562c53178 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:04.527111 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-cfffd4f7-22cc-4697-830e-aed562c53178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:04.545557 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3682b96-40fc-4b37-b1e3-6412d675626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:04.546662 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3682b96-40fc-4b37-b1e3-6412d675626b None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:04.547218 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3682b96-40fc-4b37-b1e3-6412d675626b None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:04.547704 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3682b96-40fc-4b37-b1e3-6412d675626b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:04.548788 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3682b96-40fc-4b37-b1e3-6412d675626b None admin] RBAC: Adding query filter params (interface=public, service_id=2967cedf50cb42b5bbcdde7acaba03fb, region_id=RegionOne) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:04.549318 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3682b96-40fc-4b37-b1e3-6412d675626b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:04.551053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3682b96-40fc-4b37-b1e3-6412d675626b None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:04.557658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 378/760] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Oct 20 13:24:04 2022] GET /identity/v3/endpoints?service_id=2967cedf50cb42b5bbcdde7acaba03fb&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:04.564364 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3682b96-40fc-4b37-b1e3-6412d675626b None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:04.579414 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:04.614263 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 383/761] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:04 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 13:24:04.649619 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5196a30-08bc-41c3-989c-ce86beb7f476 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:04.649937 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5196a30-08bc-41c3-989c-ce86beb7f476 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:04.650176 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5196a30-08bc-41c3-989c-ce86beb7f476 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:04.651819 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 384/762] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:24:04.658756 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b664d46-9a9c-4df9-a682-cc6e104df783 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:04.659064 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b664d46-9a9c-4df9-a682-cc6e104df783 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:04.659339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b664d46-9a9c-4df9-a682-cc6e104df783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:04.680760 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3682b96-40fc-4b37-b1e3-6412d675626b None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:04.680969 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0b664d46-9a9c-4df9-a682-cc6e104df783 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:04.681934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0b664d46-9a9c-4df9-a682-cc6e104df783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:04.717269 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ea3ec-0d0e-43c7-b7ff-be978b88528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:04.718389 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ea3ec-0d0e-43c7-b7ff-be978b88528b None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:04.718765 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ea3ec-0d0e-43c7-b7ff-be978b88528b None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:04.719080 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ea3ec-0d0e-43c7-b7ff-be978b88528b None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:04.719698 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ea3ec-0d0e-43c7-b7ff-be978b88528b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:04.721123 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ea3ec-0d0e-43c7-b7ff-be978b88528b None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:04.728639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 379/763] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Oct 20 13:24:04 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:24:04.768946 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 385/764] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:04 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 13:24:04.903899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ea3ec-0d0e-43c7-b7ff-be978b88528b None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:04.981149 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:05.016227 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ea3ec-0d0e-43c7-b7ff-be978b88528b None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:05.054595 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c5f42-4145-4cd5-9782-50779436325f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:05.055264 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c5f42-4145-4cd5-9782-50779436325f None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:05.055552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c5f42-4145-4cd5-9782-50779436325f None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:05.055830 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c5f42-4145-4cd5-9782-50779436325f None admin] PATH_INFO: `/v3/services/image` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:05.056476 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c5f42-4145-4cd5-9782-50779436325f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:05.056582 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b664d46-9a9c-4df9-a682-cc6e104df783 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:05.057851 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c5f42-4145-4cd5-9782-50779436325f None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:05.069824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-662c5f42-4145-4cd5-9782-50779436325f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 13:24:05.069824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:05.069824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:24:05.069824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:24:05.069824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:24:05.069824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:24:05.069824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:24:05.069824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:24:05.069824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 13:24:05.069824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:05.069824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:24:05.069824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:05.069824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:05.069824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:05.069824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:05.069824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:05.069824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:05.070815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:05.070815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:05.070815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:05.070815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:05.070815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:05.070815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:05.070815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:24:05.070815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:24:05.070815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:24:05.070815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:24:05.070815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:05.070815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:05.070815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:05.070815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:05.070815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:05.070815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:05.071677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:05.071677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:05.071677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:05.071677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:05.071677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:05.071677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:05.071677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:05.071677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:05.071677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:05.071677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:05.071677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:24:05.071677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:24:05.071677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 13:24:05.071677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:05.073010 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 380/765] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Oct 20 13:24:04 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:05.078209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c5f42-4145-4cd5-9782-50779436325f None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:05.080727 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:05.165616 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b664d46-9a9c-4df9-a682-cc6e104df783 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:05.209587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35009455-4727-4f2a-8a35-3ef2ed3757c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:05.210463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35009455-4727-4f2a-8a35-3ef2ed3757c1 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:05.210746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35009455-4727-4f2a-8a35-3ef2ed3757c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:05.211047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35009455-4727-4f2a-8a35-3ef2ed3757c1 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:05.212261 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35009455-4727-4f2a-8a35-3ef2ed3757c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:05.214080 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35009455-4727-4f2a-8a35-3ef2ed3757c1 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:05.217321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c5f42-4145-4cd5-9782-50779436325f None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:05.217463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: WARNING keystone.server.flask.common [None req-35009455-4727-4f2a-8a35-3ef2ed3757c1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 20 13:24:05.235469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.sql.core [None req-35009455-4727-4f2a-8a35-3ef2ed3757c1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 20 13:24:05.235469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 20 13:24:05.235469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [parameters: {'user_id': '75ffa4f62afe479a8cd66605181b5c07', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 20 13:24:05.235469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81427) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 13:24:05.246870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-35009455-4727-4f2a-8a35-3ef2ed3757c1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 20 13:24:05.246870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:05.246870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 13:24:05.246870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 13:24:05.246870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 13:24:05.246870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 13:24:05.246870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 13:24:05.246870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 13:24:05.246870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 13:24:05.246870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application conn.query(q) Oct 20 13:24:05.246870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 13:24:05.246870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 13:24:05.246870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 13:24:05.246870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application result.read() Oct 20 13:24:05.246870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 13:24:05.248059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application next(self.gen) Oct 20 13:24:05.250289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 20 13:24:05.250289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application yield resource Oct 20 13:24:05.250289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 13:24:05.250289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application next(self.gen) Oct 20 13:24:05.250289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 20 13:24:05.250289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 13:24:05.250289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 13:24:05.250289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 13:24:05.250289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 13:24:05.250289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise self.value Oct 20 13:24:05.250289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 20 13:24:05.250289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 13:24:05.250289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 20 13:24:05.250289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application session.commit() Oct 20 13:24:05.250289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 13:24:05.250289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 13:24:05.250289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 13:24:05.251395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 13:24:05.251395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 13:24:05.251395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.session.flush() Oct 20 13:24:05.251395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 13:24:05.251395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 13:24:05.251395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 13:24:05.251395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 13:24:05.251395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 13:24:05.251395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application compat.raise_( Oct 20 13:24:05.251395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 13:24:05.251395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception Oct 20 13:24:05.251395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 13:24:05.251395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 13:24:05.251395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 13:24:05.251395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 13:24:05.251395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 13:24:05.251395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 13:24:05.252526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 13:24:05.252526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 13:24:05.252526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 20 13:24:05.252526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 20 13:24:05.252526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 13:24:05.252526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 13:24:05.252526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 13:24:05.252526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 13:24:05.252526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 13:24:05.252526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 13:24:05.252526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 13:24:05.252526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 13:24:05.252526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 13:24:05.252526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 13:24:05.252526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 13:24:05.252526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception Oct 20 13:24:05.253499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 13:24:05.253499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 13:24:05.253499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 13:24:05.253499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 13:24:05.253499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 13:24:05.253499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 13:24:05.253499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 13:24:05.253499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application conn.query(q) Oct 20 13:24:05.253499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 13:24:05.253499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 13:24:05.253499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 13:24:05.253499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application result.read() Oct 20 13:24:05.253499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 13:24:05.253499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 13:24:05.253499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 13:24:05.253499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 13:24:05.254494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 13:24:05.254494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 13:24:05.254494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 13:24:05.254494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 13:24:05.254494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 20 13:24:05.254494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 20 13:24:05.254494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [parameters: {'user_id': '75ffa4f62afe479a8cd66605181b5c07', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 20 13:24:05.254494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 13:24:05.254494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:05.254494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:24:05.254494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:05.254494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:05.254494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:05.254494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:05.254494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:05.268046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:05.268046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:05.268046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:05.268046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:05.268046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:05.268046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:05.268046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:05.268046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 20 13:24:05.268046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 20 13:24:05.268046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:05.268046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:05.268046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:24:05.268046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:24:05.268046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:24:05.268046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:24:05.268046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 20 13:24:05.268046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 20 13:24:05.269572 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 20 13:24:05.269572 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 20 13:24:05.269572 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 13:24:05.269572 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 13:24:05.269572 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 20 13:24:05.269572 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:05.269572 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 386/766] 10.222.0.36 () {60 vars in 1131 bytes} [Thu Oct 20 13:24:05 2022] POST /identity/v3/users => generated 160 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:05.269572 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35009455-4727-4f2a-8a35-3ef2ed3757c1 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:05.270134 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d2872-b0d9-42de-bfcc-b6a90a1059db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:05.270134 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d2872-b0d9-42de-bfcc-b6a90a1059db None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:05.270134 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d2872-b0d9-42de-bfcc-b6a90a1059db None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:05.270134 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d2872-b0d9-42de-bfcc-b6a90a1059db None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:05.270569 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d2872-b0d9-42de-bfcc-b6a90a1059db None admin] RBAC: Adding query filter params (name=image) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:05.270569 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d2872-b0d9-42de-bfcc-b6a90a1059db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:05.270569 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d2872-b0d9-42de-bfcc-b6a90a1059db None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:05.270569 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:05.274256 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 381/767] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:24:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:05.280160 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d2872-b0d9-42de-bfcc-b6a90a1059db None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:05.360680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:05.383883 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35009455-4727-4f2a-8a35-3ef2ed3757c1 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:05.419839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0d9a2-f143-4cdd-9fd8-0cc232a018f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:05.420779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0d9a2-f143-4cdd-9fd8-0cc232a018f4 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:05.421755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0d9a2-f143-4cdd-9fd8-0cc232a018f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:05.422130 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0d9a2-f143-4cdd-9fd8-0cc232a018f4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:05.423245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d2872-b0d9-42de-bfcc-b6a90a1059db None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:05.430040 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0d9a2-f143-4cdd-9fd8-0cc232a018f4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:05.431883 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0d9a2-f143-4cdd-9fd8-0cc232a018f4 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:05.445490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-60f0d9a2-f143-4cdd-9fd8-0cc232a018f4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 13:24:05.445490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:05.445490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:05.445490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:05.445490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:05.445490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:05.445490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:05.445490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:05.445490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:05.445490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:05.445490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:05.445490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:05.445490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:24:05.445490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:24:05.445490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:24:05.445490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:05.447210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:05.448826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:05.448826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:05.448826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:24:05.448826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:24:05.448826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:24:05.448826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:24:05.448826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:24:05.448826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:24:05.448826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 20 13:24:05.448826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:05.448826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 387/768] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:24:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:24:05.455700 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0d9a2-f143-4cdd-9fd8-0cc232a018f4 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:05.468722 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c1b63-0cd7-4ad8-8958-55612da93b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:05.469735 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c1b63-0cd7-4ad8-8958-55612da93b0a None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:05.469735 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c1b63-0cd7-4ad8-8958-55612da93b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:05.470128 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c1b63-0cd7-4ad8-8958-55612da93b0a None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:05.470863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c1b63-0cd7-4ad8-8958-55612da93b0a None admin] RBAC: Adding query filter params (type=image) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:05.471220 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c1b63-0cd7-4ad8-8958-55612da93b0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:05.472746 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c1b63-0cd7-4ad8-8958-55612da93b0a None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:05.478477 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 382/769] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:24:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:05.484509 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c1b63-0cd7-4ad8-8958-55612da93b0a None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:05.562588 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:05.589049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0d9a2-f143-4cdd-9fd8-0cc232a018f4 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:05.606673 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c1b63-0cd7-4ad8-8958-55612da93b0a None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:05.632273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb5b7c3-7ad3-4ced-ab66-b110511c89e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:05.633160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5b7c3-7ad3-4ced-ab66-b110511c89e2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:05.633446 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5b7c3-7ad3-4ced-ab66-b110511c89e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:05.633994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb5b7c3-7ad3-4ced-ab66-b110511c89e2 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:05.634698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5b7c3-7ad3-4ced-ab66-b110511c89e2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:05.635196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5b7c3-7ad3-4ced-ab66-b110511c89e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:05.637238 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb5b7c3-7ad3-4ced-ab66-b110511c89e2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:05.644471 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a27ec7-78ae-4b9c-b04e-28244add1ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:05.645093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a27ec7-78ae-4b9c-b04e-28244add1ddf None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:05.645374 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a27ec7-78ae-4b9c-b04e-28244add1ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:05.645650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a27ec7-78ae-4b9c-b04e-28244add1ddf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:05.646349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a27ec7-78ae-4b9c-b04e-28244add1ddf None admin] RBAC: Adding query filter params (interface=public, service_id=bdb1190986db4e77b4946fed4e30a7a8, region_id=RegionOne) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:05.646659 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a27ec7-78ae-4b9c-b04e-28244add1ddf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:05.648120 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a27ec7-78ae-4b9c-b04e-28244add1ddf None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:05.659267 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 383/770] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Oct 20 13:24:05 2022] GET /identity/v3/endpoints?service_id=bdb1190986db4e77b4946fed4e30a7a8&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:05.660278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a27ec7-78ae-4b9c-b04e-28244add1ddf None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:05.676895 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:05.685730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 388/771] 10.222.0.36 () {56 vars in 1101 bytes} [Thu Oct 20 13:24:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:24:05.786228 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a27ec7-78ae-4b9c-b04e-28244add1ddf None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:05.817820 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:05.830901 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32761b31-202d-4bed-af32-b8190d4e89c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:05.831568 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32761b31-202d-4bed-af32-b8190d4e89c7 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:05.831860 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32761b31-202d-4bed-af32-b8190d4e89c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:05.832144 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32761b31-202d-4bed-af32-b8190d4e89c7 None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:05.832774 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32761b31-202d-4bed-af32-b8190d4e89c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:05.834191 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32761b31-202d-4bed-af32-b8190d4e89c7 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:05.841932 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 384/772] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Oct 20 13:24:05 2022] GET /identity/v3/services => generated 1957 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:24:06.538630 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c1d4d-8dee-468e-9fbd-9ffa0c2b99f8 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:06.539060 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c1d4d-8dee-468e-9fbd-9ffa0c2b99f8 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:06.539494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c1d4d-8dee-468e-9fbd-9ffa0c2b99f8 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:06.540987 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 389/773] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:06.546609 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb6b26-a492-4cfa-a31d-94d1b7b7e6ed None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:06.546902 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb6b26-a492-4cfa-a31d-94d1b7b7e6ed None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:06.547263 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb6b26-a492-4cfa-a31d-94d1b7b7e6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:06.565754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-30fb6b26-a492-4cfa-a31d-94d1b7b7e6ed None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:06.566935 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-30fb6b26-a492-4cfa-a31d-94d1b7b7e6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:06.638996 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 385/774] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:06 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:06.912298 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c1d4d-8dee-468e-9fbd-9ffa0c2b99f8 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:06.951002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a06a0e-f056-40e7-bb51-7b13e5b337ca None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:06.951310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a06a0e-f056-40e7-bb51-7b13e5b337ca None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:06.951550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a06a0e-f056-40e7-bb51-7b13e5b337ca None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:06.953829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 386/775] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:06.958647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d199a6-3c4c-4330-8458-6f2d8796f93b None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:06.958933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d199a6-3c4c-4330-8458-6f2d8796f93b None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:06.959243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d199a6-3c4c-4330-8458-6f2d8796f93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:06.977390 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-a2d199a6-3c4c-4330-8458-6f2d8796f93b None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:06.978570 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a2d199a6-3c4c-4330-8458-6f2d8796f93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:07.023296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c1d4d-8dee-468e-9fbd-9ffa0c2b99f8 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:07.055503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 387/776] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:06 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 13:24:07.066421 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd1d75-f913-43e2-a2d3-40957736ef19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:07.067092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd1d75-f913-43e2-a2d3-40957736ef19 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:07.067376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd1d75-f913-43e2-a2d3-40957736ef19 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:07.067650 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd1d75-f913-43e2-a2d3-40957736ef19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:07.068760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd1d75-f913-43e2-a2d3-40957736ef19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:07.070180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd1d75-f913-43e2-a2d3-40957736ef19 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:07.071948 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 390/777] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:24:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:07.078127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d199a6-3c4c-4330-8458-6f2d8796f93b None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:07.131727 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:07.181936 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d199a6-3c4c-4330-8458-6f2d8796f93b None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:07.216571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974967e-763a-43b6-8504-484ee7504111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:07.217177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974967e-763a-43b6-8504-484ee7504111 None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:07.217461 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974967e-763a-43b6-8504-484ee7504111 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:07.217809 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974967e-763a-43b6-8504-484ee7504111 None admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:07.218593 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974967e-763a-43b6-8504-484ee7504111 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:07.220051 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974967e-763a-43b6-8504-484ee7504111 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:07.248123 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 388/778] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Oct 20 13:24:07 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:24:07.329654 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd1d75-f913-43e2-a2d3-40957736ef19 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:07.400171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:07.437588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd1d75-f913-43e2-a2d3-40957736ef19 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:07.472621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6b630-4c76-47e9-aa28-1dcaab7cf19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:07.474986 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6b630-4c76-47e9-aa28-1dcaab7cf19c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:07.474986 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6b630-4c76-47e9-aa28-1dcaab7cf19c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:07.474986 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6b630-4c76-47e9-aa28-1dcaab7cf19c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:07.474986 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6b630-4c76-47e9-aa28-1dcaab7cf19c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:07.475793 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6b630-4c76-47e9-aa28-1dcaab7cf19c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:07.485523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-91f6b630-4c76-47e9-aa28-1dcaab7cf19c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 13:24:07.485523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:07.485523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:24:07.485523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:24:07.485523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:24:07.485523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:24:07.485523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:24:07.485523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:24:07.485523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 13:24:07.485523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:07.485523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:24:07.485523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:07.485523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:07.485523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:07.485523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:07.485523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:07.485523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:07.486763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:07.486763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:07.486763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:07.486763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:07.486763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:07.486763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:07.486763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:24:07.486763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:24:07.486763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:24:07.486763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:24:07.486763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:07.486763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:07.486763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:07.486763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:07.486763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:07.486763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:07.487828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:07.487828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:07.487828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:07.487828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:07.487828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:07.487828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:07.487828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:07.487828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:07.487828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:07.487828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:07.487828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:24:07.487828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:24:07.487828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 20 13:24:07.487828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:07.489943 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 391/779] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:24:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:07.496189 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974967e-763a-43b6-8504-484ee7504111 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:07.599783 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974967e-763a-43b6-8504-484ee7504111 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:07.602184 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:07.637251 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f409e49-072b-4482-94aa-52c254ed5c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:07.637868 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409e49-072b-4482-94aa-52c254ed5c7b None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:07.638153 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409e49-072b-4482-94aa-52c254ed5c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:07.638431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409e49-072b-4482-94aa-52c254ed5c7b None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:07.639091 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f409e49-072b-4482-94aa-52c254ed5c7b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:07.639403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f409e49-072b-4482-94aa-52c254ed5c7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:07.641441 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f409e49-072b-4482-94aa-52c254ed5c7b None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:07.651270 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 389/780] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Oct 20 13:24:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:24:07.652793 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6b630-4c76-47e9-aa28-1dcaab7cf19c None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:07.755057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6b630-4c76-47e9-aa28-1dcaab7cf19c None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:07.787464 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:07.793446 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af205b8-8555-4d5f-9be1-355fe16493cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:07.794056 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af205b8-8555-4d5f-9be1-355fe16493cb None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:07.794335 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af205b8-8555-4d5f-9be1-355fe16493cb None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:07.794607 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af205b8-8555-4d5f-9be1-355fe16493cb None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:07.795274 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af205b8-8555-4d5f-9be1-355fe16493cb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:07.795583 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af205b8-8555-4d5f-9be1-355fe16493cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:07.797709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af205b8-8555-4d5f-9be1-355fe16493cb None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:07.803046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 392/781] 10.222.0.36 () {56 vars in 1112 bytes} [Thu Oct 20 13:24:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:07.808560 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f409e49-072b-4482-94aa-52c254ed5c7b None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:07.916415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f409e49-072b-4482-94aa-52c254ed5c7b None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:07.956823 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7638c-4fbe-45cf-9549-997510b9c38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:07.957434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7638c-4fbe-45cf-9549-997510b9c38f None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:07.957713 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7638c-4fbe-45cf-9549-997510b9c38f None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:07.957981 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7638c-4fbe-45cf-9549-997510b9c38f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:07.958662 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7638c-4fbe-45cf-9549-997510b9c38f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:07.960058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7638c-4fbe-45cf-9549-997510b9c38f None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:07.983252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 390/782] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:24:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:24:08.045106 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9d2d2-1dfa-41b2-ba37-f3f454ff367d None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:08.045630 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9d2d2-1dfa-41b2-ba37-f3f454ff367d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:08.045630 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb9d2d2-1dfa-41b2-ba37-f3f454ff367d None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:08.047893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 393/783] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:08.053445 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4479db-14bc-4057-abe2-2c30ebdc02e6 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:08.053742 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4479db-14bc-4057-abe2-2c30ebdc02e6 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:08.054022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4479db-14bc-4057-abe2-2c30ebdc02e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:08.074990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-2a4479db-14bc-4057-abe2-2c30ebdc02e6 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:08.076238 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-2a4479db-14bc-4057-abe2-2c30ebdc02e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:08.097441 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:08.165738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 391/784] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:08.437625 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9d2d2-1dfa-41b2-ba37-f3f454ff367d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:08.541925 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb9d2d2-1dfa-41b2-ba37-f3f454ff367d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:08.578237 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b730ca-0aeb-4662-8976-dc64d9f85a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:08.578863 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b730ca-0aeb-4662-8976-dc64d9f85a4d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:08.579181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b730ca-0aeb-4662-8976-dc64d9f85a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:08.579442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b730ca-0aeb-4662-8976-dc64d9f85a4d None admin] PATH_INFO: `/v3/services/image` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:08.580022 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b730ca-0aeb-4662-8976-dc64d9f85a4d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:08.581379 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b730ca-0aeb-4662-8976-dc64d9f85a4d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:08.590241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-74b730ca-0aeb-4662-8976-dc64d9f85a4d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 13:24:08.590241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:08.590241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:24:08.590241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:24:08.590241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:24:08.590241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:24:08.590241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:24:08.590241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:24:08.590241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 13:24:08.590241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:08.590241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:24:08.590241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:08.590241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:08.590241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:08.590241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:08.590241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:08.590241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:08.591275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:08.591275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:08.591275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:08.591275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:08.591275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:08.591275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:08.591275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:24:08.591275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:24:08.591275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:24:08.591275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:24:08.591275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:08.591275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:08.591275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:08.591275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:08.591275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:08.591275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:08.592148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:08.592148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:08.592148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:08.592148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:08.592148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:08.592148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:08.592148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:08.592148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:08.592148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:08.592148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:08.592148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:24:08.592148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:24:08.592148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 20 13:24:08.592148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:08.592148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 394/785] 10.222.0.36 () {56 vars in 1105 bytes} [Thu Oct 20 13:24:08 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:08.598210 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4479db-14bc-4057-abe2-2c30ebdc02e6 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:08.697892 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4479db-14bc-4057-abe2-2c30ebdc02e6 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:08.731872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477821a7-ecc3-4bc9-951f-e9213a8068ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:08.732474 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477821a7-ecc3-4bc9-951f-e9213a8068ec None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:08.732753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477821a7-ecc3-4bc9-951f-e9213a8068ec None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:08.733022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477821a7-ecc3-4bc9-951f-e9213a8068ec None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:08.734184 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477821a7-ecc3-4bc9-951f-e9213a8068ec None admin] RBAC: Adding query filter params (name=image) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:08.734486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477821a7-ecc3-4bc9-951f-e9213a8068ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:08.735862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477821a7-ecc3-4bc9-951f-e9213a8068ec None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:08.745449 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 392/786] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:24:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:08.746701 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b730ca-0aeb-4662-8976-dc64d9f85a4d None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:08.809456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:08.851563 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b730ca-0aeb-4662-8976-dc64d9f85a4d None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:08.894846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08281c-785e-4454-813a-52ed077c0caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:08.895486 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08281c-785e-4454-813a-52ed077c0caf None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:08.895765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08281c-785e-4454-813a-52ed077c0caf None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:08.896039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08281c-785e-4454-813a-52ed077c0caf None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:08.896668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08281c-785e-4454-813a-52ed077c0caf None admin] RBAC: Adding query filter params (type=image) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:08.896971 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08281c-785e-4454-813a-52ed077c0caf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:08.898325 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08281c-785e-4454-813a-52ed077c0caf None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:08.903303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 395/787] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:24:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:08.909441 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477821a7-ecc3-4bc9-951f-e9213a8068ec None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:08.926343 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:09.015989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477821a7-ecc3-4bc9-951f-e9213a8068ec None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:09.050020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c343f-b6de-4e0f-9b8c-1fa701b30930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:09.050626 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c343f-b6de-4e0f-9b8c-1fa701b30930 None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:09.050902 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c343f-b6de-4e0f-9b8c-1fa701b30930 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:09.051200 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c343f-b6de-4e0f-9b8c-1fa701b30930 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:09.051866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c343f-b6de-4e0f-9b8c-1fa701b30930 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:09.053205 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c343f-b6de-4e0f-9b8c-1fa701b30930 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:09.082979 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 393/788] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:24:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:24:09.469983 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c757d47-7340-4ef1-ad6b-ad63aabe37cc None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:09.470504 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c757d47-7340-4ef1-ad6b-ad63aabe37cc None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:09.470504 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c757d47-7340-4ef1-ad6b-ad63aabe37cc None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:09.472033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 396/789] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:09.477026 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9826c3-1323-4c55-b749-16a4eb4fc6ad None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:09.477314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9826c3-1323-4c55-b749-16a4eb4fc6ad None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:09.477587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9826c3-1323-4c55-b749-16a4eb4fc6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:09.496258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-af9826c3-1323-4c55-b749-16a4eb4fc6ad None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:09.497445 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-af9826c3-1323-4c55-b749-16a4eb4fc6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:09.564427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:09.578998 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 394/790] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:09.847822 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c757d47-7340-4ef1-ad6b-ad63aabe37cc None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:09.959444 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c757d47-7340-4ef1-ad6b-ad63aabe37cc None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:09.985663 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:09.997441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f50044-b8c0-423d-9d19-f264c7319d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:09.998064 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f50044-b8c0-423d-9d19-f264c7319d9d None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:09.998337 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f50044-b8c0-423d-9d19-f264c7319d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:09.998604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f50044-b8c0-423d-9d19-f264c7319d9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:10.000245 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f50044-b8c0-423d-9d19-f264c7319d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:10.001656 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f50044-b8c0-423d-9d19-f264c7319d9d None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:10.003444 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 397/791] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:24:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:10.008852 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9826c3-1323-4c55-b749-16a4eb4fc6ad None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:10.107434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9826c3-1323-4c55-b749-16a4eb4fc6ad None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:10.142825 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc499b1-71c4-474e-88cf-c90ea8d86c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:10.143485 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc499b1-71c4-474e-88cf-c90ea8d86c96 None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:10.143763 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc499b1-71c4-474e-88cf-c90ea8d86c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:10.144033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc499b1-71c4-474e-88cf-c90ea8d86c96 None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:10.144712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc499b1-71c4-474e-88cf-c90ea8d86c96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:10.146177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc499b1-71c4-474e-88cf-c90ea8d86c96 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:10.171191 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 395/792] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:24:10 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:24:10.253779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c8d7c-207c-455e-97c2-8f8c5a95f940 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:10.254101 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c8d7c-207c-455e-97c2-8f8c5a95f940 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:10.254340 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c8d7c-207c-455e-97c2-8f8c5a95f940 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:10.255936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 398/793] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:10.261378 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6d9d8-f8a5-4d60-a7bc-a896cb812401 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:10.261681 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6d9d8-f8a5-4d60-a7bc-a896cb812401 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:10.261949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6d9d8-f8a5-4d60-a7bc-a896cb812401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:10.281440 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-b8a6d9d8-f8a5-4d60-a7bc-a896cb812401 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:10.282660 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b8a6d9d8-f8a5-4d60-a7bc-a896cb812401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:10.336679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:10.362369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 396/794] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:10.632576 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c8d7c-207c-455e-97c2-8f8c5a95f940 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:10.736779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c8d7c-207c-455e-97c2-8f8c5a95f940 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:10.770877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490eca6-3ba0-43bf-bb84-cb81c4e829c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:10.771534 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490eca6-3ba0-43bf-bb84-cb81c4e829c7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:10.771816 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490eca6-3ba0-43bf-bb84-cb81c4e829c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:10.772091 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490eca6-3ba0-43bf-bb84-cb81c4e829c7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:10.783227 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490eca6-3ba0-43bf-bb84-cb81c4e829c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:24:10.788015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-1490eca6-3ba0-43bf-bb84-cb81c4e829c7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 13:24:10.788015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:10.788015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:10.788015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:10.788015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:10.788015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:10.788015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:10.788015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:10.788015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:10.788015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:10.788015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:10.788015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:10.788015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:24:10.788015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:24:10.788015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:24:10.788015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:24:10.788919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:24:10.788919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:24:10.788919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:24:10.788919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:24:10.788919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:10.788919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:10.788919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:10.788919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:10.788919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:10.788919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:10.788919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:10.788919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:10.788919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:10.788919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:10.788919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:10.788919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:10.790021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:10.790021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:10.790021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:10.790021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:10.790021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:24:10.790021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:24:10.790021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:24:10.790021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:24:10.790021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:24:10.790021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:24:10.790021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 13:24:10.790021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:10.794339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 399/795] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Oct 20 13:24:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:10.795373 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6d9d8-f8a5-4d60-a7bc-a896cb812401 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:10.901904 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6d9d8-f8a5-4d60-a7bc-a896cb812401 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:10.937278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0c73c-0a97-4ca9-b4b8-9838eeef60dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:10.937897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0c73c-0a97-4ca9-b4b8-9838eeef60dc None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:10.938177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0c73c-0a97-4ca9-b4b8-9838eeef60dc None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:10.938446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0c73c-0a97-4ca9-b4b8-9838eeef60dc None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:10.939140 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0c73c-0a97-4ca9-b4b8-9838eeef60dc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:10.939448 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0c73c-0a97-4ca9-b4b8-9838eeef60dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:10.940817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a0c73c-0a97-4ca9-b4b8-9838eeef60dc None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:10.949456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 397/796] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Oct 20 13:24:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:10.955117 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490eca6-3ba0-43bf-bb84-cb81c4e829c7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:11.008892 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:11.057160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490eca6-3ba0-43bf-bb84-cb81c4e829c7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:11.092002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0523e2a5-e1b7-4f18-8b60-6a8bfc6dc6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:11.092002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523e2a5-e1b7-4f18-8b60-6a8bfc6dc6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:11.093547 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523e2a5-e1b7-4f18-8b60-6a8bfc6dc6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:11.093849 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0523e2a5-e1b7-4f18-8b60-6a8bfc6dc6a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:11.104285 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523e2a5-e1b7-4f18-8b60-6a8bfc6dc6a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:11.105722 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0523e2a5-e1b7-4f18-8b60-6a8bfc6dc6a3 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:11.120471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-0523e2a5-e1b7-4f18-8b60-6a8bfc6dc6a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:24:11.120471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:11.120471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:11.120471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:11.120471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:11.120471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:11.120471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:11.120471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:11.120471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:11.120471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:11.120471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:11.120471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:11.120471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:24:11.120471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:24:11.120471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:24:11.120471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:24:11.121465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:11.121465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:11.121465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:11.121465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:11.121465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:11.121465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:11.121465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:11.121465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:11.121465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:11.121465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:11.121465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:11.121465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:11.121465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:11.121465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:11.121465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:11.121465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:11.121465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:24:11.122439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:24:11.122439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:24:11.122439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:11.123357 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 400/797] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:11.127776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0c73c-0a97-4ca9-b4b8-9838eeef60dc None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:11.179522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:11.237475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0c73c-0a97-4ca9-b4b8-9838eeef60dc None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:11.270526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af134d6-aabb-4d1a-b7e9-8f7c2d6c100a None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:11.270832 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af134d6-aabb-4d1a-b7e9-8f7c2d6c100a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:11.271157 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af134d6-aabb-4d1a-b7e9-8f7c2d6c100a None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:11.272071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e85a4-b1e3-4d27-93b6-a34659f095f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:11.272673 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e85a4-b1e3-4d27-93b6-a34659f095f9 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:11.272778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 401/798] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:11.273000 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e85a4-b1e3-4d27-93b6-a34659f095f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:11.273273 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e85a4-b1e3-4d27-93b6-a34659f095f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:11.273958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e85a4-b1e3-4d27-93b6-a34659f095f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:11.274262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e85a4-b1e3-4d27-93b6-a34659f095f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:11.275635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e85a4-b1e3-4d27-93b6-a34659f095f9 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:11.277541 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bbb83-a4e7-40c2-b33a-1800ef136050 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:11.277830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bbb83-a4e7-40c2-b33a-1800ef136050 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:11.278110 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bbb83-a4e7-40c2-b33a-1800ef136050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:11.292969 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 398/799] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:24:11.294786 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e85a4-b1e3-4d27-93b6-a34659f095f9 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:11.300325 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-602bbb83-a4e7-40c2-b33a-1800ef136050 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:11.301860 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-602bbb83-a4e7-40c2-b33a-1800ef136050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:11.380672 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 402/800] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 13:24:11.398529 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e85a4-b1e3-4d27-93b6-a34659f095f9 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:11.401668 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:11.435565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802ee46-6988-4065-af61-bfe0d46361cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:11.436128 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802ee46-6988-4065-af61-bfe0d46361cf None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:11.436449 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802ee46-6988-4065-af61-bfe0d46361cf None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:11.436724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802ee46-6988-4065-af61-bfe0d46361cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:11.443928 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802ee46-6988-4065-af61-bfe0d46361cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:11.445355 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802ee46-6988-4065-af61-bfe0d46361cf None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:11.457014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-2802ee46-6988-4065-af61-bfe0d46361cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 13:24:11.457014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:11.457014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:11.457014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:11.457014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:11.457014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:11.457014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:11.457014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:11.457014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:11.457014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:11.457014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:11.457014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:11.457014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:24:11.457014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:24:11.457014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:24:11.457014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:11.457978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:11.458905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:11.458905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:11.458905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:24:11.458905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:24:11.458905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:24:11.458905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:24:11.458905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:24:11.458905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:24:11.458905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 13:24:11.458905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:11.458905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 399/801] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Oct 20 13:24:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:24:11.463949 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bbb83-a4e7-40c2-b33a-1800ef136050 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:11.499496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:11.566778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bbb83-a4e7-40c2-b33a-1800ef136050 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:11.600658 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc06b19-24b8-4898-8e31-125ac90d9db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:11.601251 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc06b19-24b8-4898-8e31-125ac90d9db6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:11.601524 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc06b19-24b8-4898-8e31-125ac90d9db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:11.601789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc06b19-24b8-4898-8e31-125ac90d9db6 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:11.602495 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc06b19-24b8-4898-8e31-125ac90d9db6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:11.602796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc06b19-24b8-4898-8e31-125ac90d9db6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:11.604276 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc06b19-24b8-4898-8e31-125ac90d9db6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:11.620815 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 403/802] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Oct 20 13:24:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:11.626604 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802ee46-6988-4065-af61-bfe0d46361cf None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:11.652956 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc06b19-24b8-4898-8e31-125ac90d9db6 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:11.739966 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802ee46-6988-4065-af61-bfe0d46361cf None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:11.747899 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:11.757887 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc06b19-24b8-4898-8e31-125ac90d9db6 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:11.777091 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d434cc0-0a44-4675-b4c8-c23c04c7a38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:11.778064 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d434cc0-0a44-4675-b4c8-c23c04c7a38d None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:11.778338 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d434cc0-0a44-4675-b4c8-c23c04c7a38d None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:11.778605 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d434cc0-0a44-4675-b4c8-c23c04c7a38d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:11.790144 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d434cc0-0a44-4675-b4c8-c23c04c7a38d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:11.791703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d434cc0-0a44-4675-b4c8-c23c04c7a38d None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:11.791944 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35be3e-ef99-43ef-8bec-1378c7f2ce7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:11.792548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35be3e-ef99-43ef-8bec-1378c7f2ce7e None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:11.792830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35be3e-ef99-43ef-8bec-1378c7f2ce7e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:11.793105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35be3e-ef99-43ef-8bec-1378c7f2ce7e None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:11.793776 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35be3e-ef99-43ef-8bec-1378c7f2ce7e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:11.795227 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d35be3e-ef99-43ef-8bec-1378c7f2ce7e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:11.807002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.sql.core [None req-5d35be3e-ef99-43ef-8bec-1378c7f2ce7e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 13:24:11.807002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 13:24:11.807002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [parameters: {'id': '27bc04721395435b95b974715b742df9', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 20 13:24:11.807002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81427) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 20 13:24:11.812376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-5d35be3e-ef99-43ef-8bec-1378c7f2ce7e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 20 13:24:11.812376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:11.812376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 13:24:11.812376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 13:24:11.812376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 13:24:11.812376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 13:24:11.812376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 13:24:11.812376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 13:24:11.812376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 13:24:11.812376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application conn.query(q) Oct 20 13:24:11.812376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 13:24:11.812376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 13:24:11.812376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 13:24:11.812376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application result.read() Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 20 13:24:11.813392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 13:24:11.814674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application next(self.gen) Oct 20 13:24:11.814674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 20 13:24:11.814674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application yield resource Oct 20 13:24:11.814674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 20 13:24:11.814674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application next(self.gen) Oct 20 13:24:11.814674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 20 13:24:11.814674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.session.rollback() Oct 20 13:24:11.814674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 20 13:24:11.814674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.force_reraise() Oct 20 13:24:11.814674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 20 13:24:11.814674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise self.value Oct 20 13:24:11.814674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 20 13:24:11.814674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 20 13:24:11.814674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 20 13:24:11.814674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application session.commit() Oct 20 13:24:11.814674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 20 13:24:11.814674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 20 13:24:11.815772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 20 13:24:11.815772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._prepare_impl() Oct 20 13:24:11.815772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 20 13:24:11.815772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.session.flush() Oct 20 13:24:11.815772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 20 13:24:11.815772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._flush(objects) Oct 20 13:24:11.815772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 20 13:24:11.815772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 20 13:24:11.815772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 20 13:24:11.815772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application compat.raise_( Oct 20 13:24:11.815772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 13:24:11.815772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception Oct 20 13:24:11.815772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 20 13:24:11.815772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application flush_context.execute() Oct 20 13:24:11.815772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 20 13:24:11.815772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rec.execute(self) Oct 20 13:24:11.815772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 20 13:24:11.816848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 20 13:24:11.816848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 20 13:24:11.816848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 20 13:24:11.816848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 20 13:24:11.816848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 20 13:24:11.816848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 20 13:24:11.816848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 20 13:24:11.816848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 20 13:24:11.816848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 20 13:24:11.816848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 20 13:24:11.816848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 20 13:24:11.816848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 20 13:24:11.816848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 20 13:24:11.816848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 20 13:24:11.816848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 20 13:24:11.817808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 20 13:24:11.817808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception Oct 20 13:24:11.817808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 20 13:24:11.817808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 20 13:24:11.817808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 20 13:24:11.817808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 20 13:24:11.817808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 20 13:24:11.817808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application result = self._query(query) Oct 20 13:24:11.817808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 20 13:24:11.817808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application conn.query(q) Oct 20 13:24:11.817808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 20 13:24:11.817808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 20 13:24:11.817808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 20 13:24:11.817808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application result.read() Oct 20 13:24:11.817808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 20 13:24:11.817808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 20 13:24:11.817808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 20 13:24:11.819382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 20 13:24:11.819382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 20 13:24:11.819382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 20 13:24:11.819382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 20 13:24:11.819382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 20 13:24:11.819382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 20 13:24:11.819382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 20 13:24:11.819382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [parameters: {'id': '27bc04721395435b95b974715b742df9', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 20 13:24:11.819382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 20 13:24:11.819382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:11.819382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:24:11.819382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:11.819382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:11.819382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 20 13:24:11.819382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 20 13:24:11.820469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 20 13:24:11.820469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 20 13:24:11.820469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 20 13:24:11.820469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:11.820469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:24:11.820469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:11.820469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:11.820469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:11.820469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:11.820469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:11.820469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:11.820469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:11.820469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:11.820469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:11.820469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:11.820469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:11.820469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:11.821600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 20 13:24:11.821600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 20 13:24:11.821600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:11.821600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:11.821600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 20 13:24:11.821600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 20 13:24:11.821600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:11.821600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:11.821600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 20 13:24:11.821600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 20 13:24:11.821600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 20 13:24:11.821600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:11.821600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 404/803] 10.222.0.36 () {60 vars in 1137 bytes} [Thu Oct 20 13:24:11 2022] POST /identity/v3/domains => generated 190 bytes in 166 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:24:11.821600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35be3e-ef99-43ef-8bec-1378c7f2ce7e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:11.823190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-5d434cc0-0a44-4675-b4c8-c23c04c7a38d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:24:11.823190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:11.823190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:11.823190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:11.823190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:11.823190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:11.823190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:11.823190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:11.823190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:11.823190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:11.823190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:11.823190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:11.823190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:24:11.823190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:24:11.823190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:24:11.823190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:24:11.824209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:11.824209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:11.824209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:11.824209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:11.824209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:11.824209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:11.824209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:11.824209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:11.824209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:11.824209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:11.824209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:11.824209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:11.824209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:11.824209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:11.824209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:11.824209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:11.824209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:24:11.825367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:24:11.825367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:24:11.825367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:11.831643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 400/804] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:24:11.832962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d434cc0-0a44-4675-b4c8-c23c04c7a38d None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:11.852036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:11.944144 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d434cc0-0a44-4675-b4c8-c23c04c7a38d None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:11.947946 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35be3e-ef99-43ef-8bec-1378c7f2ce7e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:11.979488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d6def-cb5f-4b1c-9a41-31473f6d50ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:11.980100 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d6def-cb5f-4b1c-9a41-31473f6d50ee None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:11.980383 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d6def-cb5f-4b1c-9a41-31473f6d50ee None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:11.980657 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d6def-cb5f-4b1c-9a41-31473f6d50ee None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:11.981299 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d6def-cb5f-4b1c-9a41-31473f6d50ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:11.981605 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d6def-cb5f-4b1c-9a41-31473f6d50ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:11.983211 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d6def-cb5f-4b1c-9a41-31473f6d50ee None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:11.984431 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cff05-5864-419e-ae4e-fe2614c69e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:11.985060 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cff05-5864-419e-ae4e-fe2614c69e7f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:11.985368 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cff05-5864-419e-ae4e-fe2614c69e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:11.985925 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5cff05-5864-419e-ae4e-fe2614c69e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:12.001098 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 401/805] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:24:12.001260 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cff05-5864-419e-ae4e-fe2614c69e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:12.001260 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5cff05-5864-419e-ae4e-fe2614c69e7f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:12.003356 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d6def-cb5f-4b1c-9a41-31473f6d50ee None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:12.017167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-ff5cff05-5864-419e-ae4e-fe2614c69e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:24:12.017167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:12.017167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:12.017167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:12.017167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:12.017167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:12.017167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:12.017167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:12.017167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:12.017167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:12.017167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:12.017167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:12.017167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:24:12.017167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:24:12.017167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:24:12.017167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:24:12.018166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:12.018166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:12.018166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:12.018166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:12.018166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:12.018166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:12.018166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:12.018166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:12.018166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:12.018166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:12.018166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:12.018166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:12.018166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:12.018166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:12.018166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:12.018166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:12.018166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:24:12.019506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:24:12.019506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:24:12.019506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:12.019506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 405/806] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:12.024001 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cff05-5864-419e-ae4e-fe2614c69e7f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:12.035380 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:12.095677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:12.120522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d6def-cb5f-4b1c-9a41-31473f6d50ee None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:12.140316 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5cff05-5864-419e-ae4e-fe2614c69e7f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:12.157838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09940805-ac49-4231-8e30-6c8ead6d01c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:12.159068 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09940805-ac49-4231-8e30-6c8ead6d01c0 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:12.159522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09940805-ac49-4231-8e30-6c8ead6d01c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:12.159962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09940805-ac49-4231-8e30-6c8ead6d01c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:12.167252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09940805-ac49-4231-8e30-6c8ead6d01c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:12.168886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09940805-ac49-4231-8e30-6c8ead6d01c0 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:12.175760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a2f96-af82-4161-9b6c-7a445b6e2383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:12.176365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a2f96-af82-4161-9b6c-7a445b6e2383 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:12.176638 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a2f96-af82-4161-9b6c-7a445b6e2383 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:12.176904 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233a2f96-af82-4161-9b6c-7a445b6e2383 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:12.177530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a2f96-af82-4161-9b6c-7a445b6e2383 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:12.177829 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a2f96-af82-4161-9b6c-7a445b6e2383 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:12.179189 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233a2f96-af82-4161-9b6c-7a445b6e2383 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:12.180365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-09940805-ac49-4231-8e30-6c8ead6d01c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:24:12.180365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:12.180365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:12.180365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:12.180365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:12.180365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:12.180365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:12.180365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:12.180365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:12.180365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:12.180365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:12.180365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:12.180365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:24:12.180365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:24:12.180365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:24:12.181190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:24:12.181190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:12.181190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:12.181190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:12.181190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:12.181190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:12.181190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:12.181190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:12.181190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:12.181190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:12.181190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:12.181190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:12.181190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:12.181190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:12.181190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:12.181190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:12.181190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:12.182104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:24:12.182104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:24:12.182104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:24:12.182104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:24:12.182104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:24:12.182104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:24:12.182104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:24:12.182104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:12.182104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 402/807] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:24:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:24:12.187703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09940805-ac49-4231-8e30-6c8ead6d01c0 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:12.199395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 406/808] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:24:12.302439 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09940805-ac49-4231-8e30-6c8ead6d01c0 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:12.342896 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8eaec-9856-4ed9-b5ec-f5605e67eaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:12.343547 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8eaec-9856-4ed9-b5ec-f5605e67eaa2 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:12.343823 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8eaec-9856-4ed9-b5ec-f5605e67eaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:12.344093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8eaec-9856-4ed9-b5ec-f5605e67eaa2 None admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:12.344793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8eaec-9856-4ed9-b5ec-f5605e67eaa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:12.345097 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8eaec-9856-4ed9-b5ec-f5605e67eaa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:12.346557 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8eaec-9856-4ed9-b5ec-f5605e67eaa2 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:12.349586 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:12.366699 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 403/809] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:24:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:24:12.368289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a2f96-af82-4161-9b6c-7a445b6e2383 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:12.431347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc260b73-5c25-42fb-8fb3-b6da554166ff None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:12.431774 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc260b73-5c25-42fb-8fb3-b6da554166ff None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:12.432141 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc260b73-5c25-42fb-8fb3-b6da554166ff None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:12.433612 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 404/810] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:24:12.440551 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9b59d-cd87-44fb-9e50-d928c6fe8ba0 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:12.440833 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9b59d-cd87-44fb-9e50-d928c6fe8ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:12.441107 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9b59d-cd87-44fb-9e50-d928c6fe8ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:12.457393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:12.464421 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-e1d9b59d-cd87-44fb-9e50-d928c6fe8ba0 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:12.465753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e1d9b59d-cd87-44fb-9e50-d928c6fe8ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:12.497798 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233a2f96-af82-4161-9b6c-7a445b6e2383 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:12.548600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11900aad-dd41-49de-8f9d-fc4074a5f9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:12.551144 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11900aad-dd41-49de-8f9d-fc4074a5f9c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:12.551451 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11900aad-dd41-49de-8f9d-fc4074a5f9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:12.551735 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11900aad-dd41-49de-8f9d-fc4074a5f9c7 None admin] PATH_INFO: `/v3/projects/c25f337a79704728adaa03f4103eef1c/users/674c5b25932a41309428ba6c6c72ed02/roles/248eca0e6d1f475aa038270f567786ba` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:12.556233 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11900aad-dd41-49de-8f9d-fc4074a5f9c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c25f337a79704728adaa03f4103eef1c, user_id=674c5b25932a41309428ba6c6c72ed02, role_id=248eca0e6d1f475aa038270f567786ba)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:12.557606 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11900aad-dd41-49de-8f9d-fc4074a5f9c7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:12.563591 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 405/811] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 13:24:12.575581 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 407/812] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:24:12 2022] PUT /identity/v3/projects/c25f337a79704728adaa03f4103eef1c/users/674c5b25932a41309428ba6c6c72ed02/roles/248eca0e6d1f475aa038270f567786ba => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:24:12.922468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9b59d-cd87-44fb-9e50-d928c6fe8ba0 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:13.028601 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9b59d-cd87-44fb-9e50-d928c6fe8ba0 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:13.057415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:13.067657 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ddc50-39cb-4b75-8f67-b9d8e51f7f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:13.068309 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ddc50-39cb-4b75-8f67-b9d8e51f7f16 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:13.068589 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ddc50-39cb-4b75-8f67-b9d8e51f7f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:13.068862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ddc50-39cb-4b75-8f67-b9d8e51f7f16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:13.080912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ddc50-39cb-4b75-8f67-b9d8e51f7f16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:24:13.086431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-567ddc50-39cb-4b75-8f67-b9d8e51f7f16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:24:13.086431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:13.086431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:13.086431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:13.086431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:13.086431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:13.086431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:13.086431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:13.086431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:13.086431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:13.086431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:13.086431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:13.086431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:24:13.086431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:24:13.086431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:24:13.086431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:24:13.087428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:24:13.087428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:24:13.087428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:24:13.087428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:24:13.087428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:13.087428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:13.087428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:13.087428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:13.087428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:13.087428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:13.087428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:13.087428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:13.087428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:13.087428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:13.087428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:13.087428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:13.088245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:13.088245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:13.088245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:13.088245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:13.088245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:24:13.088245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:24:13.088245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:24:13.088245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:24:13.088245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:24:13.088245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:24:13.088245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:24:13.088245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:13.088245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 406/813] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:24:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:13.094162 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11900aad-dd41-49de-8f9d-fc4074a5f9c7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:13.192250 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11900aad-dd41-49de-8f9d-fc4074a5f9c7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:13.218180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:13.227300 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd80d32-1e2d-47c2-b964-209bdb96acd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:13.227895 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd80d32-1e2d-47c2-b964-209bdb96acd7 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:13.228169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd80d32-1e2d-47c2-b964-209bdb96acd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:13.228437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd80d32-1e2d-47c2-b964-209bdb96acd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:13.229086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd80d32-1e2d-47c2-b964-209bdb96acd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:13.229385 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd80d32-1e2d-47c2-b964-209bdb96acd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:13.230735 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd80d32-1e2d-47c2-b964-209bdb96acd7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:13.239150 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 408/814] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:24:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:13.246663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ddc50-39cb-4b75-8f67-b9d8e51f7f16 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:13.347900 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ddc50-39cb-4b75-8f67-b9d8e51f7f16 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:13.381403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213217e-15fc-443a-9514-c5321fc1cdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:13.382064 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213217e-15fc-443a-9514-c5321fc1cdd4 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:13.382347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213217e-15fc-443a-9514-c5321fc1cdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:13.382619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213217e-15fc-443a-9514-c5321fc1cdd4 None admin] PATH_INFO: `/v3/users/5c579861ebf44ad39690f53f8cbc9cdc` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:13.396302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213217e-15fc-443a-9514-c5321fc1cdd4 None admin] RBAC: Authorizing `identity:get_user(user_id=5c579861ebf44ad39690f53f8cbc9cdc)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:13.397750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213217e-15fc-443a-9514-c5321fc1cdd4 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:13.399418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 407/815] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:24:13 2022] GET /identity/v3/users/5c579861ebf44ad39690f53f8cbc9cdc => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:13.405859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd80d32-1e2d-47c2-b964-209bdb96acd7 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:13.507312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd80d32-1e2d-47c2-b964-209bdb96acd7 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:13.541996 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce459cf8-1d19-49e3-85d2-084685f81034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:13.542604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce459cf8-1d19-49e3-85d2-084685f81034 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:13.542876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce459cf8-1d19-49e3-85d2-084685f81034 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:13.543169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce459cf8-1d19-49e3-85d2-084685f81034 None admin] PATH_INFO: `/v3/projects/53ce72c7542e4b03a6f379d58172d7ab` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:13.544254 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce459cf8-1d19-49e3-85d2-084685f81034 None admin] RBAC: Authorizing `identity:get_project(project_id=53ce72c7542e4b03a6f379d58172d7ab)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:13.546383 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce459cf8-1d19-49e3-85d2-084685f81034 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:13.548014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 409/816] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:24:13 2022] GET /identity/v3/projects/53ce72c7542e4b03a6f379d58172d7ab => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:13.554019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213217e-15fc-443a-9514-c5321fc1cdd4 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:13.598067 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:13.650229 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213217e-15fc-443a-9514-c5321fc1cdd4 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:13.683784 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d5a99-ea10-4a11-8756-2615d0ed96d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:13.684432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d5a99-ea10-4a11-8756-2615d0ed96d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:13.684705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d5a99-ea10-4a11-8756-2615d0ed96d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:13.684971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d5a99-ea10-4a11-8756-2615d0ed96d1 None admin] PATH_INFO: `/v3/projects/53ce72c7542e4b03a6f379d58172d7ab/users/5c579861ebf44ad39690f53f8cbc9cdc/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:13.687043 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d5a99-ea10-4a11-8756-2615d0ed96d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=53ce72c7542e4b03a6f379d58172d7ab, user_id=5c579861ebf44ad39690f53f8cbc9cdc, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:13.688455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d5a99-ea10-4a11-8756-2615d0ed96d1 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:13.701641 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 408/817] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:24:13 2022] PUT /identity/v3/projects/53ce72c7542e4b03a6f379d58172d7ab/users/5c579861ebf44ad39690f53f8cbc9cdc/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:24:14.758599 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71661a-efc6-4984-a990-47c02c33ad08 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:14.759189 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71661a-efc6-4984-a990-47c02c33ad08 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:14.759403 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71661a-efc6-4984-a990-47c02c33ad08 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:14.760744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 410/818] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:14.766693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4c4f8-27d9-42fc-96a9-355faa5ff582 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:14.767130 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4c4f8-27d9-42fc-96a9-355faa5ff582 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:14.767370 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4c4f8-27d9-42fc-96a9-355faa5ff582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:14.786204 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-deb4c4f8-27d9-42fc-96a9-355faa5ff582 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:14.787428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-deb4c4f8-27d9-42fc-96a9-355faa5ff582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:14.851909 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 409/819] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:15.120610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71661a-efc6-4984-a990-47c02c33ad08 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:15.178085 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:15.219308 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71661a-efc6-4984-a990-47c02c33ad08 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:15.252480 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba9d4c-dc28-4e9f-bff7-b30150e81469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:15.253123 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba9d4c-dc28-4e9f-bff7-b30150e81469 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:15.253395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba9d4c-dc28-4e9f-bff7-b30150e81469 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:15.253661 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba9d4c-dc28-4e9f-bff7-b30150e81469 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:15.263314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ba9d4c-dc28-4e9f-bff7-b30150e81469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:24:15.268352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-26ba9d4c-dc28-4e9f-bff7-b30150e81469 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 13:24:15.268352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:15.268352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:15.268352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:15.268352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:15.268352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:15.268352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:15.268352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:15.268352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:15.268352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:15.268352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:15.268352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:15.268352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:24:15.268352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:24:15.268352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:24:15.268352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:24:15.269487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:24:15.269487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:24:15.269487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:24:15.269487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:24:15.269487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:15.269487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:15.269487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:15.269487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:15.269487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:15.269487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:15.269487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:15.269487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:15.269487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:15.269487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:15.269487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:15.269487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:15.270377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:15.270377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:15.270377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:15.270377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:15.270377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:24:15.270377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:24:15.270377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:24:15.270377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:24:15.270377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:24:15.270377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:24:15.270377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 20 13:24:15.270377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:15.270377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 411/820] 10.222.0.36 () {56 vars in 1120 bytes} [Thu Oct 20 13:24:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:15.275417 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4c4f8-27d9-42fc-96a9-355faa5ff582 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:15.308940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:15.374675 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4c4f8-27d9-42fc-96a9-355faa5ff582 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:15.407696 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fca6c1-339b-4cd8-b9ad-cbf07999f046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:15.408294 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fca6c1-339b-4cd8-b9ad-cbf07999f046 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:15.408571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fca6c1-339b-4cd8-b9ad-cbf07999f046 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:15.408841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fca6c1-339b-4cd8-b9ad-cbf07999f046 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:15.409492 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fca6c1-339b-4cd8-b9ad-cbf07999f046 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:15.409792 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fca6c1-339b-4cd8-b9ad-cbf07999f046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:15.411188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fca6c1-339b-4cd8-b9ad-cbf07999f046 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:15.419248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 410/821] 10.222.0.36 () {56 vars in 1115 bytes} [Thu Oct 20 13:24:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:15.425696 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba9d4c-dc28-4e9f-bff7-b30150e81469 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:15.522881 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba9d4c-dc28-4e9f-bff7-b30150e81469 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:15.539787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:15.556855 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a41473-0484-40ac-92af-d813034fc2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:15.557476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a41473-0484-40ac-92af-d813034fc2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:15.557758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a41473-0484-40ac-92af-d813034fc2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:15.558025 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a41473-0484-40ac-92af-d813034fc2c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:15.568514 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a41473-0484-40ac-92af-d813034fc2c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:15.569944 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a41473-0484-40ac-92af-d813034fc2c8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:15.584135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-e0a41473-0484-40ac-92af-d813034fc2c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:24:15.584135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:15.584135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:15.584135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:15.584135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:15.584135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:15.584135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:15.584135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:15.584135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:15.584135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:15.584135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:15.584135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:15.584135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:24:15.584135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:24:15.584135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:24:15.584135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:24:15.585133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:15.585133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:15.585133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:15.585133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:15.585133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:15.585133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:15.585133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:15.585133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:15.585133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:15.585133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:15.585133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:15.585133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:15.585133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:15.585133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:15.585133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:15.585133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:15.585133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:24:15.586034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:24:15.586034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:24:15.586034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:15.587101 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 412/822] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:15.590863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fca6c1-339b-4cd8-b9ad-cbf07999f046 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:15.685037 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:15.692196 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fca6c1-339b-4cd8-b9ad-cbf07999f046 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:15.726259 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bef58a-2462-409c-a95f-69e7229d76ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:15.726897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bef58a-2462-409c-a95f-69e7229d76ff None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:15.727207 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bef58a-2462-409c-a95f-69e7229d76ff None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:15.727482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bef58a-2462-409c-a95f-69e7229d76ff None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:15.728145 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bef58a-2462-409c-a95f-69e7229d76ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:15.728452 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bef58a-2462-409c-a95f-69e7229d76ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:15.729885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bef58a-2462-409c-a95f-69e7229d76ff None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:15.744047 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 411/823] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:15.751245 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a41473-0484-40ac-92af-d813034fc2c8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:15.842801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b2a3c-d6d4-409e-9432-fc7a14188af7 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:15.843383 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b2a3c-d6d4-409e-9432-fc7a14188af7 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:15.843383 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b2a3c-d6d4-409e-9432-fc7a14188af7 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:15.844672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 412/824] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:24:15.849645 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdd7c3-313b-4959-aabc-5a1c21286bb6 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:15.849933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdd7c3-313b-4959-aabc-5a1c21286bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:15.850043 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a41473-0484-40ac-92af-d813034fc2c8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:15.850426 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdd7c3-313b-4959-aabc-5a1c21286bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:15.867703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-62cdd7c3-313b-4959-aabc-5a1c21286bb6 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:15.868900 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-62cdd7c3-313b-4959-aabc-5a1c21286bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:15.883878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ad6e8-ca08-478f-a2e8-7acfe9dd9246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:15.884501 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ad6e8-ca08-478f-a2e8-7acfe9dd9246 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:15.884778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ad6e8-ca08-478f-a2e8-7acfe9dd9246 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:15.885043 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ad6e8-ca08-478f-a2e8-7acfe9dd9246 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:15.893113 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ad6e8-ca08-478f-a2e8-7acfe9dd9246 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:15.894529 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ad6e8-ca08-478f-a2e8-7acfe9dd9246 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:15.905253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-a97ad6e8-ca08-478f-a2e8-7acfe9dd9246 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 20 13:24:15.905253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:15.905253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:15.905253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:15.905253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:15.905253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:15.905253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:15.905253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:15.905253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:15.905253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:15.905253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:15.905253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:15.905253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:24:15.905253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:24:15.905253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:24:15.905253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:15.906363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:15.907973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:15.907973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:15.907973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:24:15.907973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:24:15.907973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:24:15.907973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:24:15.907973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:24:15.907973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:24:15.907973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 20 13:24:15.907973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:15.907973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 413/825] 10.222.0.36 () {56 vars in 1093 bytes} [Thu Oct 20 13:24:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:15.911947 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ad6e8-ca08-478f-a2e8-7acfe9dd9246 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:15.941674 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 413/826] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 20 13:24:15.942699 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:16.011538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ad6e8-ca08-478f-a2e8-7acfe9dd9246 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:16.044580 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538b763-fe33-4aaa-9696-05e2c9c68e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:16.045175 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538b763-fe33-4aaa-9696-05e2c9c68e03 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:16.045537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538b763-fe33-4aaa-9696-05e2c9c68e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:16.046025 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538b763-fe33-4aaa-9696-05e2c9c68e03 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:16.046749 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538b763-fe33-4aaa-9696-05e2c9c68e03 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:16.047081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538b763-fe33-4aaa-9696-05e2c9c68e03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:16.048490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538b763-fe33-4aaa-9696-05e2c9c68e03 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:16.065467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 414/827] 10.222.0.36 () {56 vars in 1133 bytes} [Thu Oct 20 13:24:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:24:16.071276 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdd7c3-313b-4959-aabc-5a1c21286bb6 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:16.155435 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:16.171070 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdd7c3-313b-4959-aabc-5a1c21286bb6 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:16.204680 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b225ec-309e-48fb-8b8c-edb8b7aa8ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:16.205073 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b225ec-309e-48fb-8b8c-edb8b7aa8ecd None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:16.205353 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b225ec-309e-48fb-8b8c-edb8b7aa8ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:16.205644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b225ec-309e-48fb-8b8c-edb8b7aa8ecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:16.214354 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538b763-fe33-4aaa-9696-05e2c9c68e03 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:16.272646 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b225ec-309e-48fb-8b8c-edb8b7aa8ecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:16.274100 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b225ec-309e-48fb-8b8c-edb8b7aa8ecd None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:16.300123 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:16.312558 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538b763-fe33-4aaa-9696-05e2c9c68e03 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:16.345766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a5a8f-3e8b-4267-8b79-6ad7e7feb075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:16.346382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a5a8f-3e8b-4267-8b79-6ad7e7feb075 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:16.346656 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a5a8f-3e8b-4267-8b79-6ad7e7feb075 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:16.346924 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a5a8f-3e8b-4267-8b79-6ad7e7feb075 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:16.356975 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a5a8f-3e8b-4267-8b79-6ad7e7feb075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:24:16.357519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:16.363044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-c54a5a8f-3e8b-4267-8b79-6ad7e7feb075 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:24:16.363044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:16.363044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:16.363044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:16.363044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:16.363044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:16.363044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:16.363044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:16.363044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:16.363044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:16.363044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:16.363044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:16.363044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:24:16.363044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:24:16.363044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:24:16.363044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:24:16.364011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:24:16.364011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:24:16.364011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:24:16.364011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:24:16.364011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:16.364011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:16.364011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:16.364011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:16.364011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:16.364011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:16.364011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:16.364011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:16.364011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:16.364011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:16.364011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:16.364011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:16.364854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:16.364854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:16.364854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:16.364854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:16.364854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:24:16.364854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:24:16.364854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:24:16.364854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:24:16.364854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:24:16.364854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:24:16.364854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:24:16.364854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:16.364854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 415/828] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:24:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:24:16.370063 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a5a8f-3e8b-4267-8b79-6ad7e7feb075 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:16.381307 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 414/829] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:24:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 20 13:24:16.382350 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b225ec-309e-48fb-8b8c-edb8b7aa8ecd None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:16.469294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a5a8f-3e8b-4267-8b79-6ad7e7feb075 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:16.479393 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b225ec-309e-48fb-8b8c-edb8b7aa8ecd None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:16.503058 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c367b3-16c0-4add-b959-5b846feac663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:16.503658 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c367b3-16c0-4add-b959-5b846feac663 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:16.503939 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c367b3-16c0-4add-b959-5b846feac663 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:16.504215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c367b3-16c0-4add-b959-5b846feac663 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:16.504870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c367b3-16c0-4add-b959-5b846feac663 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:16.505175 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c367b3-16c0-4add-b959-5b846feac663 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:16.506541 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c367b3-16c0-4add-b959-5b846feac663 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:16.513108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39269ae-e26e-49a1-8ce5-6b84c6296e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:16.513808 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39269ae-e26e-49a1-8ce5-6b84c6296e4d None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:16.514243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39269ae-e26e-49a1-8ce5-6b84c6296e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:16.514856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39269ae-e26e-49a1-8ce5-6b84c6296e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:16.515021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 416/830] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:24:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:24:16.520724 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c367b3-16c0-4add-b959-5b846feac663 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:16.525323 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39269ae-e26e-49a1-8ce5-6b84c6296e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:16.526857 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39269ae-e26e-49a1-8ce5-6b84c6296e4d None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:16.533986 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:16.542651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-b39269ae-e26e-49a1-8ce5-6b84c6296e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:24:16.542651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:16.542651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:16.542651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:16.542651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:16.542651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:16.542651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:16.542651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:16.542651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:16.542651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:16.542651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:16.542651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:16.542651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:24:16.542651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:24:16.542651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:24:16.542651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:24:16.543695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:16.543695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:16.543695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:16.543695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:16.543695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:16.543695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:16.543695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:16.543695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:16.543695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:16.543695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:16.543695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:16.543695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:16.543695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:16.543695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:16.543695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:16.543695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:16.543695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:24:16.544577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:24:16.544577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:24:16.544577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:16.544577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 415/831] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:16.549515 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39269ae-e26e-49a1-8ce5-6b84c6296e4d None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:16.589117 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:16.620595 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c367b3-16c0-4add-b959-5b846feac663 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:16.649882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39269ae-e26e-49a1-8ce5-6b84c6296e4d None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:16.654970 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b4234-204c-4204-992d-159159879167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:16.655615 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b4234-204c-4204-992d-159159879167 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:16.655898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b4234-204c-4204-992d-159159879167 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:16.656173 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b4234-204c-4204-992d-159159879167 None admin] PATH_INFO: `/v3/users/5c579861ebf44ad39690f53f8cbc9cdc` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:16.657340 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b4234-204c-4204-992d-159159879167 None admin] RBAC: Authorizing `identity:get_user(user_id=5c579861ebf44ad39690f53f8cbc9cdc)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:16.658791 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b4234-204c-4204-992d-159159879167 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:16.660505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 417/832] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:24:16 2022] GET /identity/v3/users/5c579861ebf44ad39690f53f8cbc9cdc => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:16.666794 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b4234-204c-4204-992d-159159879167 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:16.751965 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:16.774722 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b4234-204c-4204-992d-159159879167 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:16.800915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ea77d-0cc3-4de7-9d88-2930a002a7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:16.801523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ea77d-0cc3-4de7-9d88-2930a002a7cc None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:16.801796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ea77d-0cc3-4de7-9d88-2930a002a7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:16.802065 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ea77d-0cc3-4de7-9d88-2930a002a7cc None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:16.802691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ea77d-0cc3-4de7-9d88-2930a002a7cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:16.803025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ea77d-0cc3-4de7-9d88-2930a002a7cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:16.804390 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ea77d-0cc3-4de7-9d88-2930a002a7cc None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:16.810060 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a906d01-a888-40fa-b2dd-b8b609c1e4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:16.811457 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906d01-a888-40fa-b2dd-b8b609c1e4c8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:16.811589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906d01-a888-40fa-b2dd-b8b609c1e4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:16.811753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906d01-a888-40fa-b2dd-b8b609c1e4c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:16.815777 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 416/833] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:24:16.821412 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ea77d-0cc3-4de7-9d88-2930a002a7cc None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:16.881397 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a906d01-a888-40fa-b2dd-b8b609c1e4c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:16.882881 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a906d01-a888-40fa-b2dd-b8b609c1e4c8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:16.919819 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:16.924475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ea77d-0cc3-4de7-9d88-2930a002a7cc None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:16.958197 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056388b9-2d5b-4323-afa9-feeba0f42ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:16.958821 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056388b9-2d5b-4323-afa9-feeba0f42ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:16.959118 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056388b9-2d5b-4323-afa9-feeba0f42ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:16.959385 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056388b9-2d5b-4323-afa9-feeba0f42ce2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:16.959802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:16.966095 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056388b9-2d5b-4323-afa9-feeba0f42ce2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:16.967694 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056388b9-2d5b-4323-afa9-feeba0f42ce2 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:16.978517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-056388b9-2d5b-4323-afa9-feeba0f42ce2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:24:16.978517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:16.978517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:16.978517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:16.978517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:16.978517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:16.978517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:16.978517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:16.978517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:16.978517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:16.978517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:16.978517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:16.978517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:24:16.978517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:24:16.978517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:24:16.979475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:24:16.979475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:16.979475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:16.979475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:16.979475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:16.979475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:16.979475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:16.979475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:16.979475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:16.979475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:16.979475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:16.979475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:16.979475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:16.979475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:16.979475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:16.979475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:16.979475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:16.980358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:24:16.980358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:24:16.980358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:24:16.980358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:24:16.980358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:24:16.980358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:24:16.980358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:24:16.980358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:16.980358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 417/834] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:24:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:24:16.985164 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 418/835] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:24:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 20 13:24:16.986077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056388b9-2d5b-4323-afa9-feeba0f42ce2 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:16.990789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a906d01-a888-40fa-b2dd-b8b609c1e4c8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:17.082432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056388b9-2d5b-4323-afa9-feeba0f42ce2 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:17.086462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a906d01-a888-40fa-b2dd-b8b609c1e4c8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:17.116033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33194a3e-e5ba-45bf-80c5-2a7e7bd3da71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:17.116631 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33194a3e-e5ba-45bf-80c5-2a7e7bd3da71 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:17.116908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33194a3e-e5ba-45bf-80c5-2a7e7bd3da71 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:17.117176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33194a3e-e5ba-45bf-80c5-2a7e7bd3da71 None admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:17.117854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33194a3e-e5ba-45bf-80c5-2a7e7bd3da71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:17.118156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33194a3e-e5ba-45bf-80c5-2a7e7bd3da71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:17.119590 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33194a3e-e5ba-45bf-80c5-2a7e7bd3da71 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:17.120309 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cbaed-9080-428f-884f-aa2e83fdf304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:17.120933 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cbaed-9080-428f-884f-aa2e83fdf304 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:17.121198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cbaed-9080-428f-884f-aa2e83fdf304 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:17.121468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cbaed-9080-428f-884f-aa2e83fdf304 None admin] PATH_INFO: `/v3/projects/53ce72c7542e4b03a6f379d58172d7ab` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:17.122566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cbaed-9080-428f-884f-aa2e83fdf304 None admin] RBAC: Authorizing `identity:get_project(project_id=53ce72c7542e4b03a6f379d58172d7ab)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:17.125014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cbaed-9080-428f-884f-aa2e83fdf304 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:17.126961 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 419/836] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:24:16 2022] GET /identity/v3/projects/53ce72c7542e4b03a6f379d58172d7ab => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:24:17.136303 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 418/837] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:24:17.136462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cbaed-9080-428f-884f-aa2e83fdf304 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:17.137591 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33194a3e-e5ba-45bf-80c5-2a7e7bd3da71 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:17.156717 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:17.180270 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:17.234155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cbaed-9080-428f-884f-aa2e83fdf304 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:17.237936 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33194a3e-e5ba-45bf-80c5-2a7e7bd3da71 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:17.267610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0cc61-4bcb-4afd-b749-c6d9533099a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:17.268208 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0cc61-4bcb-4afd-b749-c6d9533099a0 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:17.268548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0cc61-4bcb-4afd-b749-c6d9533099a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:17.268828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0cc61-4bcb-4afd-b749-c6d9533099a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:17.269548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0cc61-4bcb-4afd-b749-c6d9533099a0 None admin] RBAC: Adding query filter params (role.id=9c0f227afc2e4a0aa404780de229488c, scope.project.id=53ce72c7542e4b03a6f379d58172d7ab, user.id=5c579861ebf44ad39690f53f8cbc9cdc) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:17.269858 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0cc61-4bcb-4afd-b749-c6d9533099a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:17.270456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40124608-ad5b-4cf8-8263-2a8eb30e92fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:17.271092 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40124608-ad5b-4cf8-8263-2a8eb30e92fd None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:17.271309 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0cc61-4bcb-4afd-b749-c6d9533099a0 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:17.271403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40124608-ad5b-4cf8-8263-2a8eb30e92fd None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:17.271635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40124608-ad5b-4cf8-8263-2a8eb30e92fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:17.272351 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40124608-ad5b-4cf8-8263-2a8eb30e92fd None admin] RBAC: Adding query filter params (role.id=248eca0e6d1f475aa038270f567786ba, scope.project.id=c25f337a79704728adaa03f4103eef1c, user.id=674c5b25932a41309428ba6c6c72ed02) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:17.272667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40124608-ad5b-4cf8-8263-2a8eb30e92fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:17.274065 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40124608-ad5b-4cf8-8263-2a8eb30e92fd None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:17.277150 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 420/838] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:24:17 2022] GET /identity/v3/role_assignments?user.id=5c579861ebf44ad39690f53f8cbc9cdc&scope.project.id=53ce72c7542e4b03a6f379d58172d7ab&role.id=9c0f227afc2e4a0aa404780de229488c => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:24:17.280452 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 419/839] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:24:17 2022] GET /identity/v3/role_assignments?user.id=674c5b25932a41309428ba6c6c72ed02&scope.project.id=c25f337a79704728adaa03f4103eef1c&role.id=248eca0e6d1f475aa038270f567786ba => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:24:19.456018 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13429bc3-1b54-4a70-8092-fcbc0ed5a6d3 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:19.456569 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13429bc3-1b54-4a70-8092-fcbc0ed5a6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:19.456569 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13429bc3-1b54-4a70-8092-fcbc0ed5a6d3 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:19.457906 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 421/840] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:19.463413 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39810a2f-937d-4ce7-afe2-05f34120ecf5 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:19.463828 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39810a2f-937d-4ce7-afe2-05f34120ecf5 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:19.463940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39810a2f-937d-4ce7-afe2-05f34120ecf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:19.481466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-39810a2f-937d-4ce7-afe2-05f34120ecf5 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:19.482689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-39810a2f-937d-4ce7-afe2-05f34120ecf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:19.548297 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 420/841] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:19.818850 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13429bc3-1b54-4a70-8092-fcbc0ed5a6d3 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:19.918271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13429bc3-1b54-4a70-8092-fcbc0ed5a6d3 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:19.928455 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:19.950871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eb3e9d-826a-4f1a-ae12-5b1aebbd660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:19.952026 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb3e9d-826a-4f1a-ae12-5b1aebbd660a None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:19.952475 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb3e9d-826a-4f1a-ae12-5b1aebbd660a None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:19.952751 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eb3e9d-826a-4f1a-ae12-5b1aebbd660a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:19.953846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb3e9d-826a-4f1a-ae12-5b1aebbd660a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:19.955297 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eb3e9d-826a-4f1a-ae12-5b1aebbd660a None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:19.956843 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 422/842] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:24:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:19.962620 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39810a2f-937d-4ce7-afe2-05f34120ecf5 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:19.977289 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:20.060066 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39810a2f-937d-4ce7-afe2-05f34120ecf5 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:20.094074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018f6bd-c097-4e6d-a620-c900fccae395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:20.094603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018f6bd-c097-4e6d-a620-c900fccae395 None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:20.094881 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018f6bd-c097-4e6d-a620-c900fccae395 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:20.095181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018f6bd-c097-4e6d-a620-c900fccae395 None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:20.095829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018f6bd-c097-4e6d-a620-c900fccae395 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:20.097234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018f6bd-c097-4e6d-a620-c900fccae395 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:20.117739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 421/843] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:24:19 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:24:22.254453 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f56850-6457-4d86-839a-1debaad679b7 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:22.255000 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f56850-6457-4d86-839a-1debaad679b7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:22.255000 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f56850-6457-4d86-839a-1debaad679b7 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:22.256285 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 423/844] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:22.261680 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e02d2-2650-47db-92e5-8428cfcd5cc0 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:22.262072 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e02d2-2650-47db-92e5-8428cfcd5cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:22.262234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e02d2-2650-47db-92e5-8428cfcd5cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:22.281202 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-cb4e02d2-2650-47db-92e5-8428cfcd5cc0 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:22.282378 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-cb4e02d2-2650-47db-92e5-8428cfcd5cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:22.342309 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:22.348828 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 422/845] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:22.619231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f56850-6457-4d86-839a-1debaad679b7 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:22.716229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f56850-6457-4d86-839a-1debaad679b7 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:22.747778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cb7df-a075-4627-80f6-d8ce294e7860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:22.748993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cb7df-a075-4627-80f6-d8ce294e7860 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:22.749274 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cb7df-a075-4627-80f6-d8ce294e7860 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:22.749542 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cb7df-a075-4627-80f6-d8ce294e7860 None admin] PATH_INFO: `/v3/roles/c63cd01b72aa49d5932f4b4f762fdf5c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:22.750892 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cb7df-a075-4627-80f6-d8ce294e7860 None admin] RBAC: Authorizing `identity:get_role(role_id=c63cd01b72aa49d5932f4b4f762fdf5c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:22.752270 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cb7df-a075-4627-80f6-d8ce294e7860 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:22.753541 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 424/846] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:24:22 2022] GET /identity/v3/roles/c63cd01b72aa49d5932f4b4f762fdf5c => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:22.759266 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e02d2-2650-47db-92e5-8428cfcd5cc0 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:22.855984 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e02d2-2650-47db-92e5-8428cfcd5cc0 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:22.890558 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564f66b-ad28-48f0-8ac6-af040e30da4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:22.891221 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564f66b-ad28-48f0-8ac6-af040e30da4c None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:22.891506 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564f66b-ad28-48f0-8ac6-af040e30da4c None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:22.891780 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564f66b-ad28-48f0-8ac6-af040e30da4c None admin] PATH_INFO: `/v3/users/72d6f67529cb410495794eb572236f06` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:22.904734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564f66b-ad28-48f0-8ac6-af040e30da4c None admin] RBAC: Authorizing `identity:get_user(user_id=72d6f67529cb410495794eb572236f06)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:22.906181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564f66b-ad28-48f0-8ac6-af040e30da4c None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:22.907840 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 423/847] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:24:22 2022] GET /identity/v3/users/72d6f67529cb410495794eb572236f06 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:22.913529 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cb7df-a075-4627-80f6-d8ce294e7860 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:22.959568 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:23.011176 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cb7df-a075-4627-80f6-d8ce294e7860 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:23.043116 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbb170-03b5-4690-ade2-a2bda76c6765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:23.043734 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbb170-03b5-4690-ade2-a2bda76c6765 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:23.044014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbb170-03b5-4690-ade2-a2bda76c6765 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:23.044291 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbb170-03b5-4690-ade2-a2bda76c6765 None admin] PATH_INFO: `/v3/projects/53ce72c7542e4b03a6f379d58172d7ab` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:23.045956 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbb170-03b5-4690-ade2-a2bda76c6765 None admin] RBAC: Authorizing `identity:get_project(project_id=53ce72c7542e4b03a6f379d58172d7ab)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:23.047395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbb170-03b5-4690-ade2-a2bda76c6765 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:23.048995 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 425/848] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:24:22 2022] GET /identity/v3/projects/53ce72c7542e4b03a6f379d58172d7ab => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:23.054811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564f66b-ad28-48f0-8ac6-af040e30da4c None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:23.109363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:23.151310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564f66b-ad28-48f0-8ac6-af040e30da4c None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:23.183649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b325d1-f86a-4564-8f1c-3822b10dbd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:23.184291 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b325d1-f86a-4564-8f1c-3822b10dbd77 None admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:23.184570 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b325d1-f86a-4564-8f1c-3822b10dbd77 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:23.184843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b325d1-f86a-4564-8f1c-3822b10dbd77 None admin] PATH_INFO: `/v3/projects/53ce72c7542e4b03a6f379d58172d7ab/users/72d6f67529cb410495794eb572236f06/roles/c63cd01b72aa49d5932f4b4f762fdf5c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:23.187506 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b325d1-f86a-4564-8f1c-3822b10dbd77 None admin] RBAC: Authorizing `identity:create_grant(project_id=53ce72c7542e4b03a6f379d58172d7ab, user_id=72d6f67529cb410495794eb572236f06, role_id=c63cd01b72aa49d5932f4b4f762fdf5c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:23.189867 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b325d1-f86a-4564-8f1c-3822b10dbd77 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:23.203173 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 424/849] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:24:23 2022] PUT /identity/v3/projects/53ce72c7542e4b03a6f379d58172d7ab/users/72d6f67529cb410495794eb572236f06/roles/c63cd01b72aa49d5932f4b4f762fdf5c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:24:25.304948 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba00bd6-0fbd-4ddb-ae96-2d60ab7300b3 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:25.305477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba00bd6-0fbd-4ddb-ae96-2d60ab7300b3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:25.305477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba00bd6-0fbd-4ddb-ae96-2d60ab7300b3 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:25.306819 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 426/850] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:25.312499 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f592d-eb1f-456c-aee3-6ec705200a36 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:25.312922 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f592d-eb1f-456c-aee3-6ec705200a36 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:25.313053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f592d-eb1f-456c-aee3-6ec705200a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:25.330911 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-ca5f592d-eb1f-456c-aee3-6ec705200a36 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:25.332123 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-ca5f592d-eb1f-456c-aee3-6ec705200a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:25.396238 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 425/851] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:25.665151 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba00bd6-0fbd-4ddb-ae96-2d60ab7300b3 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:25.764214 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba00bd6-0fbd-4ddb-ae96-2d60ab7300b3 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:25.777408 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:25.798073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a549e-89ed-4700-b9f3-4996db9f0848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:25.798685 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a549e-89ed-4700-b9f3-4996db9f0848 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:25.798973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a549e-89ed-4700-b9f3-4996db9f0848 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:25.799272 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a549e-89ed-4700-b9f3-4996db9f0848 None admin] PATH_INFO: `/v3/roles/c63cd01b72aa49d5932f4b4f762fdf5c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:25.800627 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a549e-89ed-4700-b9f3-4996db9f0848 None admin] RBAC: Authorizing `identity:get_role(role_id=c63cd01b72aa49d5932f4b4f762fdf5c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:25.801977 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a549e-89ed-4700-b9f3-4996db9f0848 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:25.803306 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 427/852] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:24:25 2022] GET /identity/v3/roles/c63cd01b72aa49d5932f4b4f762fdf5c => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:25.808973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f592d-eb1f-456c-aee3-6ec705200a36 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:25.854002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:25.909945 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f592d-eb1f-456c-aee3-6ec705200a36 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:25.942270 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d03fb-6b18-450e-88f3-d96b961b6354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:25.942828 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d03fb-6b18-450e-88f3-d96b961b6354 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:25.943137 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d03fb-6b18-450e-88f3-d96b961b6354 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:25.943408 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d03fb-6b18-450e-88f3-d96b961b6354 None admin] PATH_INFO: `/v3/users/72d6f67529cb410495794eb572236f06` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:25.944516 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d03fb-6b18-450e-88f3-d96b961b6354 None admin] RBAC: Authorizing `identity:get_user(user_id=72d6f67529cb410495794eb572236f06)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:25.945932 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d03fb-6b18-450e-88f3-d96b961b6354 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:25.947529 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 426/853] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:24:25 2022] GET /identity/v3/users/72d6f67529cb410495794eb572236f06 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:25.953843 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a549e-89ed-4700-b9f3-4996db9f0848 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:26.049320 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a549e-89ed-4700-b9f3-4996db9f0848 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:26.081267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d2401-4864-4b2f-9028-1a91ce826cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:26.081844 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d2401-4864-4b2f-9028-1a91ce826cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:26.082118 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d2401-4864-4b2f-9028-1a91ce826cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:26.082386 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d2401-4864-4b2f-9028-1a91ce826cb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:26.128498 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:26.146508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d2401-4864-4b2f-9028-1a91ce826cb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:26.147956 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d2401-4864-4b2f-9028-1a91ce826cb0 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:26.240336 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 428/854] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:24:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 13:24:26.246066 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d03fb-6b18-450e-88f3-d96b961b6354 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:26.342628 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d03fb-6b18-450e-88f3-d96b961b6354 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:26.355944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:26.376569 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e7d9b-bb98-4f7f-acbc-744a8e750b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:26.377185 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7d9b-bb98-4f7f-acbc-744a8e750b0d None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:26.377461 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7d9b-bb98-4f7f-acbc-744a8e750b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:26.377730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e7d9b-bb98-4f7f-acbc-744a8e750b0d None admin] PATH_INFO: `/v3/projects/53ce72c7542e4b03a6f379d58172d7ab` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:26.378818 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e7d9b-bb98-4f7f-acbc-744a8e750b0d None admin] RBAC: Authorizing `identity:get_project(project_id=53ce72c7542e4b03a6f379d58172d7ab)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:26.380256 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e7d9b-bb98-4f7f-acbc-744a8e750b0d None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:26.381850 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 427/855] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:24:26 2022] GET /identity/v3/projects/53ce72c7542e4b03a6f379d58172d7ab => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:26.388140 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d2401-4864-4b2f-9028-1a91ce826cb0 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:26.467205 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:26.485215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d2401-4864-4b2f-9028-1a91ce826cb0 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:26.518525 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270161b8-3e50-4493-addd-dc2b6a170b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:26.519093 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270161b8-3e50-4493-addd-dc2b6a170b87 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:26.519376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270161b8-3e50-4493-addd-dc2b6a170b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:26.519653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270161b8-3e50-4493-addd-dc2b6a170b87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:26.520368 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270161b8-3e50-4493-addd-dc2b6a170b87 None admin] RBAC: Adding query filter params (role.id=c63cd01b72aa49d5932f4b4f762fdf5c, scope.project.id=53ce72c7542e4b03a6f379d58172d7ab, user.id=72d6f67529cb410495794eb572236f06) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:26.520679 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270161b8-3e50-4493-addd-dc2b6a170b87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:26.522081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270161b8-3e50-4493-addd-dc2b6a170b87 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:26.527735 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 429/856] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:24:26 2022] GET /identity/v3/role_assignments?user.id=72d6f67529cb410495794eb572236f06&scope.project.id=53ce72c7542e4b03a6f379d58172d7ab&role.id=c63cd01b72aa49d5932f4b4f762fdf5c => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:24:28.642398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a79c2-1847-4fce-822f-f0a8def9a4ca None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:28.642927 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a79c2-1847-4fce-822f-f0a8def9a4ca None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:28.642927 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a79c2-1847-4fce-822f-f0a8def9a4ca None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:28.644280 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 428/857] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:28.649573 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1d00f-87d3-47af-ac84-f09c8a7eecba None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:28.649964 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1d00f-87d3-47af-ac84-f09c8a7eecba None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:28.650127 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1d00f-87d3-47af-ac84-f09c8a7eecba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:28.668740 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-b9d1d00f-87d3-47af-ac84-f09c8a7eecba None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:28.670528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b9d1d00f-87d3-47af-ac84-f09c8a7eecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:28.734131 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 430/858] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:29.012371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a79c2-1847-4fce-822f-f0a8def9a4ca None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:29.114221 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a79c2-1847-4fce-822f-f0a8def9a4ca None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:29.146991 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8a53f-2d87-498a-9277-f29dae257fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:29.147607 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8a53f-2d87-498a-9277-f29dae257fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:29.147883 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8a53f-2d87-498a-9277-f29dae257fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:29.148152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8a53f-2d87-498a-9277-f29dae257fa8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:29.149233 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8a53f-2d87-498a-9277-f29dae257fa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:29.150632 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8a53f-2d87-498a-9277-f29dae257fa8 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:29.152184 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 429/859] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:24:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:29.158423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1d00f-87d3-47af-ac84-f09c8a7eecba None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:29.231864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:29.255953 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1d00f-87d3-47af-ac84-f09c8a7eecba None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:29.288372 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f5301-3aec-429a-94b0-e3409ca8fc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:29.289217 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f5301-3aec-429a-94b0-e3409ca8fc32 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:29.289489 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f5301-3aec-429a-94b0-e3409ca8fc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:29.289751 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f5301-3aec-429a-94b0-e3409ca8fc32 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:29.290394 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f5301-3aec-429a-94b0-e3409ca8fc32 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:29.291822 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f5301-3aec-429a-94b0-e3409ca8fc32 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:29.318263 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 431/860] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Oct 20 13:24:29 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:24:31.465398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2b2e4-37e9-467b-a803-e94c25b5d477 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:31.465966 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2b2e4-37e9-467b-a803-e94c25b5d477 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:31.465966 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2b2e4-37e9-467b-a803-e94c25b5d477 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:31.467439 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 430/861] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:31.472608 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44fe96-d4b0-43d4-b1f1-4e26d1a4bfc8 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:31.473044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44fe96-d4b0-43d4-b1f1-4e26d1a4bfc8 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:31.473145 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44fe96-d4b0-43d4-b1f1-4e26d1a4bfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:31.490886 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ce44fe96-d4b0-43d4-b1f1-4e26d1a4bfc8 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:31.492085 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ce44fe96-d4b0-43d4-b1f1-4e26d1a4bfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:31.555891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 432/862] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:31.828422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2b2e4-37e9-467b-a803-e94c25b5d477 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:31.878194 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:31.929613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2b2e4-37e9-467b-a803-e94c25b5d477 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:31.962728 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac8b58-b23d-4bcf-b488-9ab95e051178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:31.963376 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac8b58-b23d-4bcf-b488-9ab95e051178 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:31.963658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac8b58-b23d-4bcf-b488-9ab95e051178 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:31.963931 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac8b58-b23d-4bcf-b488-9ab95e051178 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:31.965034 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac8b58-b23d-4bcf-b488-9ab95e051178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:31.967105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac8b58-b23d-4bcf-b488-9ab95e051178 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:31.968667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 431/863] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:24:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:31.974381 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44fe96-d4b0-43d4-b1f1-4e26d1a4bfc8 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:32.029515 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:32.069528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44fe96-d4b0-43d4-b1f1-4e26d1a4bfc8 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:32.102005 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec189f8-06e0-4657-9fca-f9acc7fa221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:32.102536 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec189f8-06e0-4657-9fca-f9acc7fa221c None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:32.102810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec189f8-06e0-4657-9fca-f9acc7fa221c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:32.103109 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec189f8-06e0-4657-9fca-f9acc7fa221c None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:32.103742 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec189f8-06e0-4657-9fca-f9acc7fa221c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:32.105135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec189f8-06e0-4657-9fca-f9acc7fa221c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:32.125369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 433/864] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:24:31 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:24:34.288045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d21e1-a170-45f2-a9c0-d470686a4c90 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:34.288831 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d21e1-a170-45f2-a9c0-d470686a4c90 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:34.288831 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d21e1-a170-45f2-a9c0-d470686a4c90 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:34.290161 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 432/865] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:34.295945 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e61e2-042e-4a3a-af3f-61412a8cf2c2 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:34.296371 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e61e2-042e-4a3a-af3f-61412a8cf2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:34.296472 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e61e2-042e-4a3a-af3f-61412a8cf2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:34.315165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-dd3e61e2-042e-4a3a-af3f-61412a8cf2c2 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:34.316339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-dd3e61e2-042e-4a3a-af3f-61412a8cf2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:34.379524 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 434/866] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:34.649525 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d21e1-a170-45f2-a9c0-d470686a4c90 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:34.749011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d21e1-a170-45f2-a9c0-d470686a4c90 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:34.765780 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:34.783234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a957c51-4440-4386-af76-5886b68b383c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:34.783858 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a957c51-4440-4386-af76-5886b68b383c None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:34.784141 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a957c51-4440-4386-af76-5886b68b383c None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:34.784419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a957c51-4440-4386-af76-5886b68b383c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:34.795151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a957c51-4440-4386-af76-5886b68b383c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:24:34.799906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-8a957c51-4440-4386-af76-5886b68b383c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:24:34.799906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:34.799906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:34.799906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:34.799906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:34.799906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:34.799906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:34.799906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:34.799906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:34.799906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:34.799906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:34.799906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:34.799906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:24:34.799906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:24:34.799906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:24:34.799906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:24:34.801074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:24:34.801074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:24:34.801074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:24:34.801074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:24:34.801074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:34.801074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:34.801074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:34.801074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:34.801074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:34.801074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:34.801074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:34.801074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:34.801074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:34.801074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:34.801074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:34.801074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:34.802148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:34.802148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:34.802148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:34.802148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:34.802148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:24:34.802148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:24:34.802148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:24:34.802148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:24:34.802148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:24:34.802148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:24:34.802148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:24:34.802148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:34.802148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 433/867] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:24:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:34.807119 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e61e2-042e-4a3a-af3f-61412a8cf2c2 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:34.852042 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:34.906583 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e61e2-042e-4a3a-af3f-61412a8cf2c2 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:34.939640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53603a-c8f2-426a-85a9-1649786bc9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:34.940240 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53603a-c8f2-426a-85a9-1649786bc9dd None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:34.940518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53603a-c8f2-426a-85a9-1649786bc9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:34.940790 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53603a-c8f2-426a-85a9-1649786bc9dd None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:34.941438 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53603a-c8f2-426a-85a9-1649786bc9dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:34.941753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53603a-c8f2-426a-85a9-1649786bc9dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:34.943115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53603a-c8f2-426a-85a9-1649786bc9dd None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:34.951703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 435/868] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:24:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:34.957498 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a957c51-4440-4386-af76-5886b68b383c None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:35.055209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a957c51-4440-4386-af76-5886b68b383c None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:35.088663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70a9de-ad5d-4c58-b574-f80b749292cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:35.089278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70a9de-ad5d-4c58-b574-f80b749292cb None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:35.089558 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70a9de-ad5d-4c58-b574-f80b749292cb None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:35.089832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70a9de-ad5d-4c58-b574-f80b749292cb None admin] PATH_INFO: `/v3/users/92df90a1e2224968b179955d9610542a` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:35.103057 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70a9de-ad5d-4c58-b574-f80b749292cb None admin] RBAC: Authorizing `identity:get_user(user_id=92df90a1e2224968b179955d9610542a)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:35.104498 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70a9de-ad5d-4c58-b574-f80b749292cb None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:35.106068 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 434/869] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:24:34 2022] GET /identity/v3/users/92df90a1e2224968b179955d9610542a => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:35.111828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53603a-c8f2-426a-85a9-1649786bc9dd None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:35.207778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53603a-c8f2-426a-85a9-1649786bc9dd None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:35.214371 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:35.241632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117d3bc-36f4-4674-a1ff-d28eaca4f3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:35.242247 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117d3bc-36f4-4674-a1ff-d28eaca4f3de None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:35.242526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117d3bc-36f4-4674-a1ff-d28eaca4f3de None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:35.242801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117d3bc-36f4-4674-a1ff-d28eaca4f3de None admin] PATH_INFO: `/v3/projects/72ed955ea2834a7bad705aed3f4ef11d` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:35.243928 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117d3bc-36f4-4674-a1ff-d28eaca4f3de None admin] RBAC: Authorizing `identity:get_project(project_id=72ed955ea2834a7bad705aed3f4ef11d)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:35.245341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117d3bc-36f4-4674-a1ff-d28eaca4f3de None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:35.246958 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 436/870] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:24:35 2022] GET /identity/v3/projects/72ed955ea2834a7bad705aed3f4ef11d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:35.253342 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70a9de-ad5d-4c58-b574-f80b749292cb None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:35.287628 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:35.350995 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70a9de-ad5d-4c58-b574-f80b749292cb None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:35.383520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3981aa7-5e51-41b9-9e5e-5fe6cb8facc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:35.384157 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3981aa7-5e51-41b9-9e5e-5fe6cb8facc3 None admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:35.384432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3981aa7-5e51-41b9-9e5e-5fe6cb8facc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:35.384701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3981aa7-5e51-41b9-9e5e-5fe6cb8facc3 None admin] PATH_INFO: `/v3/projects/72ed955ea2834a7bad705aed3f4ef11d/users/92df90a1e2224968b179955d9610542a/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:35.386535 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3981aa7-5e51-41b9-9e5e-5fe6cb8facc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=72ed955ea2834a7bad705aed3f4ef11d, user_id=92df90a1e2224968b179955d9610542a, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:35.388538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3981aa7-5e51-41b9-9e5e-5fe6cb8facc3 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:35.400222 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 435/871] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:24:35 2022] PUT /identity/v3/projects/72ed955ea2834a7bad705aed3f4ef11d/users/92df90a1e2224968b179955d9610542a/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:24:37.511574 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bd32a-c3ec-4613-98ad-d44e868fcc1a None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:37.512095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bd32a-c3ec-4613-98ad-d44e868fcc1a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:37.512208 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bd32a-c3ec-4613-98ad-d44e868fcc1a None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:37.514071 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 437/872] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:37.519722 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27317d49-6ffe-4e12-84d8-bbd345b90f58 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:37.520243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27317d49-6ffe-4e12-84d8-bbd345b90f58 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:37.520339 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27317d49-6ffe-4e12-84d8-bbd345b90f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:37.538064 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-27317d49-6ffe-4e12-84d8-bbd345b90f58 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:37.539543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-27317d49-6ffe-4e12-84d8-bbd345b90f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:37.603861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 436/873] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:37.869719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bd32a-c3ec-4613-98ad-d44e868fcc1a None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:37.969430 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bd32a-c3ec-4613-98ad-d44e868fcc1a None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:38.001442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18877d2e-c0e2-409d-a814-ddb7d34838ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:38.002057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18877d2e-c0e2-409d-a814-ddb7d34838ab None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:38.002335 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18877d2e-c0e2-409d-a814-ddb7d34838ab None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:38.002610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18877d2e-c0e2-409d-a814-ddb7d34838ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:38.012225 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18877d2e-c0e2-409d-a814-ddb7d34838ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:24:38.017537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-18877d2e-c0e2-409d-a814-ddb7d34838ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:24:38.017537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:38.017537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:38.017537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:38.017537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:38.017537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:38.017537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:38.017537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:38.017537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:38.017537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:38.017537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:38.017537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:38.017537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:24:38.017537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:24:38.017537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:24:38.017537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:24:38.018643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:24:38.018643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:24:38.018643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:24:38.018643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:24:38.018643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:38.018643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:38.018643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:38.018643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:38.018643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:38.018643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:38.018643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:38.018643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:38.018643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:38.018643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:38.018643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:38.018643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:38.019706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:38.019706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:38.019706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:38.019706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:38.019706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:24:38.019706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:24:38.019706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:24:38.019706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:24:38.019706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:24:38.019706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:24:38.019706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:24:38.019706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:38.019706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 438/874] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:24:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:38.024653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27317d49-6ffe-4e12-84d8-bbd345b90f58 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:38.050897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:38.120571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27317d49-6ffe-4e12-84d8-bbd345b90f58 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:38.152800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35551bf5-5473-44aa-ac07-ce8dab7a0945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:38.153562 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35551bf5-5473-44aa-ac07-ce8dab7a0945 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:38.153845 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35551bf5-5473-44aa-ac07-ce8dab7a0945 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:38.154109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35551bf5-5473-44aa-ac07-ce8dab7a0945 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:38.154764 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35551bf5-5473-44aa-ac07-ce8dab7a0945 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:38.155089 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35551bf5-5473-44aa-ac07-ce8dab7a0945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:38.156434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35551bf5-5473-44aa-ac07-ce8dab7a0945 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:38.164330 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 437/875] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:38.170186 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18877d2e-c0e2-409d-a814-ddb7d34838ab None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:38.204917 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:38.269348 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18877d2e-c0e2-409d-a814-ddb7d34838ab None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:38.301955 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b82cf-06a7-4781-b4d4-ec84609faa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:38.302566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b82cf-06a7-4781-b4d4-ec84609faa51 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:38.302846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b82cf-06a7-4781-b4d4-ec84609faa51 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:38.303164 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b82cf-06a7-4781-b4d4-ec84609faa51 None admin] PATH_INFO: `/v3/users/92df90a1e2224968b179955d9610542a` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:38.304266 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b82cf-06a7-4781-b4d4-ec84609faa51 None admin] RBAC: Authorizing `identity:get_user(user_id=92df90a1e2224968b179955d9610542a)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:38.305683 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b82cf-06a7-4781-b4d4-ec84609faa51 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:38.307267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 439/876] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:24:38 2022] GET /identity/v3/users/92df90a1e2224968b179955d9610542a => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:38.313590 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35551bf5-5473-44aa-ac07-ce8dab7a0945 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:38.399807 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:38.411848 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35551bf5-5473-44aa-ac07-ce8dab7a0945 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:38.444773 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efd337-5e6c-45ed-9a8b-f11865b7b280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:38.445369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efd337-5e6c-45ed-9a8b-f11865b7b280 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:38.445652 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efd337-5e6c-45ed-9a8b-f11865b7b280 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:38.445926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efd337-5e6c-45ed-9a8b-f11865b7b280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:38.510571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efd337-5e6c-45ed-9a8b-f11865b7b280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:38.512028 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efd337-5e6c-45ed-9a8b-f11865b7b280 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:38.596206 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:38.609334 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 438/877] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:24:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 13:24:38.615425 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b82cf-06a7-4781-b4d4-ec84609faa51 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:38.711055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b82cf-06a7-4781-b4d4-ec84609faa51 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:38.712440 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:38.744076 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cbc39-f7e0-4d3b-872b-a97be05596f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:38.744683 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cbc39-f7e0-4d3b-872b-a97be05596f6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:38.744956 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cbc39-f7e0-4d3b-872b-a97be05596f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:38.745223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cbc39-f7e0-4d3b-872b-a97be05596f6 None admin] PATH_INFO: `/v3/projects/72ed955ea2834a7bad705aed3f4ef11d` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:38.746327 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459cbc39-f7e0-4d3b-872b-a97be05596f6 None admin] RBAC: Authorizing `identity:get_project(project_id=72ed955ea2834a7bad705aed3f4ef11d)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:38.748560 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459cbc39-f7e0-4d3b-872b-a97be05596f6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:38.750144 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 440/878] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:24:38 2022] GET /identity/v3/projects/72ed955ea2834a7bad705aed3f4ef11d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:38.756141 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efd337-5e6c-45ed-9a8b-f11865b7b280 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:38.853018 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efd337-5e6c-45ed-9a8b-f11865b7b280 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:38.888999 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe7ad3-c1f5-4e49-9dd8-c6c8a4be5a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:38.889594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe7ad3-c1f5-4e49-9dd8-c6c8a4be5a8c None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:38.889870 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe7ad3-c1f5-4e49-9dd8-c6c8a4be5a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:38.890141 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe7ad3-c1f5-4e49-9dd8-c6c8a4be5a8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:38.890853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe7ad3-c1f5-4e49-9dd8-c6c8a4be5a8c None admin] RBAC: Adding query filter params (role.id=9c0f227afc2e4a0aa404780de229488c, scope.project.id=72ed955ea2834a7bad705aed3f4ef11d, user.id=92df90a1e2224968b179955d9610542a) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:38.891187 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe7ad3-c1f5-4e49-9dd8-c6c8a4be5a8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:38.892600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe7ad3-c1f5-4e49-9dd8-c6c8a4be5a8c None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:38.898177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 439/879] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:24:38 2022] GET /identity/v3/role_assignments?user.id=92df90a1e2224968b179955d9610542a&scope.project.id=72ed955ea2834a7bad705aed3f4ef11d&role.id=9c0f227afc2e4a0aa404780de229488c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:41.012233 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79cd48-64bc-4790-8ba6-cb374a792f4f None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:41.012927 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79cd48-64bc-4790-8ba6-cb374a792f4f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:41.012927 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79cd48-64bc-4790-8ba6-cb374a792f4f None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:41.014260 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 441/880] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:41.019420 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90cc0d-a5b9-4f27-be44-c4720322eace None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:41.019851 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90cc0d-a5b9-4f27-be44-c4720322eace None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:41.019974 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90cc0d-a5b9-4f27-be44-c4720322eace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:41.037559 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-bb90cc0d-a5b9-4f27-be44-c4720322eace None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:41.039013 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-bb90cc0d-a5b9-4f27-be44-c4720322eace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:41.084598 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:41.103878 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 440/881] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:41.368985 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79cd48-64bc-4790-8ba6-cb374a792f4f None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:41.468683 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79cd48-64bc-4790-8ba6-cb374a792f4f None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:41.501247 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902df15-bac6-42d6-a7d2-f94e34c2d3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:41.501841 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902df15-bac6-42d6-a7d2-f94e34c2d3c5 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:41.502121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902df15-bac6-42d6-a7d2-f94e34c2d3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:41.502394 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902df15-bac6-42d6-a7d2-f94e34c2d3c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:41.503097 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902df15-bac6-42d6-a7d2-f94e34c2d3c5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:41.504440 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902df15-bac6-42d6-a7d2-f94e34c2d3c5 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:41.519677 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 442/882] 10.222.0.36 () {60 vars in 1138 bytes} [Thu Oct 20 13:24:41 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:24:43.667842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a3157-efc1-47df-9902-23364d168f99 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:43.668366 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a3157-efc1-47df-9902-23364d168f99 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:43.668366 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a3157-efc1-47df-9902-23364d168f99 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:43.669799 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 441/883] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:43.675490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29075200-4825-4cb3-9433-13b14b3b1b47 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:43.675910 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29075200-4825-4cb3-9433-13b14b3b1b47 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:43.676050 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29075200-4825-4cb3-9433-13b14b3b1b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:43.693990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-29075200-4825-4cb3-9433-13b14b3b1b47 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:43.695212 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-29075200-4825-4cb3-9433-13b14b3b1b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:43.718326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:43.761365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 443/884] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:44.030218 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a3157-efc1-47df-9902-23364d168f99 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:44.128708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a3157-efc1-47df-9902-23364d168f99 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:44.161939 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ae332-74f3-488a-bf6f-ab7883d50199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:44.162558 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ae332-74f3-488a-bf6f-ab7883d50199 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:44.162842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ae332-74f3-488a-bf6f-ab7883d50199 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:44.163142 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ae332-74f3-488a-bf6f-ab7883d50199 None admin] PATH_INFO: `/v3/domains/12bc27c4f6d4416688eb14e3e6848a08` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:44.173460 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ae332-74f3-488a-bf6f-ab7883d50199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=12bc27c4f6d4416688eb14e3e6848a08)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:44.174895 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ae332-74f3-488a-bf6f-ab7883d50199 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:44.176492 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 442/885] 10.222.0.36 () {56 vars in 1183 bytes} [Thu Oct 20 13:24:44 2022] GET /identity/v3/domains/12bc27c4f6d4416688eb14e3e6848a08 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:44.182345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29075200-4825-4cb3-9433-13b14b3b1b47 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:44.277575 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29075200-4825-4cb3-9433-13b14b3b1b47 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:44.310069 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb61ae-56b0-4aee-b031-e92ed331c815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:44.310601 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb61ae-56b0-4aee-b031-e92ed331c815 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:44.310875 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb61ae-56b0-4aee-b031-e92ed331c815 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:44.311180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb61ae-56b0-4aee-b031-e92ed331c815 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:44.311817 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb61ae-56b0-4aee-b031-e92ed331c815 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:44.313213 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb61ae-56b0-4aee-b031-e92ed331c815 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:44.339069 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 444/886] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Oct 20 13:24:44 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:24:46.490849 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f433ac-e6e6-47dc-8ecc-2f0c01ef490a None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:46.491445 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f433ac-e6e6-47dc-8ecc-2f0c01ef490a None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:46.491445 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f433ac-e6e6-47dc-8ecc-2f0c01ef490a None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:46.492779 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 443/887] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:46.497886 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b15069-f48c-4625-8df3-bc1a50c7f0b3 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:46.498287 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b15069-f48c-4625-8df3-bc1a50c7f0b3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:46.498427 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b15069-f48c-4625-8df3-bc1a50c7f0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:46.518583 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-49b15069-f48c-4625-8df3-bc1a50c7f0b3 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:46.520086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-49b15069-f48c-4625-8df3-bc1a50c7f0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:46.528949 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:46.588189 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 445/888] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:46.853324 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f433ac-e6e6-47dc-8ecc-2f0c01ef490a None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:46.899158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:46.955726 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f433ac-e6e6-47dc-8ecc-2f0c01ef490a None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:46.987799 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11c181-aa4d-4e89-a9d2-8f543b9797d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:46.988416 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11c181-aa4d-4e89-a9d2-8f543b9797d3 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:46.988691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11c181-aa4d-4e89-a9d2-8f543b9797d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:46.988961 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11c181-aa4d-4e89-a9d2-8f543b9797d3 None admin] PATH_INFO: `/v3/domains/12bc27c4f6d4416688eb14e3e6848a08` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:46.990046 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11c181-aa4d-4e89-a9d2-8f543b9797d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=12bc27c4f6d4416688eb14e3e6848a08)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:46.991499 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11c181-aa4d-4e89-a9d2-8f543b9797d3 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:46.993041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 444/889] 10.222.0.36 () {56 vars in 1183 bytes} [Thu Oct 20 13:24:46 2022] GET /identity/v3/domains/12bc27c4f6d4416688eb14e3e6848a08 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:46.999544 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b15069-f48c-4625-8df3-bc1a50c7f0b3 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:47.093316 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b15069-f48c-4625-8df3-bc1a50c7f0b3 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:47.125774 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbe901-e7ea-4ee6-88b8-69e69db75be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:47.126301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbe901-e7ea-4ee6-88b8-69e69db75be7 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:47.126579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbe901-e7ea-4ee6-88b8-69e69db75be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:47.126851 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbe901-e7ea-4ee6-88b8-69e69db75be7 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:47.127525 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdbe901-e7ea-4ee6-88b8-69e69db75be7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:47.128925 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdbe901-e7ea-4ee6-88b8-69e69db75be7 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:47.144645 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:47.150848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 446/890] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:24:46 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:24:49.306739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb02c6-0fab-44fe-a8f7-14de4cc098fe None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:49.307314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb02c6-0fab-44fe-a8f7-14de4cc098fe None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:49.307314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb02c6-0fab-44fe-a8f7-14de4cc098fe None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:49.308694 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 445/891] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:49.313899 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a6409-c533-4387-a7c6-db456a1ea196 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:49.314315 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a6409-c533-4387-a7c6-db456a1ea196 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:49.314440 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a6409-c533-4387-a7c6-db456a1ea196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:49.332716 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c61a6409-c533-4387-a7c6-db456a1ea196 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:49.333884 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c61a6409-c533-4387-a7c6-db456a1ea196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:49.397627 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 447/892] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:49.664433 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb02c6-0fab-44fe-a8f7-14de4cc098fe None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:49.763504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb02c6-0fab-44fe-a8f7-14de4cc098fe None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:49.773743 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:49.797516 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef93a4-9b10-4447-8c54-06aa16bf2850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:49.798128 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef93a4-9b10-4447-8c54-06aa16bf2850 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:49.798409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef93a4-9b10-4447-8c54-06aa16bf2850 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:49.798684 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef93a4-9b10-4447-8c54-06aa16bf2850 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:49.808501 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef93a4-9b10-4447-8c54-06aa16bf2850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:24:49.813838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-eaef93a4-9b10-4447-8c54-06aa16bf2850 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:24:49.813838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:49.813838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:49.813838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:49.813838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:49.813838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:49.813838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:49.813838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:49.813838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:49.813838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:49.813838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:49.813838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:49.813838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:24:49.813838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:24:49.813838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:24:49.813838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:24:49.815007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:24:49.815007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:24:49.815007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:24:49.815007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:24:49.815007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:49.815007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:49.815007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:49.815007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:49.815007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:49.815007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:49.815007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:49.815007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:49.815007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:49.815007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:49.815007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:49.815007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:49.816271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:49.816271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:49.816271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:49.816271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:49.816271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:24:49.816271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:24:49.816271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:24:49.816271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:24:49.816271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:24:49.816271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:24:49.816271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:24:49.816271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:24:49.816271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 446/893] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:24:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:49.820863 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a6409-c533-4387-a7c6-db456a1ea196 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:49.916095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a6409-c533-4387-a7c6-db456a1ea196 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:49.941799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:49.949894 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bba2dc-4686-4254-a060-c69e71ccda72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:49.950486 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bba2dc-4686-4254-a060-c69e71ccda72 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:49.950760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bba2dc-4686-4254-a060-c69e71ccda72 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:49.951059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bba2dc-4686-4254-a060-c69e71ccda72 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:49.951709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bba2dc-4686-4254-a060-c69e71ccda72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:49.952023 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bba2dc-4686-4254-a060-c69e71ccda72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:49.953347 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bba2dc-4686-4254-a060-c69e71ccda72 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:49.961127 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 448/894] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:24:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:24:49.967143 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef93a4-9b10-4447-8c54-06aa16bf2850 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:50.065747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef93a4-9b10-4447-8c54-06aa16bf2850 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:50.097346 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0a6fb-2aaa-4ffb-9d2f-1fe6f9a3874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:50.097953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0a6fb-2aaa-4ffb-9d2f-1fe6f9a3874b None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:50.098229 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0a6fb-2aaa-4ffb-9d2f-1fe6f9a3874b None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:50.098496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0a6fb-2aaa-4ffb-9d2f-1fe6f9a3874b None admin] PATH_INFO: `/v3/users/6fa396f299ff49069b553d4e33acc332` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:50.111334 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0a6fb-2aaa-4ffb-9d2f-1fe6f9a3874b None admin] RBAC: Authorizing `identity:get_user(user_id=6fa396f299ff49069b553d4e33acc332)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:50.112749 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0a6fb-2aaa-4ffb-9d2f-1fe6f9a3874b None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:50.114303 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 447/895] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:24:49 2022] GET /identity/v3/users/6fa396f299ff49069b553d4e33acc332 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:50.120072 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bba2dc-4686-4254-a060-c69e71ccda72 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:50.216115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bba2dc-4686-4254-a060-c69e71ccda72 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:50.248191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf969d-da2c-4661-b356-3aff799c5564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:50.248795 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf969d-da2c-4661-b356-3aff799c5564 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:50.249068 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf969d-da2c-4661-b356-3aff799c5564 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:50.249331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf969d-da2c-4661-b356-3aff799c5564 None admin] PATH_INFO: `/v3/projects/4adc84aede414d068ee4031029597097` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:50.250415 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf969d-da2c-4661-b356-3aff799c5564 None admin] RBAC: Authorizing `identity:get_project(project_id=4adc84aede414d068ee4031029597097)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:50.251838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf969d-da2c-4661-b356-3aff799c5564 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:50.253419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 449/896] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:24:50 2022] GET /identity/v3/projects/4adc84aede414d068ee4031029597097 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:50.259192 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0a6fb-2aaa-4ffb-9d2f-1fe6f9a3874b None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:50.286513 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:50.355031 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0a6fb-2aaa-4ffb-9d2f-1fe6f9a3874b None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:50.387432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3f489-8b32-4377-bcb4-36034e5fe3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:50.388068 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3f489-8b32-4377-bcb4-36034e5fe3ee None admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:50.388343 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3f489-8b32-4377-bcb4-36034e5fe3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:50.388611 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3f489-8b32-4377-bcb4-36034e5fe3ee None admin] PATH_INFO: `/v3/projects/4adc84aede414d068ee4031029597097/users/6fa396f299ff49069b553d4e33acc332/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:50.390466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3f489-8b32-4377-bcb4-36034e5fe3ee None admin] RBAC: Authorizing `identity:create_grant(project_id=4adc84aede414d068ee4031029597097, user_id=6fa396f299ff49069b553d4e33acc332, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:50.391893 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3f489-8b32-4377-bcb4-36034e5fe3ee None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:50.405332 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 448/897] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:24:50 2022] PUT /identity/v3/projects/4adc84aede414d068ee4031029597097/users/6fa396f299ff49069b553d4e33acc332/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:24:52.516067 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b52c1f-6c90-47e5-9e44-610a39778a92 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:52.516619 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b52c1f-6c90-47e5-9e44-610a39778a92 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:52.516709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b52c1f-6c90-47e5-9e44-610a39778a92 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:52.518345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 450/898] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:24:52.523661 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148a731-e66e-4eab-b7f5-ad7fc5b7aa1f None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:52.524092 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148a731-e66e-4eab-b7f5-ad7fc5b7aa1f None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:52.524213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148a731-e66e-4eab-b7f5-ad7fc5b7aa1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:52.542715 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-8148a731-e66e-4eab-b7f5-ad7fc5b7aa1f None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:24:52.544572 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8148a731-e66e-4eab-b7f5-ad7fc5b7aa1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:24:52.609227 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 449/899] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:24:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:24:52.876157 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b52c1f-6c90-47e5-9e44-610a39778a92 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:52.936013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:52.976947 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b52c1f-6c90-47e5-9e44-610a39778a92 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:53.010430 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b01b6-8a72-419d-854e-8cb94ae86205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:53.011072 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b01b6-8a72-419d-854e-8cb94ae86205 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:53.011353 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b01b6-8a72-419d-854e-8cb94ae86205 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:53.011625 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b01b6-8a72-419d-854e-8cb94ae86205 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:53.021690 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b01b6-8a72-419d-854e-8cb94ae86205 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:24:53.026429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-f65b01b6-8a72-419d-854e-8cb94ae86205 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:24:53.026429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:24:53.026429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:24:53.026429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:24:53.026429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:24:53.026429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:24:53.026429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:24:53.026429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:24:53.026429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:24:53.026429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:24:53.026429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:24:53.026429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:24:53.026429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:24:53.026429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:24:53.026429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:24:53.026429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:24:53.027591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:24:53.027591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:24:53.027591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:24:53.027591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:24:53.027591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:24:53.027591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:24:53.027591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:24:53.027591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:24:53.027591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:24:53.027591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:24:53.027591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:24:53.027591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:24:53.027591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:24:53.027591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:24:53.027591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:24:53.027591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:24:53.028442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:24:53.028442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:24:53.028442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:24:53.028442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:24:53.028442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:24:53.028442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:24:53.028442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:24:53.028442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:24:53.028442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:24:53.028442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:24:53.028442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:24:53.028442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:24:53.028442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 451/900] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:24:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:24:53.033816 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148a731-e66e-4eab-b7f5-ad7fc5b7aa1f None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:53.052345 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:53.131901 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148a731-e66e-4eab-b7f5-ad7fc5b7aa1f None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:53.165246 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d32df0-7601-4b5e-8b24-28d88e5b8b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:53.165843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d32df0-7601-4b5e-8b24-28d88e5b8b12 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:53.166124 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d32df0-7601-4b5e-8b24-28d88e5b8b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:53.166400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d32df0-7601-4b5e-8b24-28d88e5b8b12 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:53.167086 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d32df0-7601-4b5e-8b24-28d88e5b8b12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:53.167395 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d32df0-7601-4b5e-8b24-28d88e5b8b12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:53.169378 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d32df0-7601-4b5e-8b24-28d88e5b8b12 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:53.177182 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 450/901] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:24:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:53.183015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b01b6-8a72-419d-854e-8cb94ae86205 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:53.280829 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b01b6-8a72-419d-854e-8cb94ae86205 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:53.297945 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:53.315090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194990c-a65b-430d-b89e-0017003d649f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:53.315697 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194990c-a65b-430d-b89e-0017003d649f None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:53.315973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194990c-a65b-430d-b89e-0017003d649f None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:53.316243 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194990c-a65b-430d-b89e-0017003d649f None admin] PATH_INFO: `/v3/users/6fa396f299ff49069b553d4e33acc332` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:53.317341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194990c-a65b-430d-b89e-0017003d649f None admin] RBAC: Authorizing `identity:get_user(user_id=6fa396f299ff49069b553d4e33acc332)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:53.318757 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194990c-a65b-430d-b89e-0017003d649f None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:53.320342 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 452/902] 10.222.0.36 () {56 vars in 1177 bytes} [Thu Oct 20 13:24:53 2022] GET /identity/v3/users/6fa396f299ff49069b553d4e33acc332 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:53.326839 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d32df0-7601-4b5e-8b24-28d88e5b8b12 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:53.404983 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:53.424471 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d32df0-7601-4b5e-8b24-28d88e5b8b12 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:53.458737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69855fba-a5d8-42d8-823f-f3ae19dd74c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:53.459366 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69855fba-a5d8-42d8-823f-f3ae19dd74c1 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:53.459650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69855fba-a5d8-42d8-823f-f3ae19dd74c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:53.459923 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69855fba-a5d8-42d8-823f-f3ae19dd74c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:53.525017 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69855fba-a5d8-42d8-823f-f3ae19dd74c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:53.526442 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69855fba-a5d8-42d8-823f-f3ae19dd74c1 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:53.603284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:24:53.622365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 451/903] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:24:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 13:24:53.628178 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194990c-a65b-430d-b89e-0017003d649f None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:53.725089 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194990c-a65b-430d-b89e-0017003d649f None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:53.756781 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9252672a-1636-4236-a11e-0a3d5c70f505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:53.757391 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252672a-1636-4236-a11e-0a3d5c70f505 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:53.757669 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252672a-1636-4236-a11e-0a3d5c70f505 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:53.757940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9252672a-1636-4236-a11e-0a3d5c70f505 None admin] PATH_INFO: `/v3/projects/4adc84aede414d068ee4031029597097` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:53.759058 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252672a-1636-4236-a11e-0a3d5c70f505 None admin] RBAC: Authorizing `identity:get_project(project_id=4adc84aede414d068ee4031029597097)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:53.760468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9252672a-1636-4236-a11e-0a3d5c70f505 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:53.762839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 453/904] 10.222.0.36 () {56 vars in 1186 bytes} [Thu Oct 20 13:24:53 2022] GET /identity/v3/projects/4adc84aede414d068ee4031029597097 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:24:53.768832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69855fba-a5d8-42d8-823f-f3ae19dd74c1 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:24:53.864577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69855fba-a5d8-42d8-823f-f3ae19dd74c1 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:24:53.897744 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21d404-b12c-4134-a4cf-c2641fab6b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:24:53.898339 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21d404-b12c-4134-a4cf-c2641fab6b61 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:24:53.898613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21d404-b12c-4134-a4cf-c2641fab6b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:24:53.898881 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21d404-b12c-4134-a4cf-c2641fab6b61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:24:53.899619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21d404-b12c-4134-a4cf-c2641fab6b61 None admin] RBAC: Adding query filter params (role.id=9c0f227afc2e4a0aa404780de229488c, scope.project.id=4adc84aede414d068ee4031029597097, user.id=6fa396f299ff49069b553d4e33acc332) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:24:53.899922 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21d404-b12c-4134-a4cf-c2641fab6b61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:24:53.901358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21d404-b12c-4134-a4cf-c2641fab6b61 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:24:53.907852 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 452/905] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:24:53 2022] GET /identity/v3/role_assignments?user.id=6fa396f299ff49069b553d4e33acc332&scope.project.id=4adc84aede414d068ee4031029597097&role.id=9c0f227afc2e4a0aa404780de229488c => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:25:03.752823 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=73 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:03.905240 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=78 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:49.582231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e56b4e-c084-4cfa-99f7-df455f1444c4 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:49.582231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e56b4e-c084-4cfa-99f7-df455f1444c4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:49.582923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e56b4e-c084-4cfa-99f7-df455f1444c4 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:49.583824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 454/906] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:25:49.590347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0a46a-bc1e-4358-ae9e-a6daa02830c9 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:49.590905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0a46a-bc1e-4358-ae9e-a6daa02830c9 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:49.591133 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0a46a-bc1e-4358-ae9e-a6daa02830c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:49.612029 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-86b0a46a-bc1e-4358-ae9e-a6daa02830c9 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:25:49.613253 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-86b0a46a-bc1e-4358-ae9e-a6daa02830c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:25:49.703588 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 453/907] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:25:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:25:49.992756 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e56b4e-c084-4cfa-99f7-df455f1444c4 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:50.127398 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e56b4e-c084-4cfa-99f7-df455f1444c4 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:50.171212 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9d0a1-593c-4260-a6e3-58a86e07bdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:50.171844 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9d0a1-593c-4260-a6e3-58a86e07bdc8 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:50.172120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9d0a1-593c-4260-a6e3-58a86e07bdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:50.174990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9d0a1-593c-4260-a6e3-58a86e07bdc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:50.185617 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9d0a1-593c-4260-a6e3-58a86e07bdc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:50.187242 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9d0a1-593c-4260-a6e3-58a86e07bdc8 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:50.203103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-00e9d0a1-593c-4260-a6e3-58a86e07bdc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:25:50.203103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:25:50.203103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:25:50.203103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:25:50.203103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:25:50.203103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:25:50.203103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:25:50.203103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:25:50.203103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:25:50.203103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:25:50.203103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:25:50.203103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:25:50.203103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:25:50.203103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:25:50.203103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:25:50.203103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:25:50.207198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:25:50.207198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:25:50.207198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:25:50.207198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:25:50.207198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:25:50.207198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:25:50.207198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:25:50.207198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:25:50.207198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:25:50.207198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:25:50.207198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:25:50.207198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:25:50.207198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:25:50.207198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:25:50.207198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:25:50.207198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:25:50.207198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:25:50.208456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:25:50.208456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:25:50.208456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:25:50.208456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 455/908] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:25:50.210544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0a46a-bc1e-4358-ae9e-a6daa02830c9 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:50.344014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0a46a-bc1e-4358-ae9e-a6daa02830c9 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:50.381050 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:50.388681 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5e2aa-de77-4fd9-93d2-44660c2b42da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:50.389500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5e2aa-de77-4fd9-93d2-44660c2b42da None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:50.389808 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5e2aa-de77-4fd9-93d2-44660c2b42da None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:50.390191 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5e2aa-de77-4fd9-93d2-44660c2b42da None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:50.391018 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5e2aa-de77-4fd9-93d2-44660c2b42da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:25:50.391359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5e2aa-de77-4fd9-93d2-44660c2b42da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:50.393275 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5e2aa-de77-4fd9-93d2-44660c2b42da None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:50.411149 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 454/909] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:25:50.418033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9d0a1-593c-4260-a6e3-58a86e07bdc8 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:50.484880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:50.537580 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9d0a1-593c-4260-a6e3-58a86e07bdc8 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:50.582997 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4674ae-7ae1-4d57-bf2d-847035a97406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:50.582997 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4674ae-7ae1-4d57-bf2d-847035a97406 None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:50.582997 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4674ae-7ae1-4d57-bf2d-847035a97406 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:50.582997 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4674ae-7ae1-4d57-bf2d-847035a97406 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:50.583978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4674ae-7ae1-4d57-bf2d-847035a97406 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:50.584557 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4674ae-7ae1-4d57-bf2d-847035a97406 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:50.610974 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 456/910] 10.222.0.36 () {60 vars in 1132 bytes} [Thu Oct 20 13:25:50 2022] POST /identity/v3/users => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:25:52.838788 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fcd28-d69d-415b-9953-25523f792974 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:52.839393 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fcd28-d69d-415b-9953-25523f792974 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:52.839393 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779fcd28-d69d-415b-9953-25523f792974 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:52.840735 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 455/911] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:25:52.846010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b2f8f-115a-4e65-a197-a4b556a8e756 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:52.846507 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b2f8f-115a-4e65-a197-a4b556a8e756 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:52.846620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b2f8f-115a-4e65-a197-a4b556a8e756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:52.865910 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-1c3b2f8f-115a-4e65-a197-a4b556a8e756 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:25:52.870050 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1c3b2f8f-115a-4e65-a197-a4b556a8e756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:25:52.948104 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 457/912] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:25:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:25:53.221210 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fcd28-d69d-415b-9953-25523f792974 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:53.352148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779fcd28-d69d-415b-9953-25523f792974 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:53.390887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1147e44-e3a4-4420-81bc-ba7ca08e55f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:53.391613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1147e44-e3a4-4420-81bc-ba7ca08e55f7 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:53.391898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1147e44-e3a4-4420-81bc-ba7ca08e55f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:53.392160 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1147e44-e3a4-4420-81bc-ba7ca08e55f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:53.403717 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1147e44-e3a4-4420-81bc-ba7ca08e55f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:25:53.408627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-e1147e44-e3a4-4420-81bc-ba7ca08e55f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:25:53.408627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:25:53.408627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:25:53.408627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:25:53.408627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:25:53.408627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:25:53.408627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:25:53.408627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:25:53.408627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:25:53.408627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:25:53.408627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:25:53.408627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:25:53.408627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:25:53.408627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:25:53.408627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:25:53.408627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:25:53.409615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:25:53.409615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:25:53.409615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:25:53.409615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:25:53.409615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:25:53.409615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:25:53.409615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:25:53.409615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:25:53.409615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:25:53.409615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:25:53.409615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:25:53.409615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:25:53.409615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:25:53.409615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:25:53.409615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:25:53.409615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:25:53.410519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:25:53.410519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:25:53.410519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:25:53.410519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:25:53.410519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:25:53.410519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:25:53.410519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:25:53.410519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:25:53.410519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:25:53.410519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:25:53.410519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:25:53.410519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:25:53.410519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 456/913] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Oct 20 13:25:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:25:53.416760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b2f8f-115a-4e65-a197-a4b556a8e756 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:53.462366 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:53.531473 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b2f8f-115a-4e65-a197-a4b556a8e756 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:53.575431 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b051a-0f47-42a1-bec3-d05ddb6f0ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:53.576464 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b051a-0f47-42a1-bec3-d05ddb6f0ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:53.576989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b051a-0f47-42a1-bec3-d05ddb6f0ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:53.577502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3b051a-0f47-42a1-bec3-d05ddb6f0ca3 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:53.578491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b051a-0f47-42a1-bec3-d05ddb6f0ca3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:25:53.578989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b051a-0f47-42a1-bec3-d05ddb6f0ca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:53.581368 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3b051a-0f47-42a1-bec3-d05ddb6f0ca3 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:53.591263 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 458/914] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Oct 20 13:25:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:25:53.597203 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1147e44-e3a4-4420-81bc-ba7ca08e55f7 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:53.660727 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:53.722002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1147e44-e3a4-4420-81bc-ba7ca08e55f7 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:53.764842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9340273-3c32-49b9-974c-b240c512403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:53.765478 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9340273-3c32-49b9-974c-b240c512403c None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:53.765750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9340273-3c32-49b9-974c-b240c512403c None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:53.766021 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9340273-3c32-49b9-974c-b240c512403c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:53.776776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9340273-3c32-49b9-974c-b240c512403c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:53.778350 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9340273-3c32-49b9-974c-b240c512403c None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:53.796186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-a9340273-3c32-49b9-974c-b240c512403c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:25:53.796186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:25:53.796186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:25:53.796186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:25:53.796186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:25:53.796186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:25:53.796186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:25:53.796186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:25:53.796186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:25:53.796186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:25:53.796186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:25:53.796186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:25:53.796186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:25:53.796186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:25:53.796186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:25:53.796186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:25:53.797469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:25:53.797469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:25:53.797469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:25:53.797469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:25:53.797469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:25:53.797469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:25:53.797469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:25:53.797469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:25:53.797469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:25:53.797469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:25:53.797469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:25:53.797469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:25:53.797469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:25:53.797469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:25:53.797469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:25:53.797469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:25:53.797469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:25:53.798494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:25:53.798494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:25:53.798494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:25:53.798494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 457/915] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:25:53.803053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b051a-0f47-42a1-bec3-d05ddb6f0ca3 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:53.924888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:53.929576 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3b051a-0f47-42a1-bec3-d05ddb6f0ca3 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:53.972528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6c288-73dd-4f38-b805-d1cccc594827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:53.973291 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6c288-73dd-4f38-b805-d1cccc594827 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:53.973553 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6c288-73dd-4f38-b805-d1cccc594827 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:53.973851 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6c288-73dd-4f38-b805-d1cccc594827 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:53.974624 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6c288-73dd-4f38-b805-d1cccc594827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:25:53.975037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6c288-73dd-4f38-b805-d1cccc594827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:53.977139 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6c288-73dd-4f38-b805-d1cccc594827 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:53.990841 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 459/916] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:25:53.996441 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9340273-3c32-49b9-974c-b240c512403c None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:54.111062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9340273-3c32-49b9-974c-b240c512403c None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:54.112799 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:54.147915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856ce50-e1dc-4de2-8189-8eb5437dfd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:54.149460 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856ce50-e1dc-4de2-8189-8eb5437dfd65 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:54.149896 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856ce50-e1dc-4de2-8189-8eb5437dfd65 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:54.150241 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856ce50-e1dc-4de2-8189-8eb5437dfd65 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:54.158294 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856ce50-e1dc-4de2-8189-8eb5437dfd65 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:54.159972 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a856ce50-e1dc-4de2-8189-8eb5437dfd65 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:54.173115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-a856ce50-e1dc-4de2-8189-8eb5437dfd65 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 20 13:25:54.173115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:25:54.173115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:25:54.173115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:25:54.173115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:25:54.173115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:25:54.173115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:25:54.173115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:25:54.173115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:25:54.173115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:25:54.173115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:25:54.173115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:25:54.173115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:25:54.173115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:25:54.173115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:25:54.173115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:25:54.174359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:25:54.175600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:25:54.175600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:25:54.175600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:25:54.175600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:25:54.175600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:25:54.175600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:25:54.175600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:25:54.175600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:25:54.175600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 20 13:25:54.175600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:25:54.176747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 458/917] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:25:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:25:54.183644 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6c288-73dd-4f38-b805-d1cccc594827 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:54.298078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6c288-73dd-4f38-b805-d1cccc594827 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:54.338386 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f82fb-84cf-4301-bf7f-45208bc6eb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:54.339070 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f82fb-84cf-4301-bf7f-45208bc6eb86 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:54.339378 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f82fb-84cf-4301-bf7f-45208bc6eb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:54.339674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f82fb-84cf-4301-bf7f-45208bc6eb86 None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:54.340470 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f82fb-84cf-4301-bf7f-45208bc6eb86 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:25:54.340793 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f82fb-84cf-4301-bf7f-45208bc6eb86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:54.342399 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f82fb-84cf-4301-bf7f-45208bc6eb86 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:54.368441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 460/918] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Oct 20 13:25:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:25:54.369699 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856ce50-e1dc-4de2-8189-8eb5437dfd65 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:54.493249 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a856ce50-e1dc-4de2-8189-8eb5437dfd65 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:54.531300 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6c467-9f14-47c9-a3d3-935e3b51ac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:54.532022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c467-9f14-47c9-a3d3-935e3b51ac35 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:54.532550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c467-9f14-47c9-a3d3-935e3b51ac35 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:54.532847 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c467-9f14-47c9-a3d3-935e3b51ac35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:54.545622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6c467-9f14-47c9-a3d3-935e3b51ac35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:54.547342 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6c467-9f14-47c9-a3d3-935e3b51ac35 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:54.566701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-3fc6c467-9f14-47c9-a3d3-935e3b51ac35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:25:54.566701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:25:54.566701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:25:54.566701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:25:54.566701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:25:54.566701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:25:54.566701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:25:54.566701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:25:54.566701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:25:54.566701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:25:54.566701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:25:54.566701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:25:54.566701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:25:54.566701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:25:54.566701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:25:54.566701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:25:54.568033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:25:54.568033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:25:54.568033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:25:54.568033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:25:54.568033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:25:54.568033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:25:54.568033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:25:54.568033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:25:54.568033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:25:54.568033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:25:54.568033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:25:54.568033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:25:54.568033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:25:54.568033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:25:54.568033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:25:54.568033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:25:54.568033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:25:54.569105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:25:54.569105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:25:54.569105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:25:54.569862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 459/919] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:25:54.576078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f82fb-84cf-4301-bf7f-45208bc6eb86 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:54.596301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:54.688217 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f82fb-84cf-4301-bf7f-45208bc6eb86 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:54.723738 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730407f-0212-4697-aa2f-527bd0c931ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:54.724356 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730407f-0212-4697-aa2f-527bd0c931ab None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:54.724631 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730407f-0212-4697-aa2f-527bd0c931ab None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:54.724896 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730407f-0212-4697-aa2f-527bd0c931ab None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:54.725524 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730407f-0212-4697-aa2f-527bd0c931ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:25:54.725821 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730407f-0212-4697-aa2f-527bd0c931ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:54.727346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8730407f-0212-4697-aa2f-527bd0c931ab None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:54.739176 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 461/920] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:25:54.745466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6c467-9f14-47c9-a3d3-935e3b51ac35 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:54.764626 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:54.853657 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6c467-9f14-47c9-a3d3-935e3b51ac35 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:54.895962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e056e-9eb7-4d6a-8de4-77dddfa1b853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:54.896736 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e056e-9eb7-4d6a-8de4-77dddfa1b853 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:54.897105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e056e-9eb7-4d6a-8de4-77dddfa1b853 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:54.897446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e056e-9eb7-4d6a-8de4-77dddfa1b853 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:54.904831 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e056e-9eb7-4d6a-8de4-77dddfa1b853 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:54.906335 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e056e-9eb7-4d6a-8de4-77dddfa1b853 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:54.918873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-929e056e-9eb7-4d6a-8de4-77dddfa1b853 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:25:54.918873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:25:54.918873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:25:54.918873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:25:54.918873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:25:54.918873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:25:54.918873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:25:54.918873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:25:54.918873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:25:54.918873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:25:54.918873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:25:54.918873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:25:54.918873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:25:54.918873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:25:54.918873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:25:54.920005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:25:54.920005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:25:54.920005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:25:54.920005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:25:54.920005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:25:54.920005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:25:54.920005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:25:54.920005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:25:54.920005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:25:54.920005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:25:54.920005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:25:54.920005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:25:54.920005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:25:54.920005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:25:54.920005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:25:54.920005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:25:54.920005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:25:54.921169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:25:54.921169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:25:54.921169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:25:54.921169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:25:54.921169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:25:54.921169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:25:54.921169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:25:54.921169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:25:54.926867 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 460/921] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:25:54.927923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730407f-0212-4697-aa2f-527bd0c931ab None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:55.021152 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:55.046306 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730407f-0212-4697-aa2f-527bd0c931ab None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:55.090185 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5badb06d-1a90-4856-9652-f59282fbf38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:55.091075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badb06d-1a90-4856-9652-f59282fbf38c None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:55.091518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badb06d-1a90-4856-9652-f59282fbf38c None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:55.091922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5badb06d-1a90-4856-9652-f59282fbf38c None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:55.092742 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badb06d-1a90-4856-9652-f59282fbf38c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:25:55.093113 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badb06d-1a90-4856-9652-f59282fbf38c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:55.094785 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5badb06d-1a90-4856-9652-f59282fbf38c None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:55.110876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 462/922] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:25:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:25:55.117550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e056e-9eb7-4d6a-8de4-77dddfa1b853 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:55.199145 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:55.226841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e056e-9eb7-4d6a-8de4-77dddfa1b853 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:55.273020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a3bda-86cd-4329-9dc2-0a8753cc508f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:55.273991 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a3bda-86cd-4329-9dc2-0a8753cc508f None admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:55.274479 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a3bda-86cd-4329-9dc2-0a8753cc508f None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:55.274933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a3bda-86cd-4329-9dc2-0a8753cc508f None admin] PATH_INFO: `/v3/projects/c25f337a79704728adaa03f4103eef1c/users/a00f0b4cee8d49a48a95317aec9f647c/roles/09686a35c48b45b49ee384e08ee11206` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:55.294886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a3bda-86cd-4329-9dc2-0a8753cc508f None admin] RBAC: Authorizing `identity:create_grant(project_id=c25f337a79704728adaa03f4103eef1c, user_id=a00f0b4cee8d49a48a95317aec9f647c, role_id=09686a35c48b45b49ee384e08ee11206)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:55.299463 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a3bda-86cd-4329-9dc2-0a8753cc508f None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:55.319351 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 461/923] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:25:55 2022] PUT /identity/v3/projects/c25f337a79704728adaa03f4103eef1c/users/a00f0b4cee8d49a48a95317aec9f647c/roles/09686a35c48b45b49ee384e08ee11206 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:25:57.606390 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340acece-e0f6-4350-bbd7-bfed3ed16821 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:57.607020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340acece-e0f6-4350-bbd7-bfed3ed16821 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:57.607020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340acece-e0f6-4350-bbd7-bfed3ed16821 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:57.608224 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 463/924] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:25:57.613689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ac37e-afdd-4fa5-b361-f05ca13dde7e None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:57.614107 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ac37e-afdd-4fa5-b361-f05ca13dde7e None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:57.614240 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ac37e-afdd-4fa5-b361-f05ca13dde7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:57.631970 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-c42ac37e-afdd-4fa5-b361-f05ca13dde7e None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:25:57.633704 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-c42ac37e-afdd-4fa5-b361-f05ca13dde7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:25:57.706630 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 462/925] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:25:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:25:57.997934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340acece-e0f6-4350-bbd7-bfed3ed16821 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:58.113204 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340acece-e0f6-4350-bbd7-bfed3ed16821 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:58.149493 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a20b12-96e3-4909-bf75-e7d9ac8e188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:58.150057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a20b12-96e3-4909-bf75-e7d9ac8e188e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:58.150337 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a20b12-96e3-4909-bf75-e7d9ac8e188e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:58.150610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a20b12-96e3-4909-bf75-e7d9ac8e188e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:58.158587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:58.163538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a20b12-96e3-4909-bf75-e7d9ac8e188e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:25:58.169273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-96a20b12-96e3-4909-bf75-e7d9ac8e188e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:25:58.169273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:25:58.169273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:25:58.169273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:25:58.169273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:25:58.169273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:25:58.169273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:25:58.169273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:25:58.169273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:25:58.169273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:25:58.169273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:25:58.169273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:25:58.169273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:25:58.169273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:25:58.169273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:25:58.169273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:25:58.170416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:25:58.170416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:25:58.170416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:25:58.170416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:25:58.170416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:25:58.170416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:25:58.170416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:25:58.170416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:25:58.170416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:25:58.170416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:25:58.170416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:25:58.170416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:25:58.170416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:25:58.170416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:25:58.170416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:25:58.170416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:25:58.171932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:25:58.171932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:25:58.171932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:25:58.171932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:25:58.171932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:25:58.171932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:25:58.171932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:25:58.171932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:25:58.171932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:25:58.171932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:25:58.171932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 20 13:25:58.171932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:25:58.171932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 464/926] 10.222.0.36 () {56 vars in 1102 bytes} [Thu Oct 20 13:25:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:25:58.176874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ac37e-afdd-4fa5-b361-f05ca13dde7e None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:58.233941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:58.285292 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ac37e-afdd-4fa5-b361-f05ca13dde7e None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:58.328487 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e78e7-a6ac-4fe6-8386-dc1ba1765727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:58.329152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e78e7-a6ac-4fe6-8386-dc1ba1765727 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:58.329434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e78e7-a6ac-4fe6-8386-dc1ba1765727 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:58.329713 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e78e7-a6ac-4fe6-8386-dc1ba1765727 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:58.330488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e78e7-a6ac-4fe6-8386-dc1ba1765727 None admin] RBAC: Adding query filter params (name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:25:58.330802 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e78e7-a6ac-4fe6-8386-dc1ba1765727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:58.332421 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e78e7-a6ac-4fe6-8386-dc1ba1765727 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:58.342400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 463/927] 10.222.0.36 () {56 vars in 1103 bytes} [Thu Oct 20 13:25:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:25:58.348520 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a20b12-96e3-4909-bf75-e7d9ac8e188e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:58.465803 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a20b12-96e3-4909-bf75-e7d9ac8e188e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:58.504296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a489a50-4c25-45ed-9aa8-80f8680c1cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:58.504937 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a489a50-4c25-45ed-9aa8-80f8680c1cef None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:58.505198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a489a50-4c25-45ed-9aa8-80f8680c1cef None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:58.505465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a489a50-4c25-45ed-9aa8-80f8680c1cef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:58.516047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a489a50-4c25-45ed-9aa8-80f8680c1cef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:58.517477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a489a50-4c25-45ed-9aa8-80f8680c1cef None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:58.535084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-2a489a50-4c25-45ed-9aa8-80f8680c1cef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:25:58.535084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:25:58.535084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:25:58.535084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:25:58.535084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:25:58.535084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:25:58.535084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:25:58.535084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:25:58.535084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:25:58.535084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:25:58.535084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:25:58.535084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:25:58.535084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:25:58.535084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:25:58.535084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:25:58.535084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:25:58.536604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:25:58.536604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:25:58.536604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:25:58.536604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:25:58.536604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:25:58.536604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:25:58.536604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:25:58.536604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:25:58.536604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:25:58.536604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:25:58.536604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:25:58.536604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:25:58.536604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:25:58.536604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:25:58.536604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:25:58.536604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:25:58.536604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:25:58.537513 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:25:58.537513 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:25:58.537513 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:25:58.537513 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 465/928] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:25:58.543316 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e78e7-a6ac-4fe6-8386-dc1ba1765727 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:58.646161 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e78e7-a6ac-4fe6-8386-dc1ba1765727 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:58.663414 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:58.682724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd377d3-caaa-48c0-a63e-f033d4b5fb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:58.683363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd377d3-caaa-48c0-a63e-f033d4b5fb3a None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:58.683665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd377d3-caaa-48c0-a63e-f033d4b5fb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:58.683923 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd377d3-caaa-48c0-a63e-f033d4b5fb3a None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:58.684561 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd377d3-caaa-48c0-a63e-f033d4b5fb3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:25:58.684866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd377d3-caaa-48c0-a63e-f033d4b5fb3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:58.686227 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd377d3-caaa-48c0-a63e-f033d4b5fb3a None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:58.699320 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 464/929] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:25:58.705090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a489a50-4c25-45ed-9aa8-80f8680c1cef None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:58.762415 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:58.819185 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a489a50-4c25-45ed-9aa8-80f8680c1cef None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:58.856026 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe558b-8fbb-41fe-87d9-3c25677776d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:58.856702 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe558b-8fbb-41fe-87d9-3c25677776d9 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:58.856999 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe558b-8fbb-41fe-87d9-3c25677776d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:58.857294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe558b-8fbb-41fe-87d9-3c25677776d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:58.865825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe558b-8fbb-41fe-87d9-3c25677776d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:58.867584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe558b-8fbb-41fe-87d9-3c25677776d9 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:58.882215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-fcbe558b-8fbb-41fe-87d9-3c25677776d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 20 13:25:58.882215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:25:58.882215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:25:58.882215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:25:58.882215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:25:58.882215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:25:58.882215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:25:58.882215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:25:58.882215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:25:58.882215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:25:58.882215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:25:58.882215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:25:58.882215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:25:58.882215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:25:58.882215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:25:58.882215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:25:58.883862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:25:58.887105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:25:58.887105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:25:58.887105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:25:58.887105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:25:58.887105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:25:58.887105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:25:58.887105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:25:58.887105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:25:58.887105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 20 13:25:58.887105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:25:58.887105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 466/930] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:25:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:25:58.890793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd377d3-caaa-48c0-a63e-f033d4b5fb3a None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:58.996715 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd377d3-caaa-48c0-a63e-f033d4b5fb3a None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:59.032597 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474cd07-888b-471d-92cf-ac5051d0b586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:59.033755 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474cd07-888b-471d-92cf-ac5051d0b586 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:59.033755 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474cd07-888b-471d-92cf-ac5051d0b586 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:59.034026 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474cd07-888b-471d-92cf-ac5051d0b586 None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:59.034689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474cd07-888b-471d-92cf-ac5051d0b586 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:25:59.035020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474cd07-888b-471d-92cf-ac5051d0b586 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:59.036676 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474cd07-888b-471d-92cf-ac5051d0b586 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:59.054559 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 465/931] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Oct 20 13:25:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:25:59.060554 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe558b-8fbb-41fe-87d9-3c25677776d9 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:59.167917 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe558b-8fbb-41fe-87d9-3c25677776d9 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:59.178350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:59.203107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab111d-d75f-44ba-b464-1a4bd1f26228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:59.203742 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab111d-d75f-44ba-b464-1a4bd1f26228 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:59.204022 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab111d-d75f-44ba-b464-1a4bd1f26228 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:59.204297 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab111d-d75f-44ba-b464-1a4bd1f26228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:59.278763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab111d-d75f-44ba-b464-1a4bd1f26228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:59.280618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab111d-d75f-44ba-b464-1a4bd1f26228 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:59.387654 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 467/932] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:25:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 13:25:59.393733 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474cd07-888b-471d-92cf-ac5051d0b586 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:59.431905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:59.503861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474cd07-888b-471d-92cf-ac5051d0b586 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:59.546619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488606ac-12cf-4b18-b8b2-e7925bc4ce64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:59.547369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488606ac-12cf-4b18-b8b2-e7925bc4ce64 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:59.547758 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488606ac-12cf-4b18-b8b2-e7925bc4ce64 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:59.548034 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488606ac-12cf-4b18-b8b2-e7925bc4ce64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:59.561122 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488606ac-12cf-4b18-b8b2-e7925bc4ce64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:59.563026 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488606ac-12cf-4b18-b8b2-e7925bc4ce64 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:59.579488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-488606ac-12cf-4b18-b8b2-e7925bc4ce64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:25:59.579488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:25:59.579488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:25:59.579488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:25:59.579488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:25:59.579488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:25:59.579488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:25:59.579488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:25:59.579488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:25:59.579488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:25:59.579488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:25:59.579488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:25:59.579488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:25:59.579488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:25:59.579488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:25:59.579488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:25:59.580634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:25:59.580634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:25:59.580634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:25:59.580634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:25:59.580634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:25:59.580634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:25:59.580634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:25:59.580634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:25:59.580634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:25:59.580634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:25:59.580634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:25:59.580634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:25:59.580634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:25:59.580634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:25:59.580634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:25:59.580634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:25:59.580634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:25:59.581573 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:25:59.581573 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:25:59.581573 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:25:59.581573 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 466/933] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:25:59.587231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab111d-d75f-44ba-b464-1a4bd1f26228 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:59.598606 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:59.689338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab111d-d75f-44ba-b464-1a4bd1f26228 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:59.725222 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133e260-94b5-4f3a-a9e7-93c8367ccb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:59.725939 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133e260-94b5-4f3a-a9e7-93c8367ccb55 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:59.726783 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133e260-94b5-4f3a-a9e7-93c8367ccb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:59.727158 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133e260-94b5-4f3a-a9e7-93c8367ccb55 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:59.727804 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133e260-94b5-4f3a-a9e7-93c8367ccb55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:25:59.728187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133e260-94b5-4f3a-a9e7-93c8367ccb55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:59.729569 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133e260-94b5-4f3a-a9e7-93c8367ccb55 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:59.741597 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 468/934] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:25:59.748086 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488606ac-12cf-4b18-b8b2-e7925bc4ce64 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:25:59.843345 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:25:59.860879 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488606ac-12cf-4b18-b8b2-e7925bc4ce64 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:25:59.898689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bb219-6c09-49cd-a643-131bc6b5826c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:25:59.899587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bb219-6c09-49cd-a643-131bc6b5826c None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:25:59.899931 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bb219-6c09-49cd-a643-131bc6b5826c None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:25:59.900191 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bb219-6c09-49cd-a643-131bc6b5826c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:25:59.907685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bb219-6c09-49cd-a643-131bc6b5826c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:25:59.909169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bb219-6c09-49cd-a643-131bc6b5826c None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:25:59.921362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-8d5bb219-6c09-49cd-a643-131bc6b5826c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:25:59.921362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:25:59.921362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:25:59.921362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:25:59.921362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:25:59.921362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:25:59.921362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:25:59.921362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:25:59.921362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:25:59.921362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:25:59.921362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:25:59.921362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:25:59.921362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:25:59.921362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:25:59.921362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:25:59.922500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:25:59.922500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:25:59.922500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:25:59.922500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:25:59.922500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:25:59.922500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:25:59.922500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:25:59.922500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:25:59.922500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:25:59.922500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:25:59.922500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:25:59.922500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:25:59.922500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:25:59.922500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:25:59.922500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:25:59.922500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:25:59.922500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:25:59.923602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:25:59.923602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:25:59.923602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:25:59.923602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:25:59.923602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:25:59.923602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:25:59.923602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:25:59.923602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:25:59.923602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 467/935] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:25:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:25:59.929998 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133e260-94b5-4f3a-a9e7-93c8367ccb55 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:00.005088 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:00.041191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133e260-94b5-4f3a-a9e7-93c8367ccb55 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:00.076199 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3246fe-b043-4984-b7ae-55b2e13d1d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:00.076872 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3246fe-b043-4984-b7ae-55b2e13d1d81 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:00.077141 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3246fe-b043-4984-b7ae-55b2e13d1d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:00.077455 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3246fe-b043-4984-b7ae-55b2e13d1d81 None admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:00.078234 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3246fe-b043-4984-b7ae-55b2e13d1d81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:00.078541 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3246fe-b043-4984-b7ae-55b2e13d1d81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:00.080169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3246fe-b043-4984-b7ae-55b2e13d1d81 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:00.093748 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 469/936] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:25:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:26:00.099940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bb219-6c09-49cd-a643-131bc6b5826c None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:00.205893 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bb219-6c09-49cd-a643-131bc6b5826c None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:00.241537 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc951269-8b4e-4983-80e9-749af521cf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:00.242643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc951269-8b4e-4983-80e9-749af521cf31 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:00.242916 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc951269-8b4e-4983-80e9-749af521cf31 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:00.243213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc951269-8b4e-4983-80e9-749af521cf31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:00.243940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc951269-8b4e-4983-80e9-749af521cf31 None admin] RBAC: Adding query filter params (role.id=09686a35c48b45b49ee384e08ee11206, scope.project.id=c25f337a79704728adaa03f4103eef1c, user.id=a00f0b4cee8d49a48a95317aec9f647c) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:00.244242 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc951269-8b4e-4983-80e9-749af521cf31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:00.245892 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc951269-8b4e-4983-80e9-749af521cf31 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:00.253489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 468/937] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:26:00 2022] GET /identity/v3/role_assignments?user.id=a00f0b4cee8d49a48a95317aec9f647c&scope.project.id=c25f337a79704728adaa03f4103eef1c&role.id=09686a35c48b45b49ee384e08ee11206 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:26:02.504012 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6252d42-d210-4364-9aa8-10127d5400e2 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:02.504605 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6252d42-d210-4364-9aa8-10127d5400e2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:02.504605 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6252d42-d210-4364-9aa8-10127d5400e2 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:02.505909 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 470/938] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:26:02.511326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e3e3d-323f-4111-95fb-3b25bb04d206 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:02.511741 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e3e3d-323f-4111-95fb-3b25bb04d206 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:02.511897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e3e3d-323f-4111-95fb-3b25bb04d206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:02.532067 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-266e3e3d-323f-4111-95fb-3b25bb04d206 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:26:02.533843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-266e3e3d-323f-4111-95fb-3b25bb04d206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:26:02.538572 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:02.619163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 469/939] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:26:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:26:02.922081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6252d42-d210-4364-9aa8-10127d5400e2 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:03.035254 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6252d42-d210-4364-9aa8-10127d5400e2 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:03.070528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:03.077959 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a75afd-537a-4413-b94a-ebd22b5ebd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:03.078587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a75afd-537a-4413-b94a-ebd22b5ebd06 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:03.078939 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a75afd-537a-4413-b94a-ebd22b5ebd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:03.079241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a75afd-537a-4413-b94a-ebd22b5ebd06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:03.090775 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a75afd-537a-4413-b94a-ebd22b5ebd06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:26:03.095753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-c6a75afd-537a-4413-b94a-ebd22b5ebd06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:26:03.095753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:26:03.095753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:26:03.095753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:26:03.095753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:26:03.095753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:26:03.095753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:26:03.095753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:26:03.095753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:26:03.095753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:26:03.095753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:26:03.095753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:26:03.095753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:26:03.095753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:26:03.095753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:26:03.095753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:26:03.096694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:26:03.096694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:26:03.096694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:26:03.096694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:26:03.096694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:26:03.096694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:26:03.096694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:26:03.096694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:26:03.096694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:26:03.096694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:26:03.096694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:26:03.096694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:26:03.096694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:26:03.096694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:26:03.096694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:26:03.096694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:26:03.097517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:26:03.097517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:26:03.097517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:26:03.097517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:26:03.097517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:26:03.097517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:26:03.097517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:26:03.097517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:26:03.097517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:26:03.097517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:26:03.097517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:26:03.097517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:26:03.097517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 471/940] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:26:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:26:03.103270 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e3e3d-323f-4111-95fb-3b25bb04d206 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:03.216587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e3e3d-323f-4111-95fb-3b25bb04d206 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:03.251194 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5bd46-b999-4d6e-bffb-27d54569e011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:03.251801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5bd46-b999-4d6e-bffb-27d54569e011 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:03.252083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5bd46-b999-4d6e-bffb-27d54569e011 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:03.252358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5bd46-b999-4d6e-bffb-27d54569e011 None admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:03.253023 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5bd46-b999-4d6e-bffb-27d54569e011 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:03.253331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5bd46-b999-4d6e-bffb-27d54569e011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:03.254691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5bd46-b999-4d6e-bffb-27d54569e011 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:03.263172 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 470/941] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:26:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:26:03.269093 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a75afd-537a-4413-b94a-ebd22b5ebd06 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:03.377428 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a75afd-537a-4413-b94a-ebd22b5ebd06 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:03.417242 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973208a5-e343-4e9d-bdfb-76d289f31794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:03.417948 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973208a5-e343-4e9d-bdfb-76d289f31794 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:03.418228 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973208a5-e343-4e9d-bdfb-76d289f31794 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:03.418503 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973208a5-e343-4e9d-bdfb-76d289f31794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:03.430208 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973208a5-e343-4e9d-bdfb-76d289f31794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:03.431839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973208a5-e343-4e9d-bdfb-76d289f31794 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:03.448730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-973208a5-e343-4e9d-bdfb-76d289f31794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:26:03.448730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:26:03.448730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:26:03.448730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:26:03.448730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:26:03.448730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:26:03.448730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:26:03.448730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:26:03.448730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:26:03.448730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:26:03.448730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:26:03.448730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:26:03.448730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:26:03.448730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:26:03.448730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:26:03.448730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:26:03.449780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:26:03.449780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:26:03.449780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:26:03.449780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:26:03.449780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:26:03.449780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:26:03.449780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:26:03.449780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:26:03.449780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:26:03.449780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:26:03.449780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:26:03.449780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:26:03.449780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:26:03.449780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:26:03.449780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:26:03.449780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:26:03.449780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:26:03.450651 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:26:03.450651 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:26:03.450651 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:26:03.450651 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 472/942] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:26:03.456014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5bd46-b999-4d6e-bffb-27d54569e011 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:03.459203 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:03.569190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5bd46-b999-4d6e-bffb-27d54569e011 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:03.610678 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a9724-4875-4694-978a-26f39e700556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:03.611612 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a9724-4875-4694-978a-26f39e700556 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:03.611973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a9724-4875-4694-978a-26f39e700556 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:03.612351 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a9724-4875-4694-978a-26f39e700556 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:03.613271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a9724-4875-4694-978a-26f39e700556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:03.613589 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a9724-4875-4694-978a-26f39e700556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:03.615272 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a9724-4875-4694-978a-26f39e700556 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:03.631616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 471/943] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:26:03.638341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973208a5-e343-4e9d-bdfb-76d289f31794 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:03.689779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:03.753594 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973208a5-e343-4e9d-bdfb-76d289f31794 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:03.788899 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e024cb-0905-4c5e-b71f-9f2e6aaf1460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:03.789536 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e024cb-0905-4c5e-b71f-9f2e6aaf1460 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:03.789855 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e024cb-0905-4c5e-b71f-9f2e6aaf1460 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:03.790142 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e024cb-0905-4c5e-b71f-9f2e6aaf1460 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:03.798147 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e024cb-0905-4c5e-b71f-9f2e6aaf1460 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:03.799884 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e024cb-0905-4c5e-b71f-9f2e6aaf1460 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:03.812187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-b1e024cb-0905-4c5e-b71f-9f2e6aaf1460 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 20 13:26:03.812187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:26:03.812187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:26:03.812187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:26:03.812187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:26:03.812187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:26:03.812187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:26:03.812187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:26:03.812187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:26:03.812187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:26:03.812187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:26:03.812187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:26:03.812187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:26:03.812187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:26:03.812187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:26:03.812187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:26:03.813640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:26:03.814801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:26:03.814801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:26:03.814801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:26:03.814801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:26:03.814801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:26:03.814801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:26:03.814801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:26:03.814801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:26:03.814801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 20 13:26:03.814801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:26:03.814801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 473/944] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:26:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:26:03.819522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a9724-4875-4694-978a-26f39e700556 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:03.887682 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:03.934212 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a9724-4875-4694-978a-26f39e700556 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:03.972717 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64c41a-8784-46c1-89be-a0113bd4caba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:03.973357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c41a-8784-46c1-89be-a0113bd4caba None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:03.973598 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c41a-8784-46c1-89be-a0113bd4caba None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:03.973865 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c41a-8784-46c1-89be-a0113bd4caba None admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:03.974586 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64c41a-8784-46c1-89be-a0113bd4caba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:03.974894 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64c41a-8784-46c1-89be-a0113bd4caba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:03.977004 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64c41a-8784-46c1-89be-a0113bd4caba None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:03.994344 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 472/945] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Oct 20 13:26:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:26:04.000376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e024cb-0905-4c5e-b71f-9f2e6aaf1460 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:04.109685 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e024cb-0905-4c5e-b71f-9f2e6aaf1460 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:04.111209 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:04.150127 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa4101-978f-4c80-af64-a2036083c8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:04.150769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa4101-978f-4c80-af64-a2036083c8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:04.151084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa4101-978f-4c80-af64-a2036083c8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:04.151364 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa4101-978f-4c80-af64-a2036083c8d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:04.164291 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa4101-978f-4c80-af64-a2036083c8d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:04.165929 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa4101-978f-4c80-af64-a2036083c8d1 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:04.181968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-82fa4101-978f-4c80-af64-a2036083c8d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:26:04.181968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:26:04.181968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:26:04.181968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:26:04.181968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:26:04.181968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:26:04.181968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:26:04.181968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:26:04.181968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:26:04.181968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:26:04.181968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:26:04.181968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:26:04.181968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:26:04.181968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:26:04.181968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:26:04.181968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:26:04.183279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:26:04.183279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:26:04.183279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:26:04.183279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:26:04.183279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:26:04.183279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:26:04.183279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:26:04.183279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:26:04.183279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:26:04.183279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:26:04.183279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:26:04.183279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:26:04.183279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:26:04.183279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:26:04.183279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:26:04.183279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:26:04.183279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:26:04.184274 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:26:04.184274 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:26:04.184274 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:26:04.184274 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 474/946] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:26:04.189317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64c41a-8784-46c1-89be-a0113bd4caba None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:04.308838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64c41a-8784-46c1-89be-a0113bd4caba None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:04.334880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:04.352067 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89bdbe-070e-4bf5-a592-be0d3e84b672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:04.352744 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89bdbe-070e-4bf5-a592-be0d3e84b672 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:04.353122 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89bdbe-070e-4bf5-a592-be0d3e84b672 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:04.353491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89bdbe-070e-4bf5-a592-be0d3e84b672 None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:04.354227 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89bdbe-070e-4bf5-a592-be0d3e84b672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:04.354766 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89bdbe-070e-4bf5-a592-be0d3e84b672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:04.356171 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89bdbe-070e-4bf5-a592-be0d3e84b672 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:04.370354 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 473/947] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:26:04.376232 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa4101-978f-4c80-af64-a2036083c8d1 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:04.491796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa4101-978f-4c80-af64-a2036083c8d1 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:04.525767 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55db065-e49f-4f43-83a9-a48bd6f109e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:04.526394 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55db065-e49f-4f43-83a9-a48bd6f109e6 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:04.526672 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55db065-e49f-4f43-83a9-a48bd6f109e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:04.527043 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55db065-e49f-4f43-83a9-a48bd6f109e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:04.534895 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55db065-e49f-4f43-83a9-a48bd6f109e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:04.536678 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55db065-e49f-4f43-83a9-a48bd6f109e6 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:04.551621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-e55db065-e49f-4f43-83a9-a48bd6f109e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:26:04.551621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:26:04.551621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:26:04.551621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:26:04.551621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:26:04.551621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:26:04.551621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:26:04.551621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:26:04.551621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:26:04.551621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:26:04.551621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:26:04.551621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:26:04.551621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:26:04.551621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:26:04.551621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:26:04.552923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:26:04.552923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:26:04.552923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:26:04.552923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:26:04.552923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:26:04.552923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:26:04.552923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:26:04.552923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:26:04.552923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:26:04.552923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:26:04.552923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:26:04.552923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:26:04.552923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:26:04.552923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:26:04.552923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:26:04.552923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:26:04.552923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:26:04.554343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:26:04.554343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:26:04.554343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:26:04.554343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:26:04.554343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:26:04.554343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:26:04.554343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:26:04.554343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:26:04.554343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 475/948] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:26:04.559087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89bdbe-070e-4bf5-a592-be0d3e84b672 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:04.680315 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89bdbe-070e-4bf5-a592-be0d3e84b672 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:04.718678 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f886cc-55d2-4029-a43a-286fef89903f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:04.719321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f886cc-55d2-4029-a43a-286fef89903f None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:04.719602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f886cc-55d2-4029-a43a-286fef89903f None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:04.719874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f886cc-55d2-4029-a43a-286fef89903f None admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:04.720566 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f886cc-55d2-4029-a43a-286fef89903f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:04.720896 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f886cc-55d2-4029-a43a-286fef89903f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:04.722323 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f886cc-55d2-4029-a43a-286fef89903f None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:04.735953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 474/949] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:26:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:26:04.743346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55db065-e49f-4f43-83a9-a48bd6f109e6 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:04.760564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:04.848538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55db065-e49f-4f43-83a9-a48bd6f109e6 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:04.889366 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd6119-ef90-4478-bcf7-2204bc8a6a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:04.890061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd6119-ef90-4478-bcf7-2204bc8a6a05 None admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:04.890397 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd6119-ef90-4478-bcf7-2204bc8a6a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:04.890659 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd6119-ef90-4478-bcf7-2204bc8a6a05 None admin] PATH_INFO: `/v3/projects/c25f337a79704728adaa03f4103eef1c/users/a00f0b4cee8d49a48a95317aec9f647c/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:04.892918 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd6119-ef90-4478-bcf7-2204bc8a6a05 None admin] RBAC: Authorizing `identity:create_grant(project_id=c25f337a79704728adaa03f4103eef1c, user_id=a00f0b4cee8d49a48a95317aec9f647c, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:04.894562 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd6119-ef90-4478-bcf7-2204bc8a6a05 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:04.908768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 476/950] 10.222.0.36 () {58 vars in 1439 bytes} [Thu Oct 20 13:26:04 2022] PUT /identity/v3/projects/c25f337a79704728adaa03f4103eef1c/users/a00f0b4cee8d49a48a95317aec9f647c/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:26:07.259020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56dd99-b14a-415e-9ccc-39cd034068d0 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:07.259594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56dd99-b14a-415e-9ccc-39cd034068d0 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:07.259594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56dd99-b14a-415e-9ccc-39cd034068d0 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:07.260988 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 475/951] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:26:07.267227 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd20494-2bb5-47c8-a466-bad19553f32b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:07.267669 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd20494-2bb5-47c8-a466-bad19553f32b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:07.267774 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd20494-2bb5-47c8-a466-bad19553f32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:07.289964 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-dbd20494-2bb5-47c8-a466-bad19553f32b None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:26:07.291452 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-dbd20494-2bb5-47c8-a466-bad19553f32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:26:07.364021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 477/952] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:26:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:26:07.661795 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56dd99-b14a-415e-9ccc-39cd034068d0 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:07.715703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:07.779279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56dd99-b14a-415e-9ccc-39cd034068d0 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:07.818200 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba725a8-e346-40c5-946b-9913887ea23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:07.818863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba725a8-e346-40c5-946b-9913887ea23c None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:07.819169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba725a8-e346-40c5-946b-9913887ea23c None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:07.820171 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba725a8-e346-40c5-946b-9913887ea23c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:07.832556 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba725a8-e346-40c5-946b-9913887ea23c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 20 13:26:07.838121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-3ba725a8-e346-40c5-946b-9913887ea23c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:26:07.838121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:26:07.838121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:26:07.838121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:26:07.838121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:26:07.838121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:26:07.838121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:26:07.838121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:26:07.838121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:26:07.838121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:26:07.838121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:26:07.838121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:26:07.838121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 20 13:26:07.838121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 20 13:26:07.838121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 20 13:26:07.838121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 20 13:26:07.839287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 20 13:26:07.839287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 20 13:26:07.839287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 20 13:26:07.839287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 20 13:26:07.839287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:26:07.839287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:26:07.839287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:26:07.839287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:26:07.839287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:26:07.839287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:26:07.839287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:26:07.839287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:26:07.839287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:26:07.839287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:26:07.839287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:26:07.839287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:26:07.840248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:26:07.840248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:26:07.840248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:26:07.840248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:26:07.840248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 20 13:26:07.840248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 20 13:26:07.840248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 20 13:26:07.840248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 20 13:26:07.840248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 20 13:26:07.840248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 20 13:26:07.840248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 20 13:26:07.840248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:26:07.840248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 476/953] 10.222.0.36 () {56 vars in 1096 bytes} [Thu Oct 20 13:26:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:26:07.845832 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd20494-2bb5-47c8-a466-bad19553f32b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:07.849154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:07.956039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd20494-2bb5-47c8-a466-bad19553f32b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:07.993847 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128467-6da1-49ef-ad77-694c506f3de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:07.994519 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128467-6da1-49ef-ad77-694c506f3de4 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:07.994861 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128467-6da1-49ef-ad77-694c506f3de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:07.995194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2128467-6da1-49ef-ad77-694c506f3de4 None admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:07.995943 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2128467-6da1-49ef-ad77-694c506f3de4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:07.996292 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2128467-6da1-49ef-ad77-694c506f3de4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:07.997790 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2128467-6da1-49ef-ad77-694c506f3de4 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:08.006509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 478/954] 10.222.0.36 () {56 vars in 1099 bytes} [Thu Oct 20 13:26:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:26:08.013256 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba725a8-e346-40c5-946b-9913887ea23c None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:08.121181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:08.124999 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba725a8-e346-40c5-946b-9913887ea23c None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:08.166017 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9cb2a-fea1-4c31-b40f-032bb1a9386d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:08.166651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9cb2a-fea1-4c31-b40f-032bb1a9386d None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:08.166931 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9cb2a-fea1-4c31-b40f-032bb1a9386d None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:08.167229 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9cb2a-fea1-4c31-b40f-032bb1a9386d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:08.177897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9cb2a-fea1-4c31-b40f-032bb1a9386d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:08.180167 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9cb2a-fea1-4c31-b40f-032bb1a9386d None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:08.197903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-53a9cb2a-fea1-4c31-b40f-032bb1a9386d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:26:08.197903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:26:08.197903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:26:08.197903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:26:08.197903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:26:08.197903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:26:08.197903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:26:08.197903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:26:08.197903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:26:08.197903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:26:08.197903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:26:08.197903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:26:08.197903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:26:08.197903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:26:08.197903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:26:08.197903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:26:08.199313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:26:08.199313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:26:08.199313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:26:08.199313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:26:08.199313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:26:08.199313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:26:08.199313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:26:08.199313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:26:08.199313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:26:08.199313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:26:08.199313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:26:08.199313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:26:08.199313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:26:08.199313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:26:08.199313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:26:08.199313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:26:08.199313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:26:08.200686 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:26:08.200686 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:26:08.200686 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:26:08.200686 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 477/955] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 20 13:26:08.208006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128467-6da1-49ef-ad77-694c506f3de4 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:08.284661 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:08.324827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2128467-6da1-49ef-ad77-694c506f3de4 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:08.363087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa09267-0c5b-4a8a-bb79-3367007857e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:08.363792 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa09267-0c5b-4a8a-bb79-3367007857e2 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:08.364052 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa09267-0c5b-4a8a-bb79-3367007857e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:08.364376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa09267-0c5b-4a8a-bb79-3367007857e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:08.365057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa09267-0c5b-4a8a-bb79-3367007857e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:08.365365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa09267-0c5b-4a8a-bb79-3367007857e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:08.366803 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa09267-0c5b-4a8a-bb79-3367007857e2 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:08.379673 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 479/956] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:26:08.385913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9cb2a-fea1-4c31-b40f-032bb1a9386d None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:08.497935 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9cb2a-fea1-4c31-b40f-032bb1a9386d None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:08.536380 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d8ea0-0965-4d4e-817f-af7c7a338207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:08.537061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d8ea0-0965-4d4e-817f-af7c7a338207 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:08.537340 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d8ea0-0965-4d4e-817f-af7c7a338207 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:08.537639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d8ea0-0965-4d4e-817f-af7c7a338207 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:08.548117 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d8ea0-0965-4d4e-817f-af7c7a338207 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:08.549594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d8ea0-0965-4d4e-817f-af7c7a338207 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:08.563125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-b54d8ea0-0965-4d4e-817f-af7c7a338207 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 20 13:26:08.563125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:26:08.563125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:26:08.563125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:26:08.563125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:26:08.563125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:26:08.563125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:26:08.563125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:26:08.563125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:26:08.563125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:26:08.563125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:26:08.563125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:26:08.563125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 20 13:26:08.563125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 20 13:26:08.563125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 20 13:26:08.563125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:26:08.564312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:26:08.565428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:26:08.565428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:26:08.565428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 20 13:26:08.565428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 20 13:26:08.565428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 20 13:26:08.565428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 20 13:26:08.565428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 20 13:26:08.565428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 20 13:26:08.565428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 20 13:26:08.565428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:26:08.565428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 478/957] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:26:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:26:08.571223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa09267-0c5b-4a8a-bb79-3367007857e2 None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:08.679054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa09267-0c5b-4a8a-bb79-3367007857e2 None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:08.706630 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:08.716698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f161d9-5dc5-47f0-8301-31ebafdad2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:08.717313 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f161d9-5dc5-47f0-8301-31ebafdad2cb None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:08.717589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f161d9-5dc5-47f0-8301-31ebafdad2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:08.717851 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f161d9-5dc5-47f0-8301-31ebafdad2cb None admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:08.718581 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f161d9-5dc5-47f0-8301-31ebafdad2cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:08.718882 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f161d9-5dc5-47f0-8301-31ebafdad2cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:08.720344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f161d9-5dc5-47f0-8301-31ebafdad2cb None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:08.738989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 480/958] 10.222.0.36 () {56 vars in 1143 bytes} [Thu Oct 20 13:26:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:26:08.744899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d8ea0-0965-4d4e-817f-af7c7a338207 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:08.761750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:08.853465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d8ea0-0965-4d4e-817f-af7c7a338207 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:08.892608 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1d18a-ffb9-45fe-bd70-dc0543d215d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:08.893228 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1d18a-ffb9-45fe-bd70-dc0543d215d3 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:08.893507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1d18a-ffb9-45fe-bd70-dc0543d215d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:08.893778 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1d18a-ffb9-45fe-bd70-dc0543d215d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:08.964915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1d18a-ffb9-45fe-bd70-dc0543d215d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:08.966350 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1d18a-ffb9-45fe-bd70-dc0543d215d3 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:08.980423 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:09.067849 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 479/959] 10.222.0.36 () {58 vars in 1282 bytes} [Thu Oct 20 13:26:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 20 13:26:09.074500 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f161d9-5dc5-47f0-8301-31ebafdad2cb None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:09.181932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f161d9-5dc5-47f0-8301-31ebafdad2cb None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:09.215007 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7351088-271a-48ef-9894-146e973def8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:09.215628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7351088-271a-48ef-9894-146e973def8e None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:09.215901 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7351088-271a-48ef-9894-146e973def8e None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:09.216167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7351088-271a-48ef-9894-146e973def8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:09.225692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7351088-271a-48ef-9894-146e973def8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:09.227154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7351088-271a-48ef-9894-146e973def8e None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:09.241755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-d7351088-271a-48ef-9894-146e973def8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:26:09.241755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:26:09.241755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:26:09.241755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:26:09.241755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:26:09.241755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:26:09.241755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:26:09.241755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:26:09.241755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:26:09.241755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:26:09.241755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:26:09.241755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:26:09.241755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 20 13:26:09.241755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 20 13:26:09.241755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 20 13:26:09.241755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 20 13:26:09.242827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:26:09.242827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:26:09.242827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:26:09.242827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:26:09.242827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:26:09.242827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:26:09.242827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:26:09.242827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:26:09.242827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:26:09.242827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:26:09.242827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:26:09.242827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:26:09.242827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:26:09.242827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:26:09.242827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:26:09.242827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:26:09.242827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 20 13:26:09.243852 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 20 13:26:09.243852 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 20 13:26:09.243852 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:26:09.243852 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 481/960] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:26:09.248538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1d18a-ffb9-45fe-bd70-dc0543d215d3 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:09.343574 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1d18a-ffb9-45fe-bd70-dc0543d215d3 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:09.356593 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:09.378003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f97780-3e1c-4db3-8354-6edf495a92ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:09.378594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f97780-3e1c-4db3-8354-6edf495a92ce None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:09.378871 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f97780-3e1c-4db3-8354-6edf495a92ce None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:09.379165 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f97780-3e1c-4db3-8354-6edf495a92ce None admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:09.379792 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f97780-3e1c-4db3-8354-6edf495a92ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:09.380093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f97780-3e1c-4db3-8354-6edf495a92ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:09.381436 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f97780-3e1c-4db3-8354-6edf495a92ce None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:09.392252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 480/961] 10.222.0.36 () {56 vars in 1109 bytes} [Thu Oct 20 13:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:26:09.397979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7351088-271a-48ef-9894-146e973def8e None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:09.433206 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:09.495444 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7351088-271a-48ef-9894-146e973def8e None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:09.527479 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c66e5-4696-46e6-bcd2-3ab9612b1f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:09.528099 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c66e5-4696-46e6-bcd2-3ab9612b1f8b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:09.528378 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c66e5-4696-46e6-bcd2-3ab9612b1f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:09.528645 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c66e5-4696-46e6-bcd2-3ab9612b1f8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:09.536335 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c66e5-4696-46e6-bcd2-3ab9612b1f8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:09.538443 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c66e5-4696-46e6-bcd2-3ab9612b1f8b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:09.551410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application [None req-a90c66e5-4696-46e6-bcd2-3ab9612b1f8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:26:09.551410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:26:09.551410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:26:09.551410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:26:09.551410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:26:09.551410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:26:09.551410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:26:09.551410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:26:09.551410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:26:09.551410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:26:09.551410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:26:09.551410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:26:09.551410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 20 13:26:09.551410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 20 13:26:09.551410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 20 13:26:09.552441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 20 13:26:09.552441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:26:09.552441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:26:09.552441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:26:09.552441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:26:09.552441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:26:09.552441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:26:09.552441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:26:09.552441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application with Lock( Oct 20 13:26:09.552441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:26:09.552441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:26:09.552441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:26:09.552441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:26:09.552441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:26:09.552441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:26:09.552441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:26:09.552441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:26:09.553660 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 20 13:26:09.553660 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 20 13:26:09.553660 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 20 13:26:09.553660 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 20 13:26:09.553660 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 20 13:26:09.553660 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 20 13:26:09.553660 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 20 13:26:09.553660 dv-cinder-862136-1-smb devstack@keystone.service[81427]: ERROR keystone.server.flask.application Oct 20 13:26:09.553660 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 482/962] 10.222.0.36 () {56 vars in 1111 bytes} [Thu Oct 20 13:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:26:09.559954 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f97780-3e1c-4db3-8354-6edf495a92ce None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:09.659388 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f97780-3e1c-4db3-8354-6edf495a92ce None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:09.691775 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826b194-c628-4038-843f-e514a5917b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:09.692367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b194-c628-4038-843f-e514a5917b70 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:09.692644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b194-c628-4038-843f-e514a5917b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:09.692914 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826b194-c628-4038-843f-e514a5917b70 None admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:09.693588 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826b194-c628-4038-843f-e514a5917b70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:09.693892 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826b194-c628-4038-843f-e514a5917b70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:09.695916 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826b194-c628-4038-843f-e514a5917b70 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:09.707184 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 481/963] 10.222.0.36 () {56 vars in 1148 bytes} [Thu Oct 20 13:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:26:09.713474 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c66e5-4696-46e6-bcd2-3ab9612b1f8b None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:09.806677 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:09.812646 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c66e5-4696-46e6-bcd2-3ab9612b1f8b None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:09.845054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dab415-d5eb-4d1e-817b-e7bc0628015b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:09.845638 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dab415-d5eb-4d1e-817b-e7bc0628015b None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:09.845913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dab415-d5eb-4d1e-817b-e7bc0628015b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:09.846181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dab415-d5eb-4d1e-817b-e7bc0628015b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:09.846894 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dab415-d5eb-4d1e-817b-e7bc0628015b None admin] RBAC: Adding query filter params (role.id=9c0f227afc2e4a0aa404780de229488c, scope.project.id=c25f337a79704728adaa03f4103eef1c, user.id=a00f0b4cee8d49a48a95317aec9f647c) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:09.847231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dab415-d5eb-4d1e-817b-e7bc0628015b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:09.848635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dab415-d5eb-4d1e-817b-e7bc0628015b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:09.854454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 483/964] 10.222.0.36 () {56 vars in 1374 bytes} [Thu Oct 20 13:26:09 2022] GET /identity/v3/role_assignments?user.id=a00f0b4cee8d49a48a95317aec9f647c&scope.project.id=c25f337a79704728adaa03f4103eef1c&role.id=9c0f227afc2e4a0aa404780de229488c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:26:12.013884 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67835acd-e81e-4dcf-9baa-462b806ea301 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:12.014403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67835acd-e81e-4dcf-9baa-462b806ea301 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:12.014403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67835acd-e81e-4dcf-9baa-462b806ea301 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:12.015811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 482/965] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:26:12.020853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207e9c2-490b-4051-85eb-ba08c6f53197 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:12.021227 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207e9c2-490b-4051-85eb-ba08c6f53197 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:12.021392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207e9c2-490b-4051-85eb-ba08c6f53197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:12.040666 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-e207e9c2-490b-4051-85eb-ba08c6f53197 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:26:12.041844 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e207e9c2-490b-4051-85eb-ba08c6f53197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:26:12.106967 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 484/966] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:26:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:26:12.370785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67835acd-e81e-4dcf-9baa-462b806ea301 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:12.401051 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:12.469285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67835acd-e81e-4dcf-9baa-462b806ea301 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:12.502625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933337b-a279-421e-aaa6-cffbaedd6e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:12.503274 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933337b-a279-421e-aaa6-cffbaedd6e75 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:12.503570 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933337b-a279-421e-aaa6-cffbaedd6e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:12.503841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933337b-a279-421e-aaa6-cffbaedd6e75 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:12.504417 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933337b-a279-421e-aaa6-cffbaedd6e75 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:12.505772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933337b-a279-421e-aaa6-cffbaedd6e75 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:12.514504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-f933337b-a279-421e-aaa6-cffbaedd6e75 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 13:26:12.514504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:26:12.514504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:26:12.514504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:26:12.514504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:26:12.514504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:26:12.514504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:26:12.514504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:26:12.514504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 13:26:12.514504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:26:12.514504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:26:12.514504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:26:12.514504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:26:12.514504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:26:12.514504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:26:12.514504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:26:12.514504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:26:12.515869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:26:12.515869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:26:12.515869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:26:12.515869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:26:12.515869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:26:12.515869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:26:12.515869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:26:12.515869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:26:12.515869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:26:12.515869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:26:12.515869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:26:12.515869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:26:12.515869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:26:12.515869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:26:12.515869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:26:12.515869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:26:12.516989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:26:12.516989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:26:12.516989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:26:12.516989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:26:12.516989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:26:12.516989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:26:12.516989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:26:12.516989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:26:12.516989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:26:12.516989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:26:12.516989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:26:12.516989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:26:12.516989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 13:26:12.516989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:26:12.516989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 483/967] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Oct 20 13:26:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:26:12.521590 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207e9c2-490b-4051-85eb-ba08c6f53197 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:12.618611 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:12.628313 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207e9c2-490b-4051-85eb-ba08c6f53197 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:12.661710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f05b2-bede-4a6e-a687-444b1d0911b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:12.662305 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f05b2-bede-4a6e-a687-444b1d0911b1 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:12.662582 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f05b2-bede-4a6e-a687-444b1d0911b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:12.663001 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f05b2-bede-4a6e-a687-444b1d0911b1 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:12.663628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f05b2-bede-4a6e-a687-444b1d0911b1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:12.663933 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f05b2-bede-4a6e-a687-444b1d0911b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:12.665290 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f05b2-bede-4a6e-a687-444b1d0911b1 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:12.669888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 485/968] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Oct 20 13:26:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:26:12.675673 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933337b-a279-421e-aaa6-cffbaedd6e75 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:12.767830 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:12.774141 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933337b-a279-421e-aaa6-cffbaedd6e75 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:12.806954 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c549010c-ba21-4171-a6aa-aeb306cb7327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:12.807566 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549010c-ba21-4171-a6aa-aeb306cb7327 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:12.807842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549010c-ba21-4171-a6aa-aeb306cb7327 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:12.808110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c549010c-ba21-4171-a6aa-aeb306cb7327 None admin] PATH_INFO: `/v3/services` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:12.808724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549010c-ba21-4171-a6aa-aeb306cb7327 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:12.809022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549010c-ba21-4171-a6aa-aeb306cb7327 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:12.810360 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c549010c-ba21-4171-a6aa-aeb306cb7327 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:12.814641 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 484/969] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Oct 20 13:26:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:26:14.986499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02d23a-e88d-44cd-add0-bbf709a55fa6 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:14.987050 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02d23a-e88d-44cd-add0-bbf709a55fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:14.987050 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02d23a-e88d-44cd-add0-bbf709a55fa6 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:14.988422 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 486/970] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:26:14.993703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e72e78-52fc-41ce-821a-beea6ce83199 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:14.994115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e72e78-52fc-41ce-821a-beea6ce83199 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:14.994249 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e72e78-52fc-41ce-821a-beea6ce83199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:15.013031 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-03e72e78-52fc-41ce-821a-beea6ce83199 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:26:15.014218 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-03e72e78-52fc-41ce-821a-beea6ce83199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:26:15.079252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 485/971] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:26:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:26:15.358825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02d23a-e88d-44cd-add0-bbf709a55fa6 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:15.455825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02d23a-e88d-44cd-add0-bbf709a55fa6 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:15.488401 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ae258-981d-40b0-9acd-f69921af751b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:15.488989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ae258-981d-40b0-9acd-f69921af751b None admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:15.489264 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ae258-981d-40b0-9acd-f69921af751b None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:15.489532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ae258-981d-40b0-9acd-f69921af751b None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:15.490169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ae258-981d-40b0-9acd-f69921af751b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:15.491549 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ae258-981d-40b0-9acd-f69921af751b None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:15.505314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 487/972] 10.222.0.36 () {60 vars in 1141 bytes} [Thu Oct 20 13:26:15 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:26:17.646397 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5f78e-c18a-4705-a0a8-a26b83720baf None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:17.647063 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5f78e-c18a-4705-a0a8-a26b83720baf None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:17.647063 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5f78e-c18a-4705-a0a8-a26b83720baf None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:17.648412 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 486/973] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:26:17.653854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aba305-0fb2-4d93-8414-e11ae376733f None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:17.654280 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aba305-0fb2-4d93-8414-e11ae376733f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:17.654382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aba305-0fb2-4d93-8414-e11ae376733f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:17.675003 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-27aba305-0fb2-4d93-8414-e11ae376733f None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:26:17.676266 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-27aba305-0fb2-4d93-8414-e11ae376733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:26:17.686618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:17.749638 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 488/974] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:26:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:26:18.017864 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5f78e-c18a-4705-a0a8-a26b83720baf None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:18.108492 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:18.120345 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5f78e-c18a-4705-a0a8-a26b83720baf None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:18.153888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cef72-ff9a-4501-a212-e33d28780f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:18.154506 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cef72-ff9a-4501-a212-e33d28780f66 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:18.154784 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cef72-ff9a-4501-a212-e33d28780f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:18.155214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682cef72-ff9a-4501-a212-e33d28780f66 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:18.155793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cef72-ff9a-4501-a212-e33d28780f66 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:18.157151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682cef72-ff9a-4501-a212-e33d28780f66 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:18.166603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-682cef72-ff9a-4501-a212-e33d28780f66 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 13:26:18.166603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:26:18.166603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:26:18.166603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:26:18.166603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:26:18.166603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:26:18.166603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:26:18.166603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:26:18.166603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 13:26:18.166603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:26:18.166603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:26:18.166603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:26:18.166603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:26:18.166603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:26:18.166603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:26:18.166603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:26:18.166603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:26:18.167886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:26:18.167886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:26:18.167886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:26:18.167886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:26:18.167886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:26:18.167886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:26:18.167886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:26:18.167886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:26:18.167886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:26:18.167886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:26:18.167886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:26:18.167886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:26:18.167886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:26:18.167886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:26:18.167886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:26:18.167886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:26:18.168798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:26:18.168798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:26:18.168798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:26:18.168798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:26:18.168798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:26:18.168798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:26:18.168798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:26:18.168798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:26:18.168798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:26:18.168798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:26:18.168798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:26:18.168798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:26:18.168798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 13:26:18.168798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:26:18.168798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 487/975] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Oct 20 13:26:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:26:18.173679 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aba305-0fb2-4d93-8414-e11ae376733f None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:18.267809 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aba305-0fb2-4d93-8414-e11ae376733f None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:18.300938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90f86e-31b6-4744-8345-efa8ec8965bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:18.301527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90f86e-31b6-4744-8345-efa8ec8965bc None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:18.301802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90f86e-31b6-4744-8345-efa8ec8965bc None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:18.302069 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90f86e-31b6-4744-8345-efa8ec8965bc None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:18.302678 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90f86e-31b6-4744-8345-efa8ec8965bc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:18.303121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90f86e-31b6-4744-8345-efa8ec8965bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:18.304941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90f86e-31b6-4744-8345-efa8ec8965bc None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:18.309887 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 489/976] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Oct 20 13:26:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:26:18.316000 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cef72-ff9a-4501-a212-e33d28780f66 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:18.414755 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682cef72-ff9a-4501-a212-e33d28780f66 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:18.447423 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16572a6-c7c4-4d8f-b1f9-9f5b4c18ee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:18.448016 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16572a6-c7c4-4d8f-b1f9-9f5b4c18ee86 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:18.448294 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16572a6-c7c4-4d8f-b1f9-9f5b4c18ee86 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:18.448563 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16572a6-c7c4-4d8f-b1f9-9f5b4c18ee86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:18.449250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16572a6-c7c4-4d8f-b1f9-9f5b4c18ee86 None admin] RBAC: Adding query filter params (interface=public, service_id=7f6e926a63d8424285610100b9bc259d, region_id=RegionOne) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:18.449557 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16572a6-c7c4-4d8f-b1f9-9f5b4c18ee86 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:18.450907 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16572a6-c7c4-4d8f-b1f9-9f5b4c18ee86 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:18.455803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 488/977] 10.222.0.36 () {56 vars in 1251 bytes} [Thu Oct 20 13:26:18 2022] GET /identity/v3/endpoints?service_id=7f6e926a63d8424285610100b9bc259d&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:26:18.461480 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90f86e-31b6-4744-8345-efa8ec8965bc None admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:18.465183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:18.559627 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90f86e-31b6-4744-8345-efa8ec8965bc None admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:18.590782 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900557c-2531-45b2-9191-3c76d8015479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:18.591404 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900557c-2531-45b2-9191-3c76d8015479 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:18.591680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900557c-2531-45b2-9191-3c76d8015479 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:18.591950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900557c-2531-45b2-9191-3c76d8015479 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:18.592538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900557c-2531-45b2-9191-3c76d8015479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:18.593875 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900557c-2531-45b2-9191-3c76d8015479 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:18.601117 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 490/978] 10.222.0.36 () {56 vars in 1087 bytes} [Thu Oct 20 13:26:18 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:26:20.712293 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c59db2-68c7-4fcf-97ae-f721efe1939b None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:20.712854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c59db2-68c7-4fcf-97ae-f721efe1939b None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:20.712854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c59db2-68c7-4fcf-97ae-f721efe1939b None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:20.714158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 489/979] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:26:20.719341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaeffd-57ed-474c-b742-f35db177391b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:20.719724 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaeffd-57ed-474c-b742-f35db177391b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:20.719880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaeffd-57ed-474c-b742-f35db177391b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:20.738011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-e9aaeffd-57ed-474c-b742-f35db177391b None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:26:20.739220 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e9aaeffd-57ed-474c-b742-f35db177391b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:26:20.798303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:20.804418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 491/980] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:26:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 20 13:26:21.072889 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c59db2-68c7-4fcf-97ae-f721efe1939b None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:21.092431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:21.173773 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c59db2-68c7-4fcf-97ae-f721efe1939b None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:21.206212 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb774ed-3e27-42c6-8b02-c82b2df4c7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:21.206828 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb774ed-3e27-42c6-8b02-c82b2df4c7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:21.207144 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb774ed-3e27-42c6-8b02-c82b2df4c7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:21.207418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb774ed-3e27-42c6-8b02-c82b2df4c7b8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:21.207992 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb774ed-3e27-42c6-8b02-c82b2df4c7b8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:21.209948 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb774ed-3e27-42c6-8b02-c82b2df4c7b8 None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:21.218538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application [None req-ddb774ed-3e27-42c6-8b02-c82b2df4c7b8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 13:26:21.218538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:26:21.218538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 20 13:26:21.218538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 20 13:26:21.218538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 20 13:26:21.218538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 20 13:26:21.218538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 20 13:26:21.218538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:26:21.218538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 13:26:21.218538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:26:21.218538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 20 13:26:21.218538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:26:21.218538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 20 13:26:21.218538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 20 13:26:21.218538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 20 13:26:21.218538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 20 13:26:21.218538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 20 13:26:21.219707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 20 13:26:21.219707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 20 13:26:21.219707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 20 13:26:21.219707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 20 13:26:21.219707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 20 13:26:21.219707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 20 13:26:21.219707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 20 13:26:21.219707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 20 13:26:21.219707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 20 13:26:21.219707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 20 13:26:21.219707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 20 13:26:21.219707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 20 13:26:21.219707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 20 13:26:21.219707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 20 13:26:21.219707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 20 13:26:21.219707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.get_or_create( Oct 20 13:26:21.220730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 20 13:26:21.220730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application with Lock( Oct 20 13:26:21.220730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 20 13:26:21.220730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self._enter() Oct 20 13:26:21.220730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 20 13:26:21.220730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 20 13:26:21.220730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 20 13:26:21.220730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application return self.creator() Oct 20 13:26:21.220730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 20 13:26:21.220730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application created_value = creator( Oct 20 13:26:21.220730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 20 13:26:21.220730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 20 13:26:21.220730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 20 13:26:21.220730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: ERROR keystone.server.flask.application Oct 20 13:26:21.220730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 490/981] 10.222.0.36 () {56 vars in 1117 bytes} [Thu Oct 20 13:26:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 20 13:26:21.225915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aaeffd-57ed-474c-b742-f35db177391b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:21.323377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aaeffd-57ed-474c-b742-f35db177391b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:21.356539 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51068f5-591b-412d-805d-4521e19e3069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:21.357133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51068f5-591b-412d-805d-4521e19e3069 None admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:21.357413 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51068f5-591b-412d-805d-4521e19e3069 None admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:21.357683 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51068f5-591b-412d-805d-4521e19e3069 None admin] PATH_INFO: `/v3/services` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:21.358299 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51068f5-591b-412d-805d-4521e19e3069 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:26:21.358612 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51068f5-591b-412d-805d-4521e19e3069 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:21.359993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51068f5-591b-412d-805d-4521e19e3069 None admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:21.364956 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 492/982] 10.222.0.36 () {56 vars in 1116 bytes} [Thu Oct 20 13:26:21 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:26:21.370808 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb774ed-3e27-42c6-8b02-c82b2df4c7b8 None admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:26:21.450898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:21.468767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb774ed-3e27-42c6-8b02-c82b2df4c7b8 None admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:26:21.501658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99376c3-c1f5-4624-a96b-7e55583eb13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:26:21.502259 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99376c3-c1f5-4624-a96b-7e55583eb13e None admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:26:21.502538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99376c3-c1f5-4624-a96b-7e55583eb13e None admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:26:21.502808 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99376c3-c1f5-4624-a96b-7e55583eb13e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:26:21.503496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99376c3-c1f5-4624-a96b-7e55583eb13e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:26:21.504847 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99376c3-c1f5-4624-a96b-7e55583eb13e None admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:26:21.525003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 491/983] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:26:21 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:26:31.362067 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=69 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:26:31.520201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:25.720331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925bcd3-e426-46c6-8a3b-703d4bb5c8b3 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:25.720879 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925bcd3-e426-46c6-8a3b-703d4bb5c8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:25.721465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8925bcd3-e426-46c6-8a3b-703d4bb5c8b3 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:25.728143 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fce3ef-b2ba-488b-8b91-48687acac7de None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:25.728542 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fce3ef-b2ba-488b-8b91-48687acac7de None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:25.728756 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fce3ef-b2ba-488b-8b91-48687acac7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:25.733394 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 493/984] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:27:25 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:27:25.840850 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-58fce3ef-b2ba-488b-8b91-48687acac7de None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:27:25.842245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-58fce3ef-b2ba-488b-8b91-48687acac7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:25.958647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 492/985] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:27:26.254369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913d49c-b390-4f35-beb3-49cc6916d715 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:26.254662 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913d49c-b390-4f35-beb3-49cc6916d715 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:26.255373 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913d49c-b390-4f35-beb3-49cc6916d715 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:26.256582 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 494/986] 10.222.0.36 () {54 vars in 964 bytes} [Thu Oct 20 13:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:27:26.262830 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e488787-7664-477e-9faa-564c5453c4d4 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:26.263155 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e488787-7664-477e-9faa-564c5453c4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:26.263431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e488787-7664-477e-9faa-564c5453c4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:26.347749 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-2e488787-7664-477e-9faa-564c5453c4d4 None None] MFA Rules not processed for user `5852ff82962e4cea85b8aa8593f09d37`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:27:26.349101 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-2e488787-7664-477e-9faa-564c5453c4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:26.371751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:26.432109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 493/987] 10.222.0.36 () {58 vars in 1061 bytes} [Thu Oct 20 13:27:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:27:26.441314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913d49c-b390-4f35-beb3-49cc6916d715 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:27:26.443132 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0913d49c-b390-4f35-beb3-49cc6916d715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:26.561345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913d49c-b390-4f35-beb3-49cc6916d715 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:27:26.645783 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167fbb6-9dc1-46d3-972b-5d0b880564ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:27:26.646568 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167fbb6-9dc1-46d3-972b-5d0b880564ba service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:26.646975 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167fbb6-9dc1-46d3-972b-5d0b880564ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:26.647352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167fbb6-9dc1-46d3-972b-5d0b880564ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:26.649144 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8167fbb6-9dc1-46d3-972b-5d0b880564ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:26.727243 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:26.797365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8167fbb6-9dc1-46d3-972b-5d0b880564ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:27:26.799209 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8167fbb6-9dc1-46d3-972b-5d0b880564ba service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:27:26.822921 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 495/988] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:27:29.338913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb356a-ed51-4d51-984d-f8e2cdb25d7d None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:29.339482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb356a-ed51-4d51-984d-f8e2cdb25d7d None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:29.339482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcb356a-ed51-4d51-984d-f8e2cdb25d7d None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:29.340819 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 494/989] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:27:29.346700 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a916c6d-f562-4944-8bf2-94bcd2e361b4 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:29.347172 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a916c6d-f562-4944-8bf2-94bcd2e361b4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:29.347266 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a916c6d-f562-4944-8bf2-94bcd2e361b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:29.427644 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0a916c6d-f562-4944-8bf2-94bcd2e361b4 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:27:29.428845 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0a916c6d-f562-4944-8bf2-94bcd2e361b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:29.523078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 496/990] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:27:29.808078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb356a-ed51-4d51-984d-f8e2cdb25d7d None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:27:29.809622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-2dcb356a-ed51-4d51-984d-f8e2cdb25d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:29.914933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcb356a-ed51-4d51-984d-f8e2cdb25d7d None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:27:29.987268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:29.989667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c08d07-78ae-4758-8d7a-22107f4102f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:27:29.990482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c08d07-78ae-4758-8d7a-22107f4102f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:29.990973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c08d07-78ae-4758-8d7a-22107f4102f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:29.991434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c08d07-78ae-4758-8d7a-22107f4102f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:29.993028 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-63c08d07-78ae-4758-8d7a-22107f4102f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:30.097994 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c08d07-78ae-4758-8d7a-22107f4102f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:27:30.099391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c08d07-78ae-4758-8d7a-22107f4102f6 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:27:30.117563 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 495/991] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:27:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:27:32.560321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891a027-7e37-4d10-adc5-9adaf0d21187 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:32.560897 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891a027-7e37-4d10-adc5-9adaf0d21187 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:32.560897 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891a027-7e37-4d10-adc5-9adaf0d21187 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:32.562202 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 497/992] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:27:32.567654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875a27e-03ec-4df9-ab90-8050d5030c56 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:32.568082 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875a27e-03ec-4df9-ab90-8050d5030c56 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:32.568190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875a27e-03ec-4df9-ab90-8050d5030c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:32.634564 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-7875a27e-03ec-4df9-ab90-8050d5030c56 None None] MFA Rules not processed for user `50d1e52d676e4e008bf20b30460feb3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:27:32.635802 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7875a27e-03ec-4df9-ab90-8050d5030c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:32.688351 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:32.733073 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 496/993] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:27:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:27:33.018681 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891a027-7e37-4d10-adc5-9adaf0d21187 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:27:33.020279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b891a027-7e37-4d10-adc5-9adaf0d21187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:33.030744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:33.123340 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891a027-7e37-4d10-adc5-9adaf0d21187 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:27:33.196768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a88a3-747f-40db-b7f8-5a3c92095bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:27:33.197358 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a88a3-747f-40db-b7f8-5a3c92095bbb service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:33.197631 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a88a3-747f-40db-b7f8-5a3c92095bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:33.197898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a88a3-747f-40db-b7f8-5a3c92095bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:33.199476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d71a88a3-747f-40db-b7f8-5a3c92095bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:33.259218 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:33.305518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a88a3-747f-40db-b7f8-5a3c92095bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:27:33.306927 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a88a3-747f-40db-b7f8-5a3c92095bbb service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:27:33.325223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 498/994] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:27:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:27:36.001526 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635c8bf-a16a-4ac3-aa49-9aec9e9dbc5e None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:36.002053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635c8bf-a16a-4ac3-aa49-9aec9e9dbc5e None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:36.002053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635c8bf-a16a-4ac3-aa49-9aec9e9dbc5e None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:36.003440 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 497/995] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:27:36.008704 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77035c-2e3d-4361-93d4-9aee3d954203 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:36.009107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77035c-2e3d-4361-93d4-9aee3d954203 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:36.009256 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77035c-2e3d-4361-93d4-9aee3d954203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:36.074140 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-9e77035c-2e3d-4361-93d4-9aee3d954203 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:27:36.075384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9e77035c-2e3d-4361-93d4-9aee3d954203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:36.171546 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 499/996] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:27:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:27:36.455918 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635c8bf-a16a-4ac3-aa49-9aec9e9dbc5e None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:27:36.457448 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d635c8bf-a16a-4ac3-aa49-9aec9e9dbc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:36.559635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d635c8bf-a16a-4ac3-aa49-9aec9e9dbc5e None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:27:36.631624 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aaa72b-f8ed-4f0d-8047-b4bcb8f8cca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:27:36.632251 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaa72b-f8ed-4f0d-8047-b4bcb8f8cca4 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:36.632529 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaa72b-f8ed-4f0d-8047-b4bcb8f8cca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:36.632802 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaa72b-f8ed-4f0d-8047-b4bcb8f8cca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:36.634400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-c3aaa72b-f8ed-4f0d-8047-b4bcb8f8cca4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:36.641158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:36.744428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aaa72b-f8ed-4f0d-8047-b4bcb8f8cca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:27:36.745803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aaa72b-f8ed-4f0d-8047-b4bcb8f8cca4 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:27:36.763409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 498/997] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:27:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:27:39.528644 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d41285-b143-4ef7-919f-21de045eb046 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:39.529159 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d41285-b143-4ef7-919f-21de045eb046 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:39.529269 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d41285-b143-4ef7-919f-21de045eb046 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:39.530529 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 500/998] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:27:39.536776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f99f2-a104-44e4-b10c-54826efa0353 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:39.537198 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f99f2-a104-44e4-b10c-54826efa0353 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:39.537336 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f99f2-a104-44e4-b10c-54826efa0353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:39.613238 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-a82f99f2-a104-44e4-b10c-54826efa0353 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:27:39.614487 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a82f99f2-a104-44e4-b10c-54826efa0353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:39.677295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:39.719398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 499/999] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:27:40.003273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d41285-b143-4ef7-919f-21de045eb046 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:27:40.004916 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e1d41285-b143-4ef7-919f-21de045eb046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:40.026290 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:40.109952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d41285-b143-4ef7-919f-21de045eb046 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:27:40.184485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe34fd-785f-4c17-b2c1-0b908c75652a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:27:40.185001 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe34fd-785f-4c17-b2c1-0b908c75652a service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:40.185277 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe34fd-785f-4c17-b2c1-0b908c75652a service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:40.185545 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe34fd-785f-4c17-b2c1-0b908c75652a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:40.187154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e7fe34fd-785f-4c17-b2c1-0b908c75652a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:40.257993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:40.295953 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe34fd-785f-4c17-b2c1-0b908c75652a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:27:40.297378 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe34fd-785f-4c17-b2c1-0b908c75652a service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:27:40.315923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 501/1000] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:27:42.544055 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54400f0-7f53-4a40-ad29-90c89077253d None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:42.544583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54400f0-7f53-4a40-ad29-90c89077253d None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:42.544583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54400f0-7f53-4a40-ad29-90c89077253d None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:42.546403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 500/1001] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:27:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:27:42.552466 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b9bac-70d3-4db3-9dbb-72772cb62d5c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:42.552926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b9bac-70d3-4db3-9dbb-72772cb62d5c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:42.553136 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b9bac-70d3-4db3-9dbb-72772cb62d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:42.618609 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-e07b9bac-70d3-4db3-9dbb-72772cb62d5c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:27:42.619851 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e07b9bac-70d3-4db3-9dbb-72772cb62d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:42.727283 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 502/1002] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:27:43.010592 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54400f0-7f53-4a40-ad29-90c89077253d None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:27:43.012249 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-f54400f0-7f53-4a40-ad29-90c89077253d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:43.114713 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54400f0-7f53-4a40-ad29-90c89077253d None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:27:43.190729 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dde8c0-8360-4086-bab4-477f8b4341b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:27:43.191359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dde8c0-8360-4086-bab4-477f8b4341b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:43.191638 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dde8c0-8360-4086-bab4-477f8b4341b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:43.191906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dde8c0-8360-4086-bab4-477f8b4341b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:43.193477 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-29dde8c0-8360-4086-bab4-477f8b4341b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:43.211201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:43.305377 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dde8c0-8360-4086-bab4-477f8b4341b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:27:43.306817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dde8c0-8360-4086-bab4-477f8b4341b2 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:27:43.324891 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 501/1003] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:27:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:27:45.545848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103d81c-ef18-4151-807b-9b1cb0f0ff20 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:45.546371 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103d81c-ef18-4151-807b-9b1cb0f0ff20 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:45.546371 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103d81c-ef18-4151-807b-9b1cb0f0ff20 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:45.548354 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 503/1004] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:27:45.553714 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02c0d9-88d4-47c3-9042-ab7be86087ac None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:45.554148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02c0d9-88d4-47c3-9042-ab7be86087ac None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:45.554289 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02c0d9-88d4-47c3-9042-ab7be86087ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:45.622447 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-7f02c0d9-88d4-47c3-9042-ab7be86087ac None None] MFA Rules not processed for user `50d1e52d676e4e008bf20b30460feb3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:27:45.623734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7f02c0d9-88d4-47c3-9042-ab7be86087ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:45.688135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:45.720995 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 502/1005] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:27:45 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:27:46.005604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103d81c-ef18-4151-807b-9b1cb0f0ff20 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:27:46.007259 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f103d81c-ef18-4151-807b-9b1cb0f0ff20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:46.040403 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:46.116704 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103d81c-ef18-4151-807b-9b1cb0f0ff20 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:27:46.194060 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a152279-78b3-4eee-b087-af0dd2bfd4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:27:46.194661 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a152279-78b3-4eee-b087-af0dd2bfd4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:46.194938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a152279-78b3-4eee-b087-af0dd2bfd4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:46.195232 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a152279-78b3-4eee-b087-af0dd2bfd4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:46.196815 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6a152279-78b3-4eee-b087-af0dd2bfd4a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:46.276963 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:46.309666 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a152279-78b3-4eee-b087-af0dd2bfd4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:27:46.311133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a152279-78b3-4eee-b087-af0dd2bfd4a6 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:27:46.328797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 504/1006] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:27:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:27:48.694977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad695ee-687a-40e3-a60c-ff1b736c6acf None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:48.695639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad695ee-687a-40e3-a60c-ff1b736c6acf None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:48.695639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad695ee-687a-40e3-a60c-ff1b736c6acf None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:48.696868 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 503/1007] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:27:48.701953 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ff1e3-6490-41eb-875e-4ee98dd662e9 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:48.702398 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ff1e3-6490-41eb-875e-4ee98dd662e9 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:48.702510 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ff1e3-6490-41eb-875e-4ee98dd662e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:48.769448 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-517ff1e3-6490-41eb-875e-4ee98dd662e9 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:27:48.770658 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-517ff1e3-6490-41eb-875e-4ee98dd662e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:48.866343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 505/1008] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:27:49.146826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad695ee-687a-40e3-a60c-ff1b736c6acf None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:27:49.148403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-fad695ee-687a-40e3-a60c-ff1b736c6acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:49.249926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad695ee-687a-40e3-a60c-ff1b736c6acf None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:27:49.321949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2676b-42e4-42e8-a14a-5d869c0194b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:27:49.322550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2676b-42e4-42e8-a14a-5d869c0194b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:49.322831 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2676b-42e4-42e8-a14a-5d869c0194b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:49.323135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2676b-42e4-42e8-a14a-5d869c0194b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:49.324710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-bba2676b-42e4-42e8-a14a-5d869c0194b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:49.353270 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:49.436397 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2676b-42e4-42e8-a14a-5d869c0194b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:27:49.438858 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2676b-42e4-42e8-a14a-5d869c0194b8 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:27:49.457160 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 504/1009] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:27:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:27:51.622680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd842a2-2d9c-4716-972c-c8f9ef8404d2 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:51.623271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd842a2-2d9c-4716-972c-c8f9ef8404d2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:51.623271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd842a2-2d9c-4716-972c-c8f9ef8404d2 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:51.624589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 506/1010] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:27:51.630349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4e01b-ab88-489a-b408-8481b2b09171 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:51.630785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4e01b-ab88-489a-b408-8481b2b09171 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:51.630886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4e01b-ab88-489a-b408-8481b2b09171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:51.697025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-06a4e01b-ab88-489a-b408-8481b2b09171 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:27:51.698236 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-06a4e01b-ab88-489a-b408-8481b2b09171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:51.773123 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:51.795792 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 505/1011] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:27:52.086977 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd842a2-2d9c-4716-972c-c8f9ef8404d2 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:27:52.088521 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1fd842a2-2d9c-4716-972c-c8f9ef8404d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:52.130820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:52.194657 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd842a2-2d9c-4716-972c-c8f9ef8404d2 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:27:52.268350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da754251-3a9b-4367-ae1f-bb4d0a9f8988 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:27:52.268952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da754251-3a9b-4367-ae1f-bb4d0a9f8988 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:52.269227 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da754251-3a9b-4367-ae1f-bb4d0a9f8988 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:52.269495 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da754251-3a9b-4367-ae1f-bb4d0a9f8988 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:52.271095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-da754251-3a9b-4367-ae1f-bb4d0a9f8988 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:52.354991 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:52.381748 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da754251-3a9b-4367-ae1f-bb4d0a9f8988 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:27:52.383209 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da754251-3a9b-4367-ae1f-bb4d0a9f8988 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:27:52.402869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 507/1012] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:27:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:27:54.858332 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b1513-06da-4de2-bb06-a8c095b7e80b None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:54.858904 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b1513-06da-4de2-bb06-a8c095b7e80b None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:54.858904 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b1513-06da-4de2-bb06-a8c095b7e80b None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:54.860876 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 506/1013] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:27:54.865990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f052ba-6ae7-4f5f-8048-f64c2b1515ee None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:54.866427 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f052ba-6ae7-4f5f-8048-f64c2b1515ee None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:54.866530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f052ba-6ae7-4f5f-8048-f64c2b1515ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:54.931922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-16f052ba-6ae7-4f5f-8048-f64c2b1515ee None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:27:54.933039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-16f052ba-6ae7-4f5f-8048-f64c2b1515ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:55.026524 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 508/1014] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:27:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:27:55.318345 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b1513-06da-4de2-bb06-a8c095b7e80b None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:27:55.319931 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-678b1513-06da-4de2-bb06-a8c095b7e80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:55.421732 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b1513-06da-4de2-bb06-a8c095b7e80b None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:27:55.493720 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc80351-e127-4035-986c-6b7a4e722425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:27:55.494317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc80351-e127-4035-986c-6b7a4e722425 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:55.494599 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc80351-e127-4035-986c-6b7a4e722425 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:55.494874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc80351-e127-4035-986c-6b7a4e722425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:55.496477 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-4dc80351-e127-4035-986c-6b7a4e722425 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:55.531417 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:55.605541 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc80351-e127-4035-986c-6b7a4e722425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:27:55.606932 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc80351-e127-4035-986c-6b7a4e722425 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:27:55.625508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 507/1015] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:27:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:27:59.660867 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5df04-2535-4e6f-bcff-55b9d18876a0 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:59.661725 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5df04-2535-4e6f-bcff-55b9d18876a0 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:59.661725 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5df04-2535-4e6f-bcff-55b9d18876a0 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:59.662844 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 509/1016] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:27:59.668119 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc528e-0630-4b93-9461-5323f3ea0015 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:27:59.668591 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc528e-0630-4b93-9461-5323f3ea0015 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:27:59.668707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc528e-0630-4b93-9461-5323f3ea0015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:27:59.736071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-a1bc528e-0630-4b93-9461-5323f3ea0015 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:27:59.737175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a1bc528e-0630-4b93-9461-5323f3ea0015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:27:59.823692 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:27:59.835995 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 508/1017] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:00.118825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5df04-2535-4e6f-bcff-55b9d18876a0 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:28:00.120397 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9ff5df04-2535-4e6f-bcff-55b9d18876a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:00.168856 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:00.225496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5df04-2535-4e6f-bcff-55b9d18876a0 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:28:00.300388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543645e-dd1b-4fff-ae4f-15aa404bdc13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:28:00.300993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543645e-dd1b-4fff-ae4f-15aa404bdc13 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:00.301274 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543645e-dd1b-4fff-ae4f-15aa404bdc13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:00.301545 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543645e-dd1b-4fff-ae4f-15aa404bdc13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:00.303166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6543645e-dd1b-4fff-ae4f-15aa404bdc13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:00.396392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:00.413994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543645e-dd1b-4fff-ae4f-15aa404bdc13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:28:00.415458 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6543645e-dd1b-4fff-ae4f-15aa404bdc13 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:28:00.434290 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 510/1018] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:28:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:28:03.243853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44853d98-89ab-49e7-bf2f-4c9e6f2533f3 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:03.244357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44853d98-89ab-49e7-bf2f-4c9e6f2533f3 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:03.244357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44853d98-89ab-49e7-bf2f-4c9e6f2533f3 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:03.245817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 509/1019] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:03.251451 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96366539-d257-4875-85fd-49e84b18cdf3 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:03.251868 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96366539-d257-4875-85fd-49e84b18cdf3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:03.251985 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96366539-d257-4875-85fd-49e84b18cdf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:03.317352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-96366539-d257-4875-85fd-49e84b18cdf3 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:03.318562 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-96366539-d257-4875-85fd-49e84b18cdf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:03.414896 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 511/1020] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:28:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:03.702495 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44853d98-89ab-49e7-bf2f-4c9e6f2533f3 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:28:03.704644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-44853d98-89ab-49e7-bf2f-4c9e6f2533f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:03.813399 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44853d98-89ab-49e7-bf2f-4c9e6f2533f3 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:28:03.890742 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596f76ea-dc82-469a-94b3-a80ca01ebb47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:28:03.891887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f76ea-dc82-469a-94b3-a80ca01ebb47 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:03.892170 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f76ea-dc82-469a-94b3-a80ca01ebb47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:03.892442 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596f76ea-dc82-469a-94b3-a80ca01ebb47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:03.894029 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-596f76ea-dc82-469a-94b3-a80ca01ebb47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:03.939697 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:04.009667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f76ea-dc82-469a-94b3-a80ca01ebb47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:28:04.011159 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596f76ea-dc82-469a-94b3-a80ca01ebb47 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:28:04.030571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 510/1021] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:28:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:28:08.163627 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79e8df-3021-443d-9c24-0772b67db6de None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:08.164151 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79e8df-3021-443d-9c24-0772b67db6de None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:08.164244 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79e8df-3021-443d-9c24-0772b67db6de None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:08.165542 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 512/1022] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:08.170702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83357559-278d-4e05-b301-bc7be95532ba None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:08.171180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83357559-278d-4e05-b301-bc7be95532ba None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:08.171273 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83357559-278d-4e05-b301-bc7be95532ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:08.244702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-83357559-278d-4e05-b301-bc7be95532ba None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:08.245921 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-83357559-278d-4e05-b301-bc7be95532ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:08.342237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:08.345317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 511/1023] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:08.627186 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79e8df-3021-443d-9c24-0772b67db6de None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:28:08.628724 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8a79e8df-3021-443d-9c24-0772b67db6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:08.686890 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:08.731939 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79e8df-3021-443d-9c24-0772b67db6de None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:28:08.804242 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db9b12-d1f5-4158-a8f3-9aff0381d9be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:28:08.804844 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db9b12-d1f5-4158-a8f3-9aff0381d9be service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:08.805119 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db9b12-d1f5-4158-a8f3-9aff0381d9be service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:08.805385 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db9b12-d1f5-4158-a8f3-9aff0381d9be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:08.806972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e0db9b12-d1f5-4158-a8f3-9aff0381d9be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:08.914499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:08.918589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db9b12-d1f5-4158-a8f3-9aff0381d9be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:28:08.920320 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db9b12-d1f5-4158-a8f3-9aff0381d9be service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:28:08.940137 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 513/1024] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:28:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:28:13.854521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df8893-cdf3-4c98-ba25-55e53f753738 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:13.854920 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df8893-cdf3-4c98-ba25-55e53f753738 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:13.854920 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df8893-cdf3-4c98-ba25-55e53f753738 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:13.857332 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 512/1025] 10.222.0.36 () {54 vars in 921 bytes} [Thu Oct 20 13:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:13.864045 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d4705-a2d6-4950-a3d9-bd422d181d25 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:13.864506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d4705-a2d6-4950-a3d9-bd422d181d25 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:13.864586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d4705-a2d6-4950-a3d9-bd422d181d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:13.971094 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-560d4705-a2d6-4950-a3d9-bd422d181d25 None None] MFA Rules not processed for user `a00f0b4cee8d49a48a95317aec9f647c`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:13.972868 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-560d4705-a2d6-4950-a3d9-bd422d181d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:14.159284 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 514/1026] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Oct 20 13:28:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:18.487756 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd4580-2ba6-4793-9dc6-8c94ff1ae95e None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:18.488644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd4580-2ba6-4793-9dc6-8c94ff1ae95e None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:18.488952 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd4580-2ba6-4793-9dc6-8c94ff1ae95e None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:18.490474 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 513/1027] 10.222.0.36 () {54 vars in 921 bytes} [Thu Oct 20 13:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:18.495370 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ad4eb-8675-45ca-be18-710052b959c9 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:18.495774 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ad4eb-8675-45ca-be18-710052b959c9 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:18.495962 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ad4eb-8675-45ca-be18-710052b959c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:18.553002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:18.578355 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-504ad4eb-8675-45ca-be18-710052b959c9 None None] MFA Rules not processed for user `a00f0b4cee8d49a48a95317aec9f647c`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:18.579826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-504ad4eb-8675-45ca-be18-710052b959c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:18.694687 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 515/1028] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Oct 20 13:28:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:20.091919 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8edd0c-bf87-4718-b304-03463b0cf8f8 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:20.092501 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8edd0c-bf87-4718-b304-03463b0cf8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:20.092501 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8edd0c-bf87-4718-b304-03463b0cf8f8 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:20.093840 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 514/1029] 10.222.0.36 () {54 vars in 921 bytes} [Thu Oct 20 13:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:20.098801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615baff2-1c0d-4519-9dea-75e570c82d97 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:20.099272 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615baff2-1c0d-4519-9dea-75e570c82d97 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:20.099438 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615baff2-1c0d-4519-9dea-75e570c82d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:20.176882 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-615baff2-1c0d-4519-9dea-75e570c82d97 None None] MFA Rules not processed for user `a00f0b4cee8d49a48a95317aec9f647c`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:20.177987 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-615baff2-1c0d-4519-9dea-75e570c82d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:20.223023 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:20.292498 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 516/1030] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Oct 20 13:28:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:28:23.745727 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfeed92-9283-4418-aae8-26b6a859148c None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:23.746243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfeed92-9283-4418-aae8-26b6a859148c None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:23.746472 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfeed92-9283-4418-aae8-26b6a859148c None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:23.747954 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 515/1031] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:23.753900 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264e114-c57b-46ac-8e60-197687f6ae8b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:23.754352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264e114-c57b-46ac-8e60-197687f6ae8b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:23.754648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264e114-c57b-46ac-8e60-197687f6ae8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:23.825265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5264e114-c57b-46ac-8e60-197687f6ae8b None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:23.826888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5264e114-c57b-46ac-8e60-197687f6ae8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:23.939005 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 517/1032] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:24.241842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237152cf-a0cb-4a5b-919e-5b77e521fed8 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:24.242816 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237152cf-a0cb-4a5b-919e-5b77e521fed8 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:24.243380 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237152cf-a0cb-4a5b-919e-5b77e521fed8 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:24.245604 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 516/1033] 10.222.0.36 () {54 vars in 961 bytes} [Thu Oct 20 13:28:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:24.255183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dee1f3-2bdb-4b04-8a33-974ade7257e3 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:24.255183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dee1f3-2bdb-4b04-8a33-974ade7257e3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:24.255484 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dee1f3-2bdb-4b04-8a33-974ade7257e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:24.275711 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:24.341637 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c3dee1f3-2bdb-4b04-8a33-974ade7257e3 None None] MFA Rules not processed for user `674c5b25932a41309428ba6c6c72ed02`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:24.343521 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c3dee1f3-2bdb-4b04-8a33-974ade7257e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:24.471300 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 518/1034] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Oct 20 13:28:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:24.479796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237152cf-a0cb-4a5b-919e-5b77e521fed8 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:28:24.481412 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-237152cf-a0cb-4a5b-919e-5b77e521fed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:24.650927 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237152cf-a0cb-4a5b-919e-5b77e521fed8 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:28:24.727754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:24.773413 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362eaca-3a51-4fcd-8d3d-bd48c4dc334d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:28:24.774863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362eaca-3a51-4fcd-8d3d-bd48c4dc334d service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:24.775376 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362eaca-3a51-4fcd-8d3d-bd48c4dc334d service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:24.775758 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362eaca-3a51-4fcd-8d3d-bd48c4dc334d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:24.777532 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9362eaca-3a51-4fcd-8d3d-bd48c4dc334d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:24.891260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362eaca-3a51-4fcd-8d3d-bd48c4dc334d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:28:24.893414 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362eaca-3a51-4fcd-8d3d-bd48c4dc334d service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:28:24.914296 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 517/1035] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:28:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:28:27.293895 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65dbd3-f60a-4da8-986f-5030e5d15bf1 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:27.293895 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65dbd3-f60a-4da8-986f-5030e5d15bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:27.293895 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65dbd3-f60a-4da8-986f-5030e5d15bf1 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:27.300909 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785da66-b08c-4d16-95a2-951427439b77 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:27.301511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785da66-b08c-4d16-95a2-951427439b77 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:27.301511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785da66-b08c-4d16-95a2-951427439b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:27.305891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 519/1036] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:28:27 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:27.390697 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-5785da66-b08c-4d16-95a2-951427439b77 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:27.392053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-5785da66-b08c-4d16-95a2-951427439b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:27.438256 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:27.504260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 518/1037] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:28:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:27.798452 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65dbd3-f60a-4da8-986f-5030e5d15bf1 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:28:27.800386 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3e65dbd3-f60a-4da8-986f-5030e5d15bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:27.884766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:27.985222 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65dbd3-f60a-4da8-986f-5030e5d15bf1 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:28:28.109877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfd4d1-73ab-42aa-a401-42901cab4aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:28:28.110497 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfd4d1-73ab-42aa-a401-42901cab4aa3 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:28.110777 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfd4d1-73ab-42aa-a401-42901cab4aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:28.111087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfd4d1-73ab-42aa-a401-42901cab4aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:28.112704 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a8dfd4d1-73ab-42aa-a401-42901cab4aa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:28.136730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:28.208342 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfd4d1-73ab-42aa-a401-42901cab4aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:28:28.209932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfd4d1-73ab-42aa-a401-42901cab4aa3 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:28:28.227935 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 520/1038] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:28:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:28:30.715997 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f849f9-0503-45e8-b76f-344642aad2a5 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:30.716523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f849f9-0503-45e8-b76f-344642aad2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:30.716523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f849f9-0503-45e8-b76f-344642aad2a5 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:30.718098 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 519/1039] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:30.723254 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581074a6-44cd-4486-b462-8ca80dd2abb0 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:30.723664 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581074a6-44cd-4486-b462-8ca80dd2abb0 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:30.723853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581074a6-44cd-4486-b462-8ca80dd2abb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:30.793728 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-581074a6-44cd-4486-b462-8ca80dd2abb0 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:30.794940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-581074a6-44cd-4486-b462-8ca80dd2abb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:30.913702 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:30.918990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 521/1040] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:31.211952 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732507ba-93e1-41fe-8050-34bb3d32ddf0 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:31.212488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732507ba-93e1-41fe-8050-34bb3d32ddf0 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:31.212761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732507ba-93e1-41fe-8050-34bb3d32ddf0 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:31.214102 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 520/1041] 10.222.0.36 () {54 vars in 961 bytes} [Thu Oct 20 13:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:31.220542 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4e6a8-3285-4d34-ac2a-54946bea8e99 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:31.220947 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4e6a8-3285-4d34-ac2a-54946bea8e99 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:31.221336 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4e6a8-3285-4d34-ac2a-54946bea8e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:31.301095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-edd4e6a8-3285-4d34-ac2a-54946bea8e99 None None] MFA Rules not processed for user `674c5b25932a41309428ba6c6c72ed02`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:31.302464 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-edd4e6a8-3285-4d34-ac2a-54946bea8e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:31.425028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 522/1042] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Oct 20 13:28:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:31.433324 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732507ba-93e1-41fe-8050-34bb3d32ddf0 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:28:31.434989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-732507ba-93e1-41fe-8050-34bb3d32ddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:31.590761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732507ba-93e1-41fe-8050-34bb3d32ddf0 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:28:31.612781 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:31.716302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f0ba3-ec7e-48b9-b424-f078671a7340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:28:31.716952 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f0ba3-ec7e-48b9-b424-f078671a7340 service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:31.717332 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f0ba3-ec7e-48b9-b424-f078671a7340 service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:31.717539 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f0ba3-ec7e-48b9-b424-f078671a7340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:31.719141 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-815f0ba3-ec7e-48b9-b424-f078671a7340 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:31.818661 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f0ba3-ec7e-48b9-b424-f078671a7340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:28:31.820354 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f0ba3-ec7e-48b9-b424-f078671a7340 service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:28:31.842156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 521/1043] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:28:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:28:31.935806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df092f13-cd84-4a04-849c-0c21bb9f586f None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:31.936995 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df092f13-cd84-4a04-849c-0c21bb9f586f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:31.936995 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df092f13-cd84-4a04-849c-0c21bb9f586f None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:31.942682 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 523/1044] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:28:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:31.944305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39928b-1908-4277-b405-b601f77f4688 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:31.944597 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39928b-1908-4277-b405-b601f77f4688 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:31.944880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39928b-1908-4277-b405-b601f77f4688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:31.981189 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:32.027901 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-6e39928b-1908-4277-b405-b601f77f4688 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:32.029337 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6e39928b-1908-4277-b405-b601f77f4688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:32.148909 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 522/1045] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:28:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:28:32.481421 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df40ab-f346-45ce-b54c-0f4d656f1166 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:32.481421 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df40ab-f346-45ce-b54c-0f4d656f1166 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:32.481421 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df40ab-f346-45ce-b54c-0f4d656f1166 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:32.484374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 524/1046] 10.222.0.36 () {54 vars in 963 bytes} [Thu Oct 20 13:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:32.488766 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fad58-f4c9-48d9-8dd2-aec985bb78dd None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:32.489053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fad58-f4c9-48d9-8dd2-aec985bb78dd None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:32.489328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fad58-f4c9-48d9-8dd2-aec985bb78dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:32.575082 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-019fad58-f4c9-48d9-8dd2-aec985bb78dd None None] MFA Rules not processed for user `8a7a1006ff4b43c3be2cc011359abdd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:32.576756 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-019fad58-f4c9-48d9-8dd2-aec985bb78dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:32.628845 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:32.661943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 523/1047] 10.222.0.36 () {58 vars in 1060 bytes} [Thu Oct 20 13:28:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:32.669639 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df40ab-f346-45ce-b54c-0f4d656f1166 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:28:32.671885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f8df40ab-f346-45ce-b54c-0f4d656f1166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:32.726760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:32.787657 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df40ab-f346-45ce-b54c-0f4d656f1166 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:28:32.880430 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95f138-8197-4758-bc19-918594826516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:28:32.881366 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f138-8197-4758-bc19-918594826516 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:32.881731 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f138-8197-4758-bc19-918594826516 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:32.882093 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95f138-8197-4758-bc19-918594826516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:32.884383 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ae95f138-8197-4758-bc19-918594826516 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:33.003442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:33.018323 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95f138-8197-4758-bc19-918594826516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:28:33.019821 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95f138-8197-4758-bc19-918594826516 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:28:33.050515 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 525/1048] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:28:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:28:34.116790 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a66e9e-a701-4a81-9efd-5f49eb038504 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:34.117329 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a66e9e-a701-4a81-9efd-5f49eb038504 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:34.117446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a66e9e-a701-4a81-9efd-5f49eb038504 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:34.118841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 524/1049] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:34.124815 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802d4cb-507d-427c-860d-011a1eb72c86 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:34.125245 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802d4cb-507d-427c-860d-011a1eb72c86 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:34.125432 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802d4cb-507d-427c-860d-011a1eb72c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:34.191900 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-7802d4cb-507d-427c-860d-011a1eb72c86 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:34.193126 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7802d4cb-507d-427c-860d-011a1eb72c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:34.292388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 526/1050] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:34.593471 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a66e9e-a701-4a81-9efd-5f49eb038504 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:28:34.595045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-24a66e9e-a701-4a81-9efd-5f49eb038504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:34.758003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a66e9e-a701-4a81-9efd-5f49eb038504 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:28:34.812871 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:34.883647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d53f2c1-d851-46df-99f9-08953b86d3e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:28:34.884334 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53f2c1-d851-46df-99f9-08953b86d3e6 service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:34.884636 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53f2c1-d851-46df-99f9-08953b86d3e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:34.884901 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d53f2c1-d851-46df-99f9-08953b86d3e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:34.886485 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6d53f2c1-d851-46df-99f9-08953b86d3e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:34.979998 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53f2c1-d851-46df-99f9-08953b86d3e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:28:34.981589 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d53f2c1-d851-46df-99f9-08953b86d3e6 service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:28:35.001863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 525/1051] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:28:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:28:37.224364 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b1acf-449c-4a55-8fd8-728f34df788b None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:37.224904 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b1acf-449c-4a55-8fd8-728f34df788b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:37.224904 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b1acf-449c-4a55-8fd8-728f34df788b None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:37.226395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 527/1052] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:37.231573 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3278e9-8e7a-4eaa-9c0d-1178265e0a47 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:37.231983 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3278e9-8e7a-4eaa-9c0d-1178265e0a47 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:37.232169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3278e9-8e7a-4eaa-9c0d-1178265e0a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:37.301644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-1c3278e9-8e7a-4eaa-9c0d-1178265e0a47 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:37.302859 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-1c3278e9-8e7a-4eaa-9c0d-1178265e0a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:37.309723 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:37.415443 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 526/1053] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:28:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:37.707714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b1acf-449c-4a55-8fd8-728f34df788b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:28:37.709362 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-365b1acf-449c-4a55-8fd8-728f34df788b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:37.777495 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:37.873651 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b1acf-449c-4a55-8fd8-728f34df788b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:28:37.999287 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b186e59-8eb7-4532-9c4a-99ef8e9df393 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:28:38.000341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b186e59-8eb7-4532-9c4a-99ef8e9df393 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:38.000778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b186e59-8eb7-4532-9c4a-99ef8e9df393 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:38.001207 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b186e59-8eb7-4532-9c4a-99ef8e9df393 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:38.002942 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9b186e59-8eb7-4532-9c4a-99ef8e9df393 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:38.023401 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:38.103086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b186e59-8eb7-4532-9c4a-99ef8e9df393 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:28:38.104736 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b186e59-8eb7-4532-9c4a-99ef8e9df393 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:28:38.126128 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 528/1054] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:28:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:28:40.355586 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a901c0d-2827-476c-a129-d82c5d887b94 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:40.356043 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a901c0d-2827-476c-a129-d82c5d887b94 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:40.356552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a901c0d-2827-476c-a129-d82c5d887b94 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:40.359263 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 527/1055] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:28:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:40.364548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88407e-a381-4b7c-8193-ff341f4599a2 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:40.364990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88407e-a381-4b7c-8193-ff341f4599a2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:40.365171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88407e-a381-4b7c-8193-ff341f4599a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:40.439460 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0a88407e-a381-4b7c-8193-ff341f4599a2 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:40.440572 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0a88407e-a381-4b7c-8193-ff341f4599a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:40.537120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:40.551077 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 529/1056] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:28:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:40.842907 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a901c0d-2827-476c-a129-d82c5d887b94 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:28:40.844458 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0a901c0d-2827-476c-a129-d82c5d887b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:40.985963 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:40.996899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a901c0d-2827-476c-a129-d82c5d887b94 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:28:41.143732 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3bab3-e2c0-46cc-8b91-76201150d1a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:28:41.144475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3bab3-e2c0-46cc-8b91-76201150d1a8 service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:41.144832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3bab3-e2c0-46cc-8b91-76201150d1a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:41.145188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3bab3-e2c0-46cc-8b91-76201150d1a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:41.147272 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b2e3bab3-e2c0-46cc-8b91-76201150d1a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:41.258304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3bab3-e2c0-46cc-8b91-76201150d1a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:28:41.259930 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3bab3-e2c0-46cc-8b91-76201150d1a8 service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:28:41.272445 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:41.281661 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 528/1057] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:28:43.538874 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aae42e-6da1-4a9a-aab3-447200c6240e None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:43.539492 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aae42e-6da1-4a9a-aab3-447200c6240e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:43.539632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aae42e-6da1-4a9a-aab3-447200c6240e None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:43.541445 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 530/1058] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:43.547917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329b4e7-7f43-42b0-a83f-3aa580db6baa None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:43.548364 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329b4e7-7f43-42b0-a83f-3aa580db6baa None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:43.548648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329b4e7-7f43-42b0-a83f-3aa580db6baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:43.627899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-6329b4e7-7f43-42b0-a83f-3aa580db6baa None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:43.629149 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6329b4e7-7f43-42b0-a83f-3aa580db6baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:43.747627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 529/1059] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:28:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:44.118515 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aae42e-6da1-4a9a-aab3-447200c6240e None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:28:44.120467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-64aae42e-6da1-4a9a-aab3-447200c6240e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:44.285061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aae42e-6da1-4a9a-aab3-447200c6240e None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:28:44.352693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:44.410333 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd47c8-723a-4e25-a507-365e87420e91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:28:44.411199 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd47c8-723a-4e25-a507-365e87420e91 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:44.411558 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd47c8-723a-4e25-a507-365e87420e91 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:44.412078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd47c8-723a-4e25-a507-365e87420e91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:44.414055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-76cd47c8-723a-4e25-a507-365e87420e91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:44.509269 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd47c8-723a-4e25-a507-365e87420e91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:28:44.510922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd47c8-723a-4e25-a507-365e87420e91 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:28:44.530210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 531/1060] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:28:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:28:47.146391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970057c0-d62c-46e4-9d43-57e87192adb7 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:47.147044 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970057c0-d62c-46e4-9d43-57e87192adb7 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:47.147044 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970057c0-d62c-46e4-9d43-57e87192adb7 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:47.148401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 530/1061] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:47.154525 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0505a9-c445-4e3c-8052-017c728c8f0c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:47.154937 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0505a9-c445-4e3c-8052-017c728c8f0c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:47.155078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0505a9-c445-4e3c-8052-017c728c8f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:47.225555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-8d0505a9-c445-4e3c-8052-017c728c8f0c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:47.227137 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8d0505a9-c445-4e3c-8052-017c728c8f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:47.266034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:47.337090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 532/1062] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:47.629295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970057c0-d62c-46e4-9d43-57e87192adb7 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:28:47.630828 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-970057c0-d62c-46e4-9d43-57e87192adb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:47.709305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:47.780919 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970057c0-d62c-46e4-9d43-57e87192adb7 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:28:47.899389 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a518fa8-885c-4dbf-95ff-059c293bf63f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:28:47.899997 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a518fa8-885c-4dbf-95ff-059c293bf63f service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:47.900296 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a518fa8-885c-4dbf-95ff-059c293bf63f service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:47.900548 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a518fa8-885c-4dbf-95ff-059c293bf63f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:47.902119 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-1a518fa8-885c-4dbf-95ff-059c293bf63f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:47.942671 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:47.994598 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a518fa8-885c-4dbf-95ff-059c293bf63f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:28:47.996222 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a518fa8-885c-4dbf-95ff-059c293bf63f service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:28:48.015022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 531/1063] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:28:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:28:49.415450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f311ad7-e5ae-499a-9e3a-ab18bf56fd79 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:49.415979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f311ad7-e5ae-499a-9e3a-ab18bf56fd79 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:49.415979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f311ad7-e5ae-499a-9e3a-ab18bf56fd79 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:49.417346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 533/1064] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:49.423395 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451db59-cc30-4214-990c-98a3216fcfec None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:49.423839 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451db59-cc30-4214-990c-98a3216fcfec None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:49.423933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451db59-cc30-4214-990c-98a3216fcfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:49.494442 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-6451db59-cc30-4214-990c-98a3216fcfec None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:49.495613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6451db59-cc30-4214-990c-98a3216fcfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:49.598187 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 532/1065] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:28:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:49.897843 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e8663-df00-470b-9d2d-3f92ef3d5149 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:49.898257 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e8663-df00-470b-9d2d-3f92ef3d5149 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:49.898598 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e8663-df00-470b-9d2d-3f92ef3d5149 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:49.900102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 534/1066] 10.222.0.36 () {54 vars in 962 bytes} [Thu Oct 20 13:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:49.905849 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12749d70-0977-4bf0-bbb5-1a9d1a4dfb3d None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:49.906134 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12749d70-0977-4bf0-bbb5-1a9d1a4dfb3d None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:49.906404 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12749d70-0977-4bf0-bbb5-1a9d1a4dfb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:49.923010 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:49.992443 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-12749d70-0977-4bf0-bbb5-1a9d1a4dfb3d None None] MFA Rules not processed for user `7d026ec6ed344404a5ebe4352792cc1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:49.993650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-12749d70-0977-4bf0-bbb5-1a9d1a4dfb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:50.069858 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 533/1067] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Oct 20 13:28:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:50.079523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e8663-df00-470b-9d2d-3f92ef3d5149 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:28:50.081089 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3e2e8663-df00-470b-9d2d-3f92ef3d5149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:50.192853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e8663-df00-470b-9d2d-3f92ef3d5149 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:28:50.220827 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd559e42-a7c2-4e34-a89b-a73ef45f60d9 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:50.221114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd559e42-a7c2-4e34-a89b-a73ef45f60d9 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:50.221392 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd559e42-a7c2-4e34-a89b-a73ef45f60d9 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:50.222731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 534/1068] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:28:50.227826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5638f9-0209-45c1-bfd2-8868ca66c3d3 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:50.228105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5638f9-0209-45c1-bfd2-8868ca66c3d3 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:50.228485 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5638f9-0209-45c1-bfd2-8868ca66c3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:50.256873 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:50.272537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909c72d-6db1-4746-96e8-2a3f4eaeea8e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d026ec6ed344404a5ebe4352792cc1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:28:50.273146 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909c72d-6db1-4746-96e8-2a3f4eaeea8e service glance] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:50.273420 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909c72d-6db1-4746-96e8-2a3f4eaeea8e service glance] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:50.273687 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909c72d-6db1-4746-96e8-2a3f4eaeea8e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:50.275303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9909c72d-6db1-4746-96e8-2a3f4eaeea8e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:50.296347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-3f5638f9-0209-45c1-bfd2-8868ca66c3d3 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:50.297523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-3f5638f9-0209-45c1-bfd2-8868ca66c3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:50.354435 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:50.389446 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909c72d-6db1-4746-96e8-2a3f4eaeea8e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:28:50.391287 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909c72d-6db1-4746-96e8-2a3f4eaeea8e service glance] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:28:50.398867 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 535/1069] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:28:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:28:50.411404 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 535/1070] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:28:50.696440 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5638f9-0209-45c1-bfd2-8868ca66c3d3 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:28:50.697683 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-3f5638f9-0209-45c1-bfd2-8868ca66c3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:50.830009 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5638f9-0209-45c1-bfd2-8868ca66c3d3 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:28:50.904964 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:50.956222 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751ad70-5b6b-459e-8ac9-99189114a797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:28:50.956832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751ad70-5b6b-459e-8ac9-99189114a797 service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:50.957105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751ad70-5b6b-459e-8ac9-99189114a797 service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:50.957369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751ad70-5b6b-459e-8ac9-99189114a797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:50.958965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-2751ad70-5b6b-459e-8ac9-99189114a797 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:51.061350 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751ad70-5b6b-459e-8ac9-99189114a797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:28:51.062935 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751ad70-5b6b-459e-8ac9-99189114a797 service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:28:51.081937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 536/1071] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:28:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:28:51.160344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313d3b9-a1c9-43c3-8563-93f5c5919dc8 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:51.160852 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313d3b9-a1c9-43c3-8563-93f5c5919dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:51.160955 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313d3b9-a1c9-43c3-8563-93f5c5919dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:51.237931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c313d3b9-a1c9-43c3-8563-93f5c5919dc8 None None] MFA Rules not processed for user `44342daa668c4516ae131d9f0160261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:51.239237 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c313d3b9-a1c9-43c3-8563-93f5c5919dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:51.285205 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:51.336390 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 536/1072] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Oct 20 13:28:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:51.384240 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b4528-2399-40d2-b7d5-7932d1d99666 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:51.384523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b4528-2399-40d2-b7d5-7932d1d99666 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:51.384798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b4528-2399-40d2-b7d5-7932d1d99666 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:51.386151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 537/1073] 10.222.0.36 () {54 vars in 943 bytes} [Thu Oct 20 13:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:51.392633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053268bb-0ad4-47a6-81d4-c52962c3de07 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:51.392923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053268bb-0ad4-47a6-81d4-c52962c3de07 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:51.393206 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053268bb-0ad4-47a6-81d4-c52962c3de07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:51.471714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-053268bb-0ad4-47a6-81d4-c52962c3de07 None None] MFA Rules not processed for user `c893e6388ed340eca17da2e279ca34a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:51.472931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-053268bb-0ad4-47a6-81d4-c52962c3de07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:51.581033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 537/1074] 10.222.0.36 () {58 vars in 1040 bytes} [Thu Oct 20 13:28:51 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:51.590561 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b4528-2399-40d2-b7d5-7932d1d99666 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:28:51.592882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d64b4528-2399-40d2-b7d5-7932d1d99666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:51.672289 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:51.729371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b4528-2399-40d2-b7d5-7932d1d99666 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:28:51.835902 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833eb16-aefb-4491-9f79-bff5529ee329 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c893e6388ed340eca17da2e279ca34a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:28:51.836511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833eb16-aefb-4491-9f79-bff5529ee329 service swift] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:51.836793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833eb16-aefb-4491-9f79-bff5529ee329 service swift] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:51.837066 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833eb16-aefb-4491-9f79-bff5529ee329 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:51.838744 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-1833eb16-aefb-4491-9f79-bff5529ee329 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:51.906985 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:51.927108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833eb16-aefb-4491-9f79-bff5529ee329 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:28:51.928688 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833eb16-aefb-4491-9f79-bff5529ee329 service swift] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:28:51.937386 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 538/1075] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Oct 20 13:28:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 13:28:53.300488 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613c9af-0e56-42b4-b3ca-31c77c13af84 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:53.301043 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613c9af-0e56-42b4-b3ca-31c77c13af84 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:53.301043 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613c9af-0e56-42b4-b3ca-31c77c13af84 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:53.302354 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 538/1076] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:53.307611 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004a1ec-be3a-4f9d-b206-d6005c7e1362 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:53.308035 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004a1ec-be3a-4f9d-b206-d6005c7e1362 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:53.308191 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004a1ec-be3a-4f9d-b206-d6005c7e1362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:53.378763 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-6004a1ec-be3a-4f9d-b206-d6005c7e1362 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:53.383112 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6004a1ec-be3a-4f9d-b206-d6005c7e1362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:53.489513 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 539/1077] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:53.795467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613c9af-0e56-42b4-b3ca-31c77c13af84 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:28:53.796978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d613c9af-0e56-42b4-b3ca-31c77c13af84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:53.810836 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:53.965131 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613c9af-0e56-42b4-b3ca-31c77c13af84 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:28:54.062269 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:54.094225 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9791b2b-38dd-4fa9-9b85-b28a41236150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:28:54.094862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9791b2b-38dd-4fa9-9b85-b28a41236150 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:54.095196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9791b2b-38dd-4fa9-9b85-b28a41236150 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:54.095467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9791b2b-38dd-4fa9-9b85-b28a41236150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:54.097058 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e9791b2b-38dd-4fa9-9b85-b28a41236150 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:54.197682 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9791b2b-38dd-4fa9-9b85-b28a41236150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:28:54.199431 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9791b2b-38dd-4fa9-9b85-b28a41236150 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:28:54.227359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 539/1078] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:28:56.449420 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e7be3-1b27-458a-8537-b8b170cf589a None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:56.450587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e7be3-1b27-458a-8537-b8b170cf589a None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:56.450587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e7be3-1b27-458a-8537-b8b170cf589a None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:56.452931 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 540/1079] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:28:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:56.458258 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bea72-cfd1-4d1c-88fc-31d40be06bb3 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:56.458681 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bea72-cfd1-4d1c-88fc-31d40be06bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:56.458860 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bea72-cfd1-4d1c-88fc-31d40be06bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:56.529827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-346bea72-cfd1-4d1c-88fc-31d40be06bb3 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:56.531160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-346bea72-cfd1-4d1c-88fc-31d40be06bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:56.584966 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:56.640545 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 540/1080] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:28:56.939736 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e7be3-1b27-458a-8537-b8b170cf589a None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:28:56.941357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-698e7be3-1b27-458a-8537-b8b170cf589a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:57.009135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:57.107356 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e7be3-1b27-458a-8537-b8b170cf589a None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:28:57.256529 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40865f1c-9993-4b8b-9329-90b88e571b29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:28:57.257172 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40865f1c-9993-4b8b-9329-90b88e571b29 service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:57.257447 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40865f1c-9993-4b8b-9329-90b88e571b29 service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:57.257719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40865f1c-9993-4b8b-9329-90b88e571b29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:57.259353 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-40865f1c-9993-4b8b-9329-90b88e571b29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:57.280974 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:57.369272 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40865f1c-9993-4b8b-9329-90b88e571b29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:28:57.370900 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40865f1c-9993-4b8b-9329-90b88e571b29 service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:28:57.393698 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 541/1081] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:28:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:28:59.650718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578ed54-7a13-429e-ad81-1517b30ceb8b None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:59.651344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578ed54-7a13-429e-ad81-1517b30ceb8b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:59.651344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578ed54-7a13-429e-ad81-1517b30ceb8b None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:59.657283 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 541/1082] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:28:59.658990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea74e5-29b2-4453-8c87-b90a697da088 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:28:59.659436 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea74e5-29b2-4453-8c87-b90a697da088 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:28:59.659605 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea74e5-29b2-4453-8c87-b90a697da088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:28:59.733541 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-50ea74e5-29b2-4453-8c87-b90a697da088 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:28:59.734874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-50ea74e5-29b2-4453-8c87-b90a697da088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:28:59.842040 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:28:59.848899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 542/1083] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:00.145383 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578ed54-7a13-429e-ad81-1517b30ceb8b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:00.147157 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e578ed54-7a13-429e-ad81-1517b30ceb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:00.316117 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578ed54-7a13-429e-ad81-1517b30ceb8b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:00.353972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:00.443737 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eda489-042e-4975-8e08-75bcf309c7a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:00.444254 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eda489-042e-4975-8e08-75bcf309c7a7 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:00.444531 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eda489-042e-4975-8e08-75bcf309c7a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:00.444802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eda489-042e-4975-8e08-75bcf309c7a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:00.446412 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c3eda489-042e-4975-8e08-75bcf309c7a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:00.544999 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eda489-042e-4975-8e08-75bcf309c7a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:00.546605 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eda489-042e-4975-8e08-75bcf309c7a7 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:00.568021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 542/1084] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:09.847257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:10.563617 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=83 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:14.638687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d045908-1407-4f55-9fd0-a30e55f91864 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:14.639286 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d045908-1407-4f55-9fd0-a30e55f91864 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:14.639286 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d045908-1407-4f55-9fd0-a30e55f91864 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:14.640645 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 543/1085] 10.222.0.36 () {54 vars in 918 bytes} [Thu Oct 20 13:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:14.645857 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5a758-ed48-479f-b7e7-c164e714c2ee None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:14.646257 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5a758-ed48-479f-b7e7-c164e714c2ee None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:14.646400 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5a758-ed48-479f-b7e7-c164e714c2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:14.722831 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-aad5a758-ed48-479f-b7e7-c164e714c2ee None None] MFA Rules not processed for user `a00f0b4cee8d49a48a95317aec9f647c`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:14.724090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-aad5a758-ed48-479f-b7e7-c164e714c2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:14.830631 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 543/1086] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Oct 20 13:29:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:14.845421 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98185a-7262-4a86-9fd8-a53382fd60b3 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:14.845698 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98185a-7262-4a86-9fd8-a53382fd60b3 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:14.845971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98185a-7262-4a86-9fd8-a53382fd60b3 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:14.847333 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 544/1087] 10.222.0.36 () {54 vars in 918 bytes} [Thu Oct 20 13:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:14.851942 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a06db-1fa9-448f-b153-8b902f95809b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:14.852229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a06db-1fa9-448f-b153-8b902f95809b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:14.852503 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a06db-1fa9-448f-b153-8b902f95809b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:14.926335 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:14.928947 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-4f7a06db-1fa9-448f-b153-8b902f95809b None None] MFA Rules not processed for user `674c5b25932a41309428ba6c6c72ed02`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:14.930701 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-4f7a06db-1fa9-448f-b153-8b902f95809b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:15.043316 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 544/1088] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Oct 20 13:29:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:17.636796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c0cbf-e03a-4c20-890a-736195b706a7 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:17.637370 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c0cbf-e03a-4c20-890a-736195b706a7 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:17.637370 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c0cbf-e03a-4c20-890a-736195b706a7 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:17.639373 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 545/1089] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 13:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:17.644848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983752d-a7df-4a57-a054-eb2f6610407a None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:17.645294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983752d-a7df-4a57-a054-eb2f6610407a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:17.645391 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983752d-a7df-4a57-a054-eb2f6610407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:17.722977 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0983752d-a7df-4a57-a054-eb2f6610407a None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:17.724214 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0983752d-a7df-4a57-a054-eb2f6610407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:17.781547 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:17.831400 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 545/1090] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 13:29:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:29:18.135750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c0cbf-e03a-4c20-890a-736195b706a7 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:18.137466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-cc5c0cbf-e03a-4c20-890a-736195b706a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:18.284270 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c0cbf-e03a-4c20-890a-736195b706a7 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:18.355788 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:18.395504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aaf2e9-44db-41ab-ba82-9ad23a924a29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:18.396030 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaf2e9-44db-41ab-ba82-9ad23a924a29 service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:18.396302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaf2e9-44db-41ab-ba82-9ad23a924a29 service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:18.396570 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aaf2e9-44db-41ab-ba82-9ad23a924a29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:18.398221 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d1aaf2e9-44db-41ab-ba82-9ad23a924a29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:18.486028 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aaf2e9-44db-41ab-ba82-9ad23a924a29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:18.487647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aaf2e9-44db-41ab-ba82-9ad23a924a29 service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:18.505664 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 546/1091] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:19.642873 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe019d-4284-410c-ba46-d675318f1fa6 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:19.643492 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe019d-4284-410c-ba46-d675318f1fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:19.643492 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe019d-4284-410c-ba46-d675318f1fa6 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:19.644766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 546/1092] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 13:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:19.651393 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e16405-8c88-40b4-b224-182d2aeb916f None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:19.651853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e16405-8c88-40b4-b224-182d2aeb916f None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:19.651961 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e16405-8c88-40b4-b224-182d2aeb916f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:19.728676 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-03e16405-8c88-40b4-b224-182d2aeb916f None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:19.730409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-03e16405-8c88-40b4-b224-182d2aeb916f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:19.757025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:19.827193 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 547/1093] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 13:29:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:19.977599 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe019d-4284-410c-ba46-d675318f1fa6 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:19.979056 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-65fe019d-4284-410c-ba46-d675318f1fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:20.122380 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe019d-4284-410c-ba46-d675318f1fa6 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:20.162574 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:20.233467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106625ca-8161-43a1-9277-20496fd555a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:20.233976 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106625ca-8161-43a1-9277-20496fd555a0 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:20.234248 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106625ca-8161-43a1-9277-20496fd555a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:20.234512 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106625ca-8161-43a1-9277-20496fd555a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:20.236107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-106625ca-8161-43a1-9277-20496fd555a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:20.323284 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106625ca-8161-43a1-9277-20496fd555a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:20.325346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106625ca-8161-43a1-9277-20496fd555a0 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:20.343404 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 547/1094] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:21.465075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19896456-a5d6-4ccd-b40c-4b2d003d10a0 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:21.465594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19896456-a5d6-4ccd-b40c-4b2d003d10a0 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:21.465594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19896456-a5d6-4ccd-b40c-4b2d003d10a0 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:21.466887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 548/1095] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 13:29:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:21.473221 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9d16b-84e7-4fb2-993f-930cdddbc3e2 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:21.473677 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9d16b-84e7-4fb2-993f-930cdddbc3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:21.473774 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9d16b-84e7-4fb2-993f-930cdddbc3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:21.527727 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:21.549349 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-aff9d16b-84e7-4fb2-993f-930cdddbc3e2 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:21.550537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-aff9d16b-84e7-4fb2-993f-930cdddbc3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:21.646544 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 548/1096] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 13:29:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:21.798988 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19896456-a5d6-4ccd-b40c-4b2d003d10a0 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:21.800518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-19896456-a5d6-4ccd-b40c-4b2d003d10a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:21.947651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19896456-a5d6-4ccd-b40c-4b2d003d10a0 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:21.960557 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:22.061603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ec170-a56c-4a1a-9ea8-956e7b0cc551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:22.062138 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ec170-a56c-4a1a-9ea8-956e7b0cc551 service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:22.062415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ec170-a56c-4a1a-9ea8-956e7b0cc551 service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:22.062686 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ec170-a56c-4a1a-9ea8-956e7b0cc551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:22.064299 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-f08ec170-a56c-4a1a-9ea8-956e7b0cc551 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:22.151470 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ec170-a56c-4a1a-9ea8-956e7b0cc551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:22.153077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08ec170-a56c-4a1a-9ea8-956e7b0cc551 service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:22.170941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 549/1097] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:23.279942 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec8932-9466-42f9-98d2-c87a01ef3ffc None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:23.280501 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec8932-9466-42f9-98d2-c87a01ef3ffc None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:23.280501 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec8932-9466-42f9-98d2-c87a01ef3ffc None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:23.282128 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 549/1098] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 13:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:23.288267 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221342f-0e4a-46c8-9afd-c9d233bf930b None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:23.288724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221342f-0e4a-46c8-9afd-c9d233bf930b None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:23.288822 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221342f-0e4a-46c8-9afd-c9d233bf930b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:23.309277 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:23.365973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-b221342f-0e4a-46c8-9afd-c9d233bf930b None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:23.367228 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b221342f-0e4a-46c8-9afd-c9d233bf930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:23.460966 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 550/1099] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 13:29:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:23.612344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec8932-9466-42f9-98d2-c87a01ef3ffc None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:23.613807 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-52ec8932-9466-42f9-98d2-c87a01ef3ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:23.730547 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:23.766095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec8932-9466-42f9-98d2-c87a01ef3ffc None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:23.877587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249788b-2dec-4066-8f40-6b9983de4b8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:23.878223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249788b-2dec-4066-8f40-6b9983de4b8f service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:23.878521 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249788b-2dec-4066-8f40-6b9983de4b8f service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:23.878787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249788b-2dec-4066-8f40-6b9983de4b8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:23.880490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e249788b-2dec-4066-8f40-6b9983de4b8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:23.958038 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:23.971529 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249788b-2dec-4066-8f40-6b9983de4b8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:23.973159 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249788b-2dec-4066-8f40-6b9983de4b8f service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:23.991309 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 550/1100] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:25.114431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb85407-c857-47eb-a38f-a4bf13105585 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:25.114940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb85407-c857-47eb-a38f-a4bf13105585 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:25.115085 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb85407-c857-47eb-a38f-a4bf13105585 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:25.116341 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 551/1101] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 13:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:25.123239 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54213450-dc11-4984-bb5e-829a0abdc8f1 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:25.123664 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54213450-dc11-4984-bb5e-829a0abdc8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:25.123766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54213450-dc11-4984-bb5e-829a0abdc8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:25.198835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-54213450-dc11-4984-bb5e-829a0abdc8f1 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:25.200150 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-54213450-dc11-4984-bb5e-829a0abdc8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:25.295371 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 551/1102] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 13:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:25.447172 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb85407-c857-47eb-a38f-a4bf13105585 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:25.449215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-dfb85407-c857-47eb-a38f-a4bf13105585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:25.532725 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:25.595727 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb85407-c857-47eb-a38f-a4bf13105585 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:25.712460 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d269dd-b6f6-420b-9006-5bd80539adeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:25.712990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d269dd-b6f6-420b-9006-5bd80539adeb service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:25.713269 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d269dd-b6f6-420b-9006-5bd80539adeb service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:25.713542 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d269dd-b6f6-420b-9006-5bd80539adeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:25.715453 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-97d269dd-b6f6-420b-9006-5bd80539adeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:25.763934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:25.808137 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d269dd-b6f6-420b-9006-5bd80539adeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:25.809740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d269dd-b6f6-420b-9006-5bd80539adeb service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:25.828421 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 552/1103] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:26.884929 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1cf02-2525-4f7c-b394-b9cf9c7ad5c2 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:26.885420 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1cf02-2525-4f7c-b394-b9cf9c7ad5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:26.886039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1cf02-2525-4f7c-b394-b9cf9c7ad5c2 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:26.887518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 552/1104] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 13:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:26.893831 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d0fa0-f99e-43e7-b790-1ba17a157012 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:26.894302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d0fa0-f99e-43e7-b790-1ba17a157012 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:26.894416 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d0fa0-f99e-43e7-b790-1ba17a157012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:26.970550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-cc7d0fa0-f99e-43e7-b790-1ba17a157012 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:26.971703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-cc7d0fa0-f99e-43e7-b790-1ba17a157012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:27.067629 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 553/1105] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 13:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:27.222905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1cf02-2525-4f7c-b394-b9cf9c7ad5c2 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:27.224469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6df1cf02-2525-4f7c-b394-b9cf9c7ad5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:27.273701 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:27.372591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1cf02-2525-4f7c-b394-b9cf9c7ad5c2 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:27.484955 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928bd80f-86d4-41cd-aac0-bb0328bb2aff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:27.485470 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bd80f-86d4-41cd-aac0-bb0328bb2aff service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:27.485741 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bd80f-86d4-41cd-aac0-bb0328bb2aff service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:27.486007 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928bd80f-86d4-41cd-aac0-bb0328bb2aff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:27.487608 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-928bd80f-86d4-41cd-aac0-bb0328bb2aff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:27.494329 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:27.578120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928bd80f-86d4-41cd-aac0-bb0328bb2aff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:27.579745 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928bd80f-86d4-41cd-aac0-bb0328bb2aff service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:27.597766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 553/1106] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:28.649761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff52e0-96a6-4331-836f-be3ee4704a61 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:28.650346 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff52e0-96a6-4331-836f-be3ee4704a61 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:28.650346 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff52e0-96a6-4331-836f-be3ee4704a61 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:28.652344 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 554/1107] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 13:29:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:28.658812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaef424-e780-48a2-8457-2e6e181847e1 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:28.659295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaef424-e780-48a2-8457-2e6e181847e1 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:28.659452 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaef424-e780-48a2-8457-2e6e181847e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:28.734206 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-afaef424-e780-48a2-8457-2e6e181847e1 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:28.735428 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-afaef424-e780-48a2-8457-2e6e181847e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:28.802473 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:28.831858 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 554/1108] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 13:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:28.981055 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff52e0-96a6-4331-836f-be3ee4704a61 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:28.982514 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-16ff52e0-96a6-4331-836f-be3ee4704a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:29.000461 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:29.127236 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff52e0-96a6-4331-836f-be3ee4704a61 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:29.213117 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:29.239375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9347a8-3a38-4c99-8516-faba8463e21a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:29.245395 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9347a8-3a38-4c99-8516-faba8463e21a service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:29.245395 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9347a8-3a38-4c99-8516-faba8463e21a service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:29.245395 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9347a8-3a38-4c99-8516-faba8463e21a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:29.245798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-1d9347a8-3a38-4c99-8516-faba8463e21a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:29.335099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9347a8-3a38-4c99-8516-faba8463e21a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:29.336668 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9347a8-3a38-4c99-8516-faba8463e21a service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:29.354823 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 555/1109] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:30.423210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b6b1-38a5-448b-89af-71558a2e620f None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:30.423792 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b6b1-38a5-448b-89af-71558a2e620f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:30.423792 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b6b1-38a5-448b-89af-71558a2e620f None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:30.425159 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 555/1110] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 13:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:29:30.431379 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02554dd-896e-4e57-a557-b452902af770 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:30.431843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02554dd-896e-4e57-a557-b452902af770 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:30.431952 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02554dd-896e-4e57-a557-b452902af770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:30.506660 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-e02554dd-896e-4e57-a557-b452902af770 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:30.507873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e02554dd-896e-4e57-a557-b452902af770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:30.548767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:30.603282 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 556/1111] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 13:29:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:30.754688 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077b6b1-38a5-448b-89af-71558a2e620f None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:30.756168 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c077b6b1-38a5-448b-89af-71558a2e620f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:30.901595 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077b6b1-38a5-448b-89af-71558a2e620f None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:30.955465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:31.013874 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa22506-9cf7-4aae-a0e1-681d4961f3d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:31.014406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa22506-9cf7-4aae-a0e1-681d4961f3d4 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:31.014680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa22506-9cf7-4aae-a0e1-681d4961f3d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:31.014965 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa22506-9cf7-4aae-a0e1-681d4961f3d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:31.016559 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-4aa22506-9cf7-4aae-a0e1-681d4961f3d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:31.105425 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa22506-9cf7-4aae-a0e1-681d4961f3d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:31.107031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa22506-9cf7-4aae-a0e1-681d4961f3d4 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:31.126385 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 556/1112] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:32.188261 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35daf2d2-6c63-43b9-94d9-664f96304dd8 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:32.188786 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35daf2d2-6c63-43b9-94d9-664f96304dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:32.188786 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35daf2d2-6c63-43b9-94d9-664f96304dd8 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:32.190109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 557/1113] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 13:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:32.196382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9392e-55ab-42ca-b074-c4cc7eea07d2 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:32.196803 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9392e-55ab-42ca-b074-c4cc7eea07d2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:32.196949 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9392e-55ab-42ca-b074-c4cc7eea07d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:32.272590 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-49a9392e-55ab-42ca-b074-c4cc7eea07d2 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:32.273792 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-49a9392e-55ab-42ca-b074-c4cc7eea07d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:32.275825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:32.370623 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 557/1114] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 13:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:32.519941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35daf2d2-6c63-43b9-94d9-664f96304dd8 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:32.521416 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-35daf2d2-6c63-43b9-94d9-664f96304dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:32.669244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35daf2d2-6c63-43b9-94d9-664f96304dd8 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:32.696141 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:32.782548 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da79d09-ceed-4c0b-9ac8-2a215bc64101 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:32.783185 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da79d09-ceed-4c0b-9ac8-2a215bc64101 service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:32.783466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da79d09-ceed-4c0b-9ac8-2a215bc64101 service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:32.783734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da79d09-ceed-4c0b-9ac8-2a215bc64101 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:32.785330 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0da79d09-ceed-4c0b-9ac8-2a215bc64101 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:32.874970 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da79d09-ceed-4c0b-9ac8-2a215bc64101 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:32.876576 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da79d09-ceed-4c0b-9ac8-2a215bc64101 service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:32.894541 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 558/1115] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:34.957481 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753e74c-c68f-4c7c-943a-059371e4d559 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:34.958013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753e74c-c68f-4c7c-943a-059371e4d559 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:34.958132 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753e74c-c68f-4c7c-943a-059371e4d559 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:34.959470 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 558/1116] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 13:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:34.965545 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ebd79-66b5-4490-b27d-3aa1173c5c81 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:34.966017 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ebd79-66b5-4490-b27d-3aa1173c5c81 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:34.966116 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1ebd79-66b5-4490-b27d-3aa1173c5c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:35.006700 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:35.032827 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-bd1ebd79-66b5-4490-b27d-3aa1173c5c81 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:35.034037 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-bd1ebd79-66b5-4490-b27d-3aa1173c5c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:35.130285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 559/1117] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 13:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:35.423687 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753e74c-c68f-4c7c-943a-059371e4d559 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:35.425266 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0753e74c-c68f-4c7c-943a-059371e4d559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:35.528638 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753e74c-c68f-4c7c-943a-059371e4d559 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:35.561145 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:35.601762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf45b4-b62d-4273-be87-f334e420d41d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:35.602359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf45b4-b62d-4273-be87-f334e420d41d service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:35.602656 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf45b4-b62d-4273-be87-f334e420d41d service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:35.602925 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf45b4-b62d-4273-be87-f334e420d41d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:35.604531 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2adf45b4-b62d-4273-be87-f334e420d41d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:35.714265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf45b4-b62d-4273-be87-f334e420d41d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:35.715652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf45b4-b62d-4273-be87-f334e420d41d service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:35.733092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 559/1118] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:38.023787 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8393cd-5004-4842-81c1-525687a2ae04 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:38.024375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8393cd-5004-4842-81c1-525687a2ae04 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:38.024375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8393cd-5004-4842-81c1-525687a2ae04 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:38.025686 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 560/1119] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 13:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:38.031886 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ee40e-ff79-46cf-b1b4-c1953e3700ec None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:38.032336 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ee40e-ff79-46cf-b1b4-c1953e3700ec None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:38.032458 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ee40e-ff79-46cf-b1b4-c1953e3700ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:38.097727 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-686ee40e-ff79-46cf-b1b4-c1953e3700ec None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:38.098925 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-686ee40e-ff79-46cf-b1b4-c1953e3700ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:38.112240 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:38.195624 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 560/1120] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 13:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:38.477642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8393cd-5004-4842-81c1-525687a2ae04 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:38.479209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-3f8393cd-5004-4842-81c1-525687a2ae04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:38.583336 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8393cd-5004-4842-81c1-525687a2ae04 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:38.596210 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:38.657931 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb68c6-f85e-44a0-827e-169c9e84250f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:38.658556 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb68c6-f85e-44a0-827e-169c9e84250f service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:38.658816 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb68c6-f85e-44a0-827e-169c9e84250f service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:38.659124 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb68c6-f85e-44a0-827e-169c9e84250f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:38.660722 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-eadb68c6-f85e-44a0-827e-169c9e84250f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:38.769378 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb68c6-f85e-44a0-827e-169c9e84250f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:38.770747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb68c6-f85e-44a0-827e-169c9e84250f service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:38.788873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 561/1121] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:41.270906 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00063d3-1918-42b9-ab8f-181926d8cb4d None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:41.271475 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00063d3-1918-42b9-ab8f-181926d8cb4d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:41.271577 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00063d3-1918-42b9-ab8f-181926d8cb4d None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:41.272857 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 561/1122] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 13:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:41.278816 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5682d8-f5f7-4c80-9d76-92621b953d13 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:41.279298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5682d8-f5f7-4c80-9d76-92621b953d13 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:41.279411 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5682d8-f5f7-4c80-9d76-92621b953d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:41.327273 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:41.345788 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-5a5682d8-f5f7-4c80-9d76-92621b953d13 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:41.347006 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-5a5682d8-f5f7-4c80-9d76-92621b953d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:41.441545 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 562/1123] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 13:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:41.726648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00063d3-1918-42b9-ab8f-181926d8cb4d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:41.728229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e00063d3-1918-42b9-ab8f-181926d8cb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:41.830853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00063d3-1918-42b9-ab8f-181926d8cb4d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:41.871624 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:41.906779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c9e41-765a-412b-8213-2f7466abea9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:41.907673 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c9e41-765a-412b-8213-2f7466abea9e service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:41.907947 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c9e41-765a-412b-8213-2f7466abea9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:41.908217 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c9e41-765a-412b-8213-2f7466abea9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:41.909773 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-476c9e41-765a-412b-8213-2f7466abea9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:42.017130 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c9e41-765a-412b-8213-2f7466abea9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:42.018468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c9e41-765a-412b-8213-2f7466abea9e service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:42.036808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 562/1124] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:44.341263 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46105e0b-d43b-4d5e-8a8b-8e504037f644 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:44.341798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46105e0b-d43b-4d5e-8a8b-8e504037f644 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:44.341798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46105e0b-d43b-4d5e-8a8b-8e504037f644 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:44.343183 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 563/1125] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 13:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:44.348555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969d4ce-ff3a-4695-bffc-056ce4107861 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:44.349012 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969d4ce-ff3a-4695-bffc-056ce4107861 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:44.349112 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969d4ce-ff3a-4695-bffc-056ce4107861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:44.414234 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-a969d4ce-ff3a-4695-bffc-056ce4107861 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:44.415472 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a969d4ce-ff3a-4695-bffc-056ce4107861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:44.436619 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:44.512412 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 563/1126] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 13:29:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:44.798660 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46105e0b-d43b-4d5e-8a8b-8e504037f644 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:44.800214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-46105e0b-d43b-4d5e-8a8b-8e504037f644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:44.901632 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46105e0b-d43b-4d5e-8a8b-8e504037f644 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:44.922518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:44.974474 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98c809-bd86-4a84-8ce1-81e2b4938c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:44.975104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98c809-bd86-4a84-8ce1-81e2b4938c87 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:44.975409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98c809-bd86-4a84-8ce1-81e2b4938c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:44.975699 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98c809-bd86-4a84-8ce1-81e2b4938c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:44.977257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7a98c809-bd86-4a84-8ce1-81e2b4938c87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:45.085526 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98c809-bd86-4a84-8ce1-81e2b4938c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:45.086972 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98c809-bd86-4a84-8ce1-81e2b4938c87 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:45.104895 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 564/1127] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:47.383695 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912709c-022d-4104-8028-e366145f7a8f None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:47.384273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912709c-022d-4104-8028-e366145f7a8f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:47.384273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912709c-022d-4104-8028-e366145f7a8f None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:47.385579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 564/1128] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 13:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:47.391023 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490af26b-e938-4a0d-88f3-e19ffda1af6f None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:47.391451 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490af26b-e938-4a0d-88f3-e19ffda1af6f None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:47.391577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490af26b-e938-4a0d-88f3-e19ffda1af6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:47.454436 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:47.457075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-490af26b-e938-4a0d-88f3-e19ffda1af6f None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:47.458897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-490af26b-e938-4a0d-88f3-e19ffda1af6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:47.555172 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 565/1129] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 13:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:47.836040 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912709c-022d-4104-8028-e366145f7a8f None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:47.837611 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5912709c-022d-4104-8028-e366145f7a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:47.940331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912709c-022d-4104-8028-e366145f7a8f None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:47.988673 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:48.013096 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7120d4-f56e-4a92-9451-8d3bfed0ceff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:48.013718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7120d4-f56e-4a92-9451-8d3bfed0ceff service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:48.013996 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7120d4-f56e-4a92-9451-8d3bfed0ceff service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:48.014266 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7120d4-f56e-4a92-9451-8d3bfed0ceff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:48.015882 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7e7120d4-f56e-4a92-9451-8d3bfed0ceff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:48.122697 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7120d4-f56e-4a92-9451-8d3bfed0ceff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:48.124075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7120d4-f56e-4a92-9451-8d3bfed0ceff service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:48.142340 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 565/1130] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:50.321727 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501aa2d-50bb-4010-aa08-de890e496065 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:50.322289 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501aa2d-50bb-4010-aa08-de890e496065 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:50.322289 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501aa2d-50bb-4010-aa08-de890e496065 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:50.323682 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 566/1131] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 13:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:50.329257 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800e195-6ee3-4df7-afee-e6be9bb5d6f7 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:50.329661 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800e195-6ee3-4df7-afee-e6be9bb5d6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:50.329800 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800e195-6ee3-4df7-afee-e6be9bb5d6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:50.395074 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-3800e195-6ee3-4df7-afee-e6be9bb5d6f7 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:50.396284 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3800e195-6ee3-4df7-afee-e6be9bb5d6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:50.425350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:50.494115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 566/1132] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 13:29:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:50.780900 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501aa2d-50bb-4010-aa08-de890e496065 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:50.782446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8501aa2d-50bb-4010-aa08-de890e496065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:50.885657 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501aa2d-50bb-4010-aa08-de890e496065 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:50.914199 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:50.959767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f16525-ae09-45d1-b439-75d770d3e32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:50.960364 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f16525-ae09-45d1-b439-75d770d3e32a service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:50.960639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f16525-ae09-45d1-b439-75d770d3e32a service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:50.960907 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f16525-ae09-45d1-b439-75d770d3e32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:50.962472 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-76f16525-ae09-45d1-b439-75d770d3e32a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:51.070779 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f16525-ae09-45d1-b439-75d770d3e32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:51.072256 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f16525-ae09-45d1-b439-75d770d3e32a service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:51.090704 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 567/1133] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:53.259313 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8242994-3bfd-49ba-aaa5-4e2f4aa044cf None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:53.259865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8242994-3bfd-49ba-aaa5-4e2f4aa044cf None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:53.259865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8242994-3bfd-49ba-aaa5-4e2f4aa044cf None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:53.261128 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 567/1134] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 13:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:53.267350 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549afc9-37c9-4715-b9df-b1b7842d5cae None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:53.267783 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549afc9-37c9-4715-b9df-b1b7842d5cae None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:53.267899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549afc9-37c9-4715-b9df-b1b7842d5cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:53.334849 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-b549afc9-37c9-4715-b9df-b1b7842d5cae None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:53.336094 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b549afc9-37c9-4715-b9df-b1b7842d5cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:53.344925 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:53.433754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 568/1135] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 13:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:53.732723 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8c02-5bed-4e13-8b2c-bc25c6bfb461 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:53.733005 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8c02-5bed-4e13-8b2c-bc25c6bfb461 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:53.733282 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b8c02-5bed-4e13-8b2c-bc25c6bfb461 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:53.734657 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 568/1136] 10.222.0.36 () {54 vars in 964 bytes} [Thu Oct 20 13:29:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:53.740519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d91bd-20e0-40e7-94cb-08d7127df0d6 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:53.740799 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d91bd-20e0-40e7-94cb-08d7127df0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:53.741069 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d91bd-20e0-40e7-94cb-08d7127df0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:53.816363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-e68d91bd-20e0-40e7-94cb-08d7127df0d6 None None] MFA Rules not processed for user `5852ff82962e4cea85b8aa8593f09d37`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:53.817557 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e68d91bd-20e0-40e7-94cb-08d7127df0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:53.893069 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 569/1137] 10.222.0.36 () {58 vars in 1061 bytes} [Thu Oct 20 13:29:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:53.902048 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b8c02-5bed-4e13-8b2c-bc25c6bfb461 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:53.904647 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2c2b8c02-5bed-4e13-8b2c-bc25c6bfb461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:54.004989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b8c02-5bed-4e13-8b2c-bc25c6bfb461 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:54.060012 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:54.078719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d36b1b-f820-4113-b7a2-3d10d383f76e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:54.079366 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d36b1b-f820-4113-b7a2-3d10d383f76e service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:54.079643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d36b1b-f820-4113-b7a2-3d10d383f76e service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:54.079912 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d36b1b-f820-4113-b7a2-3d10d383f76e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:54.081485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b6d36b1b-f820-4113-b7a2-3d10d383f76e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:54.190703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d36b1b-f820-4113-b7a2-3d10d383f76e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:54.192130 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d36b1b-f820-4113-b7a2-3d10d383f76e service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:54.210262 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 569/1138] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:56.795333 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b828531-f13e-415b-b11c-0e0718d1664b None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:56.795946 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b828531-f13e-415b-b11c-0e0718d1664b None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:56.795946 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b828531-f13e-415b-b11c-0e0718d1664b None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:56.797264 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 570/1139] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 13:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:56.802529 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e35db4-2524-4eab-a183-eb6b8f79023f None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:56.802933 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e35db4-2524-4eab-a183-eb6b8f79023f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:56.803127 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e35db4-2524-4eab-a183-eb6b8f79023f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:56.868693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-e3e35db4-2524-4eab-a183-eb6b8f79023f None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:56.869916 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e3e35db4-2524-4eab-a183-eb6b8f79023f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:56.908297 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:56.966584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 570/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 13:29:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:29:57.252288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b828531-f13e-415b-b11c-0e0718d1664b None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:29:57.253817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0b828531-f13e-415b-b11c-0e0718d1664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:57.257703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:57.363092 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b828531-f13e-415b-b11c-0e0718d1664b None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:29:57.436800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72407f2a-2eaa-4a7d-b68f-286b874510b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:29:57.437400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72407f2a-2eaa-4a7d-b68f-286b874510b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:57.437672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72407f2a-2eaa-4a7d-b68f-286b874510b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:57.437939 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72407f2a-2eaa-4a7d-b68f-286b874510b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:57.439558 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-72407f2a-2eaa-4a7d-b68f-286b874510b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:57.497197 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:29:57.547500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72407f2a-2eaa-4a7d-b68f-286b874510b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:29:57.548958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72407f2a-2eaa-4a7d-b68f-286b874510b5 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:29:57.567111 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 571/1141] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:29:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:29:59.718420 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bfaff-1a0b-4247-9ce6-d1a30b8fd195 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:59.718931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bfaff-1a0b-4247-9ce6-d1a30b8fd195 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:59.719076 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bfaff-1a0b-4247-9ce6-d1a30b8fd195 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:59.720389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 571/1142] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 13:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:29:59.725801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938ab31-2f3f-4801-9617-e66fa18e1397 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:29:59.726220 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938ab31-2f3f-4801-9617-e66fa18e1397 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:29:59.726376 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938ab31-2f3f-4801-9617-e66fa18e1397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:29:59.791257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-9938ab31-2f3f-4801-9617-e66fa18e1397 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:29:59.792449 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9938ab31-2f3f-4801-9617-e66fa18e1397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:29:59.889798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 572/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 13:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:30:00.178783 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bfaff-1a0b-4247-9ce6-d1a30b8fd195 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:30:00.180359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1d4bfaff-1a0b-4247-9ce6-d1a30b8fd195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:00.283858 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bfaff-1a0b-4247-9ce6-d1a30b8fd195 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:30:00.349583 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:00.356559 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528bde7-6616-47ca-9ca9-14d9444255e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:30:00.357214 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528bde7-6616-47ca-9ca9-14d9444255e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:00.357569 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528bde7-6616-47ca-9ca9-14d9444255e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:00.357825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528bde7-6616-47ca-9ca9-14d9444255e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:00.359435 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8528bde7-6616-47ca-9ca9-14d9444255e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:00.468044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528bde7-6616-47ca-9ca9-14d9444255e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:30:00.469379 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528bde7-6616-47ca-9ca9-14d9444255e1 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:30:00.487248 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 572/1144] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:30:02.654220 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b4a22-3095-4e1c-98f8-1924930194da None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:02.654791 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b4a22-3095-4e1c-98f8-1924930194da None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:02.654791 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b4a22-3095-4e1c-98f8-1924930194da None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:02.656185 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 573/1145] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 13:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:30:02.661888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bd51c-d365-47ab-9565-70437c5c3e79 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:02.662316 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bd51c-d365-47ab-9565-70437c5c3e79 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:02.662425 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bd51c-d365-47ab-9565-70437c5c3e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:02.727292 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-836bd51c-d365-47ab-9565-70437c5c3e79 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:30:02.728494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-836bd51c-d365-47ab-9565-70437c5c3e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:02.775238 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:02.822470 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 573/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 13:30:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:30:03.102453 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b4a22-3095-4e1c-98f8-1924930194da None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:30:03.104057 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-be3b4a22-3095-4e1c-98f8-1924930194da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:03.117539 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:03.208223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b4a22-3095-4e1c-98f8-1924930194da None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:30:03.282590 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51c586-74d3-45cb-8a38-53ad3a2bffe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:30:03.283218 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51c586-74d3-45cb-8a38-53ad3a2bffe1 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:03.283498 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51c586-74d3-45cb-8a38-53ad3a2bffe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:03.283769 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51c586-74d3-45cb-8a38-53ad3a2bffe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:03.285620 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-bf51c586-74d3-45cb-8a38-53ad3a2bffe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:03.353314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:03.395955 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51c586-74d3-45cb-8a38-53ad3a2bffe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:30:03.397386 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51c586-74d3-45cb-8a38-53ad3a2bffe1 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:30:03.415763 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 574/1147] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:30:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:30:12.821014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=22 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:13.413518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=25 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:23.479435 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6e932-4af9-4a5f-851f-e11819a8cd69 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:23.479987 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6e932-4af9-4a5f-851f-e11819a8cd69 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:23.479987 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6e932-4af9-4a5f-851f-e11819a8cd69 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:23.481342 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 574/1148] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:30:23.487351 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af35837-eefa-4f41-bf69-cf084af03c1c None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:23.487746 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af35837-eefa-4f41-bf69-cf084af03c1c None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:23.487909 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af35837-eefa-4f41-bf69-cf084af03c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:23.554972 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-0af35837-eefa-4f41-bf69-cf084af03c1c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:30:23.556238 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0af35837-eefa-4f41-bf69-cf084af03c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:23.651549 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 575/1149] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:30:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:30:23.947735 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dd3e2-5f33-4958-8025-8ee8ba34e5fb None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:23.948024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dd3e2-5f33-4958-8025-8ee8ba34e5fb None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:23.948301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9dd3e2-5f33-4958-8025-8ee8ba34e5fb None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:23.949665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 575/1150] 10.222.0.36 () {54 vars in 962 bytes} [Thu Oct 20 13:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:30:23.955289 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133917d-b661-44bd-b818-eb02449bf9e4 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:23.955578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133917d-b661-44bd-b818-eb02449bf9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:23.955851 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133917d-b661-44bd-b818-eb02449bf9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:24.032645 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-f133917d-b661-44bd-b818-eb02449bf9e4 None None] MFA Rules not processed for user `7d026ec6ed344404a5ebe4352792cc1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:30:24.033852 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-f133917d-b661-44bd-b818-eb02449bf9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:24.054759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:24.114307 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 576/1151] 10.222.0.36 () {58 vars in 1059 bytes} [Thu Oct 20 13:30:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:30:24.123287 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9dd3e2-5f33-4958-8025-8ee8ba34e5fb None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:30:24.124780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ef9dd3e2-5f33-4958-8025-8ee8ba34e5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:24.232812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9dd3e2-5f33-4958-8025-8ee8ba34e5fb None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:30:24.306339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb549679-24a6-420c-9e17-d896d0e44ee1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d026ec6ed344404a5ebe4352792cc1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:30:24.306944 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb549679-24a6-420c-9e17-d896d0e44ee1 service glance] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:24.307288 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb549679-24a6-420c-9e17-d896d0e44ee1 service glance] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:24.307562 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb549679-24a6-420c-9e17-d896d0e44ee1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:24.309219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-eb549679-24a6-420c-9e17-d896d0e44ee1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:24.364231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:24.419228 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb549679-24a6-420c-9e17-d896d0e44ee1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:30:24.420629 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb549679-24a6-420c-9e17-d896d0e44ee1 service glance] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:30:24.439868 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 576/1152] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:30:26.688124 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04c4e4-f126-4fc5-a37c-b1a827475233 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:26.688779 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04c4e4-f126-4fc5-a37c-b1a827475233 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:26.688779 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04c4e4-f126-4fc5-a37c-b1a827475233 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:26.690049 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 577/1153] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:30:26.695508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52bcf4-0094-4d75-99d6-a2fdae4ff0f9 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:26.695918 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52bcf4-0094-4d75-99d6-a2fdae4ff0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:26.696048 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52bcf4-0094-4d75-99d6-a2fdae4ff0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:26.762153 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-3e52bcf4-0094-4d75-99d6-a2fdae4ff0f9 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:30:26.763396 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3e52bcf4-0094-4d75-99d6-a2fdae4ff0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:26.858006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 577/1154] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:30:27.134801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04c4e4-f126-4fc5-a37c-b1a827475233 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:30:27.136366 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-bf04c4e4-f126-4fc5-a37c-b1a827475233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:27.264368 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04c4e4-f126-4fc5-a37c-b1a827475233 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:30:27.316156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:27.363839 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d86bd-b661-4cf3-a7fe-fc094b5d4c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:30:27.364369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d86bd-b661-4cf3-a7fe-fc094b5d4c9b admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:27.364643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d86bd-b661-4cf3-a7fe-fc094b5d4c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:27.364911 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d86bd-b661-4cf3-a7fe-fc094b5d4c9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:27.365536 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d86bd-b661-4cf3-a7fe-fc094b5d4c9b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:30:27.366623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: WARNING py.warnings [None req-9f2d86bd-b661-4cf3-a7fe-fc094b5d4c9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 13:30:27.366623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: warnings.warn(msg) Oct 20 13:30:27.366623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: Oct 20 13:30:27.367794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d86bd-b661-4cf3-a7fe-fc094b5d4c9b admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:30:27.386693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 578/1155] 10.222.0.36 () {56 vars in 1108 bytes} [Thu Oct 20 13:30:27 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:30:29.555183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641fb89-5dae-4f24-8adc-0244a7da2f74 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:29.555793 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641fb89-5dae-4f24-8adc-0244a7da2f74 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:29.555793 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641fb89-5dae-4f24-8adc-0244a7da2f74 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:29.557372 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 578/1156] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:30:29.564447 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53dacf-b9ce-46d4-8a69-8933fa36e794 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:29.564891 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53dacf-b9ce-46d4-8a69-8933fa36e794 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:29.565013 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53dacf-b9ce-46d4-8a69-8933fa36e794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:29.633585 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-fc53dacf-b9ce-46d4-8a69-8933fa36e794 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:30:29.634781 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-fc53dacf-b9ce-46d4-8a69-8933fa36e794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:29.730882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 579/1157] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:30:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:30:30.025889 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641fb89-5dae-4f24-8adc-0244a7da2f74 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:30:30.027475 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f641fb89-5dae-4f24-8adc-0244a7da2f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:30.038076 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:30.177001 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641fb89-5dae-4f24-8adc-0244a7da2f74 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:30:30.259417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:30.300555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30da662-45c9-41cf-bd47-657aeab2a7bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:30:30.301164 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30da662-45c9-41cf-bd47-657aeab2a7bc service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:30.301435 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30da662-45c9-41cf-bd47-657aeab2a7bc service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:30.301699 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30da662-45c9-41cf-bd47-657aeab2a7bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:30.303335 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d30da662-45c9-41cf-bd47-657aeab2a7bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:30.395227 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30da662-45c9-41cf-bd47-657aeab2a7bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:30:30.396850 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30da662-45c9-41cf-bd47-657aeab2a7bc service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:30:30.415916 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 579/1158] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:30:32.803106 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a0f50-5616-4278-b985-7f23abdb49d3 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:32.803651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a0f50-5616-4278-b985-7f23abdb49d3 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:32.803651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a0f50-5616-4278-b985-7f23abdb49d3 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:32.805008 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 580/1159] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:30:32.810494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a88d1-c79a-4c7e-a442-31ab30e01cc0 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:32.810940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a88d1-c79a-4c7e-a442-31ab30e01cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:32.811081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a88d1-c79a-4c7e-a442-31ab30e01cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:32.879152 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-a25a88d1-c79a-4c7e-a442-31ab30e01cc0 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:30:32.880385 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a25a88d1-c79a-4c7e-a442-31ab30e01cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:32.929359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:32.982077 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 580/1160] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:30:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:30:33.269474 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a0f50-5616-4278-b985-7f23abdb49d3 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:30:33.271031 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-cc4a0f50-5616-4278-b985-7f23abdb49d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:33.296654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:33.382998 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a0f50-5616-4278-b985-7f23abdb49d3 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:30:33.460355 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dd2bf-1318-4b12-8ad0-f9eb56c7a5fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:30:33.461181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dd2bf-1318-4b12-8ad0-f9eb56c7a5fd service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:33.461517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dd2bf-1318-4b12-8ad0-f9eb56c7a5fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:33.461789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dd2bf-1318-4b12-8ad0-f9eb56c7a5fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:33.463540 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6e5dd2bf-1318-4b12-8ad0-f9eb56c7a5fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:33.544087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:33.583242 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dd2bf-1318-4b12-8ad0-f9eb56c7a5fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:30:33.584686 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5dd2bf-1318-4b12-8ad0-f9eb56c7a5fd service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:30:33.603502 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 581/1161] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:30:35.876144 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f4e79-e03e-4d86-b306-a7cb1969292e None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:35.876602 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f4e79-e03e-4d86-b306-a7cb1969292e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:35.876713 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f4e79-e03e-4d86-b306-a7cb1969292e None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:35.878328 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 581/1162] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:30:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:30:35.883903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15a632-3953-4e58-bccd-f7beb2f5b464 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:35.884370 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15a632-3953-4e58-bccd-f7beb2f5b464 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:35.884482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15a632-3953-4e58-bccd-f7beb2f5b464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:35.955326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-9d15a632-3953-4e58-bccd-f7beb2f5b464 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:30:35.956446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9d15a632-3953-4e58-bccd-f7beb2f5b464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:36.054392 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 582/1163] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:30:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:30:36.352842 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f4e79-e03e-4d86-b306-a7cb1969292e None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:30:36.354389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d79f4e79-e03e-4d86-b306-a7cb1969292e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:36.462560 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f4e79-e03e-4d86-b306-a7cb1969292e None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:30:36.536067 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:36.538154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0be55-3194-4e06-aaa9-215f27f3e6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:30:36.538833 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0be55-3194-4e06-aaa9-215f27f3e6bf service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:36.540154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0be55-3194-4e06-aaa9-215f27f3e6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:36.540154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0be55-3194-4e06-aaa9-215f27f3e6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:36.541972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-46d0be55-3194-4e06-aaa9-215f27f3e6bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:36.652972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0be55-3194-4e06-aaa9-215f27f3e6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:30:36.654761 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d0be55-3194-4e06-aaa9-215f27f3e6bf service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:30:36.674345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 582/1164] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:30:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:30:38.988581 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae23cef-fe69-46b8-b0c6-983c5ae064e4 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:38.989133 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae23cef-fe69-46b8-b0c6-983c5ae064e4 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:38.989133 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae23cef-fe69-46b8-b0c6-983c5ae064e4 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:38.990522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 583/1165] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:30:38.995826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14c182-8932-4c11-8d0d-a4092ee729f5 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:38.996256 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14c182-8932-4c11-8d0d-a4092ee729f5 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:38.996366 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14c182-8932-4c11-8d0d-a4092ee729f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:39.062964 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-7b14c182-8932-4c11-8d0d-a4092ee729f5 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:30:39.064198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7b14c182-8932-4c11-8d0d-a4092ee729f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:39.116816 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:39.161257 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 583/1166] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:30:39.451899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae23cef-fe69-46b8-b0c6-983c5ae064e4 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:30:39.454015 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-2ae23cef-fe69-46b8-b0c6-983c5ae064e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:39.489962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:39.560852 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae23cef-fe69-46b8-b0c6-983c5ae064e4 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:30:39.637756 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62d290-041f-40ba-9de9-74ec52925304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:30:39.638361 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62d290-041f-40ba-9de9-74ec52925304 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:39.638639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62d290-041f-40ba-9de9-74ec52925304 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:39.638906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62d290-041f-40ba-9de9-74ec52925304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:39.640543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-df62d290-041f-40ba-9de9-74ec52925304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:39.719492 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:39.748647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62d290-041f-40ba-9de9-74ec52925304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:30:39.750729 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62d290-041f-40ba-9de9-74ec52925304 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:30:39.768671 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 584/1167] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:30:42.080750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886c059-6bf4-47c1-8184-946ae7295f83 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:42.081317 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886c059-6bf4-47c1-8184-946ae7295f83 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:42.081317 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886c059-6bf4-47c1-8184-946ae7295f83 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:42.082836 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 584/1168] 10.222.0.36 () {54 vars in 927 bytes} [Thu Oct 20 13:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:30:42.087873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa547c8-d347-4427-bb04-5c777d90013d None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:42.088276 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa547c8-d347-4427-bb04-5c777d90013d None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:42.088420 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa547c8-d347-4427-bb04-5c777d90013d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:42.153121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-7fa547c8-d347-4427-bb04-5c777d90013d None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:30:42.154228 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7fa547c8-d347-4427-bb04-5c777d90013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:42.251603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 585/1169] 10.222.0.36 () {58 vars in 1024 bytes} [Thu Oct 20 13:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:30:42.540819 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886c059-6bf4-47c1-8184-946ae7295f83 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:30:42.542359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e886c059-6bf4-47c1-8184-946ae7295f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:42.648302 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886c059-6bf4-47c1-8184-946ae7295f83 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:30:42.721786 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243e316-af59-436c-8048-318d5fc20cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:30:42.722385 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243e316-af59-436c-8048-318d5fc20cbe service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:30:42.722661 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243e316-af59-436c-8048-318d5fc20cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:30:42.722929 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243e316-af59-436c-8048-318d5fc20cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:30:42.724532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d243e316-af59-436c-8048-318d5fc20cbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:30:42.732873 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:42.832192 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243e316-af59-436c-8048-318d5fc20cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:30:42.833530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243e316-af59-436c-8048-318d5fc20cbe service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:30:42.852265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 585/1170] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:30:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:30:52.249516 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=82 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:30:52.850019 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=50 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:32:02.341973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a377d26-a559-4f6d-b5da-1ed46ff36950 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:32:02.342556 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a377d26-a559-4f6d-b5da-1ed46ff36950 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:32:02.342556 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a377d26-a559-4f6d-b5da-1ed46ff36950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:32:02.419856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-5a377d26-a559-4f6d-b5da-1ed46ff36950 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:32:02.421071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-5a377d26-a559-4f6d-b5da-1ed46ff36950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:32:02.517225 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 586/1171] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:32:02.525596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd1ada-7c39-479e-94b7-af1b448a367a None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:32:02.526098 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd1ada-7c39-479e-94b7-af1b448a367a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:32:02.526204 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd1ada-7c39-479e-94b7-af1b448a367a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:32:02.600981 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-92fd1ada-7c39-479e-94b7-af1b448a367a None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:32:02.602132 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-92fd1ada-7c39-479e-94b7-af1b448a367a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:32:02.697816 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 586/1172] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:32:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:32:02.702521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a377d26-a559-4f6d-b5da-1ed46ff36950 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:32:02.703752 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-5a377d26-a559-4f6d-b5da-1ed46ff36950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:32:02.715547 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a377d26-a559-4f6d-b5da-1ed46ff36950 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:32:02.777891 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:32:02.812371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc72d3-b54d-4440-8af8-18eff707ffbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:32:02.812978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc72d3-b54d-4440-8af8-18eff707ffbb admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:32:02.813256 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc72d3-b54d-4440-8af8-18eff707ffbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:32:02.813525 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc72d3-b54d-4440-8af8-18eff707ffbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:32:02.814161 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc72d3-b54d-4440-8af8-18eff707ffbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:32:02.814463 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc72d3-b54d-4440-8af8-18eff707ffbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:32:02.815503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: WARNING py.warnings [None req-34dc72d3-b54d-4440-8af8-18eff707ffbb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 20 13:32:02.815503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: warnings.warn(msg) Oct 20 13:32:02.815503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: Oct 20 13:32:02.816393 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dc72d3-b54d-4440-8af8-18eff707ffbb admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:32:02.828438 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 587/1173] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:32:02.838803 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd1ada-7c39-479e-94b7-af1b448a367a None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:32:02.848019 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd1ada-7c39-479e-94b7-af1b448a367a None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:32:02.910913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:32:02.945681 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635db948-300e-466c-948e-2efe31a1f5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:32:02.946288 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635db948-300e-466c-948e-2efe31a1f5ff admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:32:02.946573 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635db948-300e-466c-948e-2efe31a1f5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:32:02.946843 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635db948-300e-466c-948e-2efe31a1f5ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:32:02.947507 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635db948-300e-466c-948e-2efe31a1f5ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:32:02.948608 dv-cinder-862136-1-smb devstack@keystone.service[81427]: WARNING py.warnings [None req-635db948-300e-466c-948e-2efe31a1f5ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 13:32:02.948608 dv-cinder-862136-1-smb devstack@keystone.service[81427]: warnings.warn(msg) Oct 20 13:32:02.948608 dv-cinder-862136-1-smb devstack@keystone.service[81427]: Oct 20 13:32:02.949814 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635db948-300e-466c-948e-2efe31a1f5ff admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:32:03.006930 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 587/1174] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:32:02 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:32:03.011337 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc72d3-b54d-4440-8af8-18eff707ffbb admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:32:03.012862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-34dc72d3-b54d-4440-8af8-18eff707ffbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:32:03.045825 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc72d3-b54d-4440-8af8-18eff707ffbb admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:32:03.138828 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2368f10-42cf-4fbc-a135-78b4b0815467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:32:03.139402 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2368f10-42cf-4fbc-a135-78b4b0815467 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:32:03.139716 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2368f10-42cf-4fbc-a135-78b4b0815467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:32:03.140017 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2368f10-42cf-4fbc-a135-78b4b0815467 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:32:03.140663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2368f10-42cf-4fbc-a135-78b4b0815467 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:32:03.141705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: WARNING py.warnings [None req-a2368f10-42cf-4fbc-a135-78b4b0815467 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 13:32:03.141705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: warnings.warn(msg) Oct 20 13:32:03.141705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: Oct 20 13:32:03.142910 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2368f10-42cf-4fbc-a135-78b4b0815467 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:32:03.185725 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 588/1175] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:32:03 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:32:03.189834 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635db948-300e-466c-948e-2efe31a1f5ff admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:32:03.191405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-635db948-300e-466c-948e-2efe31a1f5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:32:03.252055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635db948-300e-466c-948e-2efe31a1f5ff admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:32:03.334732 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:32:03.346261 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6530c88-7c39-4327-9808-88c1dd9edac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:32:03.346863 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6530c88-7c39-4327-9808-88c1dd9edac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:32:03.347168 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6530c88-7c39-4327-9808-88c1dd9edac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:32:03.347440 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6530c88-7c39-4327-9808-88c1dd9edac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:32:03.348082 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6530c88-7c39-4327-9808-88c1dd9edac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:32:03.349782 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6530c88-7c39-4327-9808-88c1dd9edac4 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:32:03.362310 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 588/1176] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:32:03.366368 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2368f10-42cf-4fbc-a135-78b4b0815467 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:32:03.367915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a2368f10-42cf-4fbc-a135-78b4b0815467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:32:03.379265 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2368f10-42cf-4fbc-a135-78b4b0815467 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:32:03.405758 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:32:03.476292 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8f2aa-e75e-492f-b188-f4b1f6725239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:32:03.476893 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8f2aa-e75e-492f-b188-f4b1f6725239 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:32:03.477166 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8f2aa-e75e-492f-b188-f4b1f6725239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:32:03.477432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8f2aa-e75e-492f-b188-f4b1f6725239 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:32:03.478062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8f2aa-e75e-492f-b188-f4b1f6725239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:32:03.479740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8f2aa-e75e-492f-b188-f4b1f6725239 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:32:03.491738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 589/1177] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:32:03 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:32:03.495961 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6530c88-7c39-4327-9808-88c1dd9edac4 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:32:03.497470 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f6530c88-7c39-4327-9808-88c1dd9edac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:32:03.531293 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6530c88-7c39-4327-9808-88c1dd9edac4 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:32:03.625532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08cbe5-2ee0-4647-a65b-e02d4c77a196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:32:03.626182 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08cbe5-2ee0-4647-a65b-e02d4c77a196 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:32:03.626462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08cbe5-2ee0-4647-a65b-e02d4c77a196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:32:03.626735 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08cbe5-2ee0-4647-a65b-e02d4c77a196 admin admin] PATH_INFO: `/v3/projects/4c10ad791c7e4e1ba30e627c3ef676c5/users/ccb546f7fa8549d286f3106b20cb24d4/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:32:03.650249 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08cbe5-2ee0-4647-a65b-e02d4c77a196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c10ad791c7e4e1ba30e627c3ef676c5, user_id=ccb546f7fa8549d286f3106b20cb24d4, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:32:03.652929 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08cbe5-2ee0-4647-a65b-e02d4c77a196 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:32:03.678802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 589/1178] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:32:03 2022] PUT /identity/v3/projects/4c10ad791c7e4e1ba30e627c3ef676c5/users/ccb546f7fa8549d286f3106b20cb24d4/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:32:03.689677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5bc99-8b10-4de8-b4eb-507f1cc54e27 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:32:03.689970 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5bc99-8b10-4de8-b4eb-507f1cc54e27 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:32:03.690250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5bc99-8b10-4de8-b4eb-507f1cc54e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:32:03.748945 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-e3a5bc99-8b10-4de8-b4eb-507f1cc54e27 None None] MFA Rules not processed for user `ccb546f7fa8549d286f3106b20cb24d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:32:03.750163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e3a5bc99-8b10-4de8-b4eb-507f1cc54e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:32:03.829914 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 590/1179] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:32:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:32:03.843233 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c132f-d774-4295-b81c-bbdaa6059f2c None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:32:03.843520 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c132f-d774-4295-b81c-bbdaa6059f2c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:32:03.843795 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c132f-d774-4295-b81c-bbdaa6059f2c None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:32:03.845132 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 590/1180] 10.222.0.36 () {54 vars in 963 bytes} [Thu Oct 20 13:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:32:03.850209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a192b0d-a222-4435-9c90-7f55676c9d8f None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:32:03.850492 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a192b0d-a222-4435-9c90-7f55676c9d8f None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:32:03.850767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a192b0d-a222-4435-9c90-7f55676c9d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:32:03.883774 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:32:03.928255 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-0a192b0d-a222-4435-9c90-7f55676c9d8f None None] MFA Rules not processed for user `8a7a1006ff4b43c3be2cc011359abdd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:32:03.929498 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0a192b0d-a222-4435-9c90-7f55676c9d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:32:04.002346 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 591/1181] 10.222.0.36 () {58 vars in 1060 bytes} [Thu Oct 20 13:32:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:32:04.010025 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c132f-d774-4295-b81c-bbdaa6059f2c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:32:04.011552 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6e2c132f-d774-4295-b81c-bbdaa6059f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:32:04.061018 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:32:04.113517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c132f-d774-4295-b81c-bbdaa6059f2c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:32:04.186850 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0116d-7998-4a01-9c3a-794226262fd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:32:04.187402 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0116d-7998-4a01-9c3a-794226262fd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:32:04.187675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0116d-7998-4a01-9c3a-794226262fd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:32:04.187940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c0116d-7998-4a01-9c3a-794226262fd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:32:04.189508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-28c0116d-7998-4a01-9c3a-794226262fd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:32:04.286492 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0116d-7998-4a01-9c3a-794226262fd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:32:04.288604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c0116d-7998-4a01-9c3a-794226262fd8 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:32:04.292062 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:32:04.308098 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 591/1182] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:32:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:32:04.354714 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b931ac0-50bb-4bb6-a61b-d1b2096a0e64 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:32:04.355043 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b931ac0-50bb-4bb6-a61b-d1b2096a0e64 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:32:04.355323 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b931ac0-50bb-4bb6-a61b-d1b2096a0e64 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:32:04.356573 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 592/1183] 10.222.0.36 () {52 vars in 830 bytes} [Thu Oct 20 13:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:32:04.360124 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0116d-7998-4a01-9c3a-794226262fd8 service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:32:04.361330 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-28c0116d-7998-4a01-9c3a-794226262fd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:32:04.460221 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c0116d-7998-4a01-9c3a-794226262fd8 service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:32:04.552940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7a722-dfad-4cc2-9dcd-d96d7303e3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:32:04.553701 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7a722-dfad-4cc2-9dcd-d96d7303e3ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:32:04.553811 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7a722-dfad-4cc2-9dcd-d96d7303e3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:32:04.554082 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7a722-dfad-4cc2-9dcd-d96d7303e3ec admin admin] PATH_INFO: `/v3/users/ccb546f7fa8549d286f3106b20cb24d4` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:32:04.566901 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7a722-dfad-4cc2-9dcd-d96d7303e3ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccb546f7fa8549d286f3106b20cb24d4)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:32:04.567954 dv-cinder-862136-1-smb devstack@keystone.service[81427]: WARNING py.warnings [None req-6bc7a722-dfad-4cc2-9dcd-d96d7303e3ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 13:32:04.567954 dv-cinder-862136-1-smb devstack@keystone.service[81427]: warnings.warn(msg) Oct 20 13:32:04.567954 dv-cinder-862136-1-smb devstack@keystone.service[81427]: Oct 20 13:32:04.569171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc7a722-dfad-4cc2-9dcd-d96d7303e3ec admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:32:04.578692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:32:04.635381 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6bc7a722-dfad-4cc2-9dcd-d96d7303e3ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccb546f7fa8549d286f3106b20cb24d4'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:32:04.635929 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6bc7a722-dfad-4cc2-9dcd-d96d7303e3ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccb546f7fa8549d286f3106b20cb24d4'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:32:04.650005 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6bc7a722-dfad-4cc2-9dcd-d96d7303e3ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccb546f7fa8549d286f3106b20cb24d4'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:32:04.674185 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6bc7a722-dfad-4cc2-9dcd-d96d7303e3ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccb546f7fa8549d286f3106b20cb24d4'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:32:04.674659 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6bc7a722-dfad-4cc2-9dcd-d96d7303e3ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccb546f7fa8549d286f3106b20cb24d4'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:32:04.688877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 592/1184] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:32:04 2022] DELETE /identity/v3/users/ccb546f7fa8549d286f3106b20cb24d4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:32:04.693857 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18cbb00-d52f-405d-9e23-0950bab07986 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:32:04.694357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18cbb00-d52f-405d-9e23-0950bab07986 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:32:04.694454 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18cbb00-d52f-405d-9e23-0950bab07986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:32:04.751257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-a18cbb00-d52f-405d-9e23-0950bab07986 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:32:04.752380 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a18cbb00-d52f-405d-9e23-0950bab07986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:32:04.829565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:32:04.842886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 593/1185] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:32:04.852563 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7a722-dfad-4cc2-9dcd-d96d7303e3ec admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:32:04.853826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6bc7a722-dfad-4cc2-9dcd-d96d7303e3ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:32:04.953240 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc7a722-dfad-4cc2-9dcd-d96d7303e3ec admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:32:05.006739 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:32:05.026042 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18811d-2d84-4319-8721-c83a4bd8598a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:32:05.026644 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18811d-2d84-4319-8721-c83a4bd8598a service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:32:05.026919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18811d-2d84-4319-8721-c83a4bd8598a service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:32:05.027219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18811d-2d84-4319-8721-c83a4bd8598a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:32:05.028793 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8b18811d-2d84-4319-8721-c83a4bd8598a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:32:05.135833 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18811d-2d84-4319-8721-c83a4bd8598a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:32:05.137241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18811d-2d84-4319-8721-c83a4bd8598a service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:32:05.155601 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 593/1186] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:32:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:32:05.511285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18cbb00-d52f-405d-9e23-0950bab07986 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:32:05.512542 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a18cbb00-d52f-405d-9e23-0950bab07986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:32:05.524618 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18cbb00-d52f-405d-9e23-0950bab07986 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:32:05.625901 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af4507-2649-435c-aa43-82d33da4f531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:32:05.626572 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af4507-2649-435c-aa43-82d33da4f531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:32:05.626851 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af4507-2649-435c-aa43-82d33da4f531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:32:05.627160 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af4507-2649-435c-aa43-82d33da4f531 admin admin] PATH_INFO: `/v3/projects/4c10ad791c7e4e1ba30e627c3ef676c5` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:32:05.638002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af4507-2649-435c-aa43-82d33da4f531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c10ad791c7e4e1ba30e627c3ef676c5)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:32:05.639064 dv-cinder-862136-1-smb devstack@keystone.service[81426]: WARNING py.warnings [None req-a5af4507-2649-435c-aa43-82d33da4f531 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 13:32:05.639064 dv-cinder-862136-1-smb devstack@keystone.service[81426]: warnings.warn(msg) Oct 20 13:32:05.639064 dv-cinder-862136-1-smb devstack@keystone.service[81426]: Oct 20 13:32:05.640279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af4507-2649-435c-aa43-82d33da4f531 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:32:05.701846 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a5af4507-2649-435c-aa43-82d33da4f531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c10ad791c7e4e1ba30e627c3ef676c5', 'request_id': 'req-a5af4507-2649-435c-aa43-82d33da4f531'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:32:05.715830 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a5af4507-2649-435c-aa43-82d33da4f531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c10ad791c7e4e1ba30e627c3ef676c5', 'request_id': 'req-a5af4507-2649-435c-aa43-82d33da4f531'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:32:05.721788 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a5af4507-2649-435c-aa43-82d33da4f531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c10ad791c7e4e1ba30e627c3ef676c5', 'request_id': 'req-a5af4507-2649-435c-aa43-82d33da4f531'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:32:05.748436 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a5af4507-2649-435c-aa43-82d33da4f531 admin admin] The token cache is being invalidate because project 4c10ad791c7e4e1ba30e627c3ef676c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:32:05.748723 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a5af4507-2649-435c-aa43-82d33da4f531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:32:05.749234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a5af4507-2649-435c-aa43-82d33da4f531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:32:05.750552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 594/1187] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:32:05 2022] DELETE /identity/v3/projects/4c10ad791c7e4e1ba30e627c3ef676c5 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:32:15.153355 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=62 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:32:15.746435 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:33:36.495471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedfb59-1bde-485e-ad97-397feb339cbf None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:36.496076 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedfb59-1bde-485e-ad97-397feb339cbf None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:36.496076 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aedfb59-1bde-485e-ad97-397feb339cbf None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:36.497358 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 594/1188] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 13:33:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:33:36.502208 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cbe03-8cf8-484d-974e-1e7f96958592 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:36.502652 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cbe03-8cf8-484d-974e-1e7f96958592 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:36.502759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872cbe03-8cf8-484d-974e-1e7f96958592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:36.585214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-872cbe03-8cf8-484d-974e-1e7f96958592 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:33:36.586424 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-872cbe03-8cf8-484d-974e-1e7f96958592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:33:36.689168 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 595/1189] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 13:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:33:36.843457 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedfb59-1bde-485e-ad97-397feb339cbf None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:33:36.845594 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5aedfb59-1bde-485e-ad97-397feb339cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:33:36.965382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aedfb59-1bde-485e-ad97-397feb339cbf None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:33:36.970853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6832189-ce5a-4d8e-a191-054a2f82d0a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:33:36.971480 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6832189-ce5a-4d8e-a191-054a2f82d0a4 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:36.971760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6832189-ce5a-4d8e-a191-054a2f82d0a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:36.972035 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6832189-ce5a-4d8e-a191-054a2f82d0a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:36.980037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6832189-ce5a-4d8e-a191-054a2f82d0a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:33:36.981585 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6832189-ce5a-4d8e-a191-054a2f82d0a4 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:33:36.991047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 595/1190] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:33:38.061068 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798632b9-9ee7-494e-8354-73bb08878ce2 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:38.061637 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798632b9-9ee7-494e-8354-73bb08878ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:38.061637 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798632b9-9ee7-494e-8354-73bb08878ce2 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:38.062990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 596/1191] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 13:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:33:38.069272 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36435a58-8a99-4280-acc1-520516018ff3 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:38.069688 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36435a58-8a99-4280-acc1-520516018ff3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:38.069795 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36435a58-8a99-4280-acc1-520516018ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:38.091242 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-36435a58-8a99-4280-acc1-520516018ff3 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:33:38.092694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-36435a58-8a99-4280-acc1-520516018ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:33:38.102335 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 596/1192] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 13:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:33:38.258962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798632b9-9ee7-494e-8354-73bb08878ce2 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:33:38.274054 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798632b9-9ee7-494e-8354-73bb08878ce2 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:33:38.279780 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe3904-5b9f-41f3-9071-5232e417e884 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:33:38.280376 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe3904-5b9f-41f3-9071-5232e417e884 service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:38.280656 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe3904-5b9f-41f3-9071-5232e417e884 service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:38.280931 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe3904-5b9f-41f3-9071-5232e417e884 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:38.289700 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe3904-5b9f-41f3-9071-5232e417e884 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:33:38.291403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe3904-5b9f-41f3-9071-5232e417e884 service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:33:38.300932 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 597/1193] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:33:38.627593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d6ac0-2a5b-490d-8f9a-6369f29c6e9f None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:38.627874 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d6ac0-2a5b-490d-8f9a-6369f29c6e9f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:38.628150 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d6ac0-2a5b-490d-8f9a-6369f29c6e9f None None] PATH_INFO: `/v3` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:38.629429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 597/1194] 10.222.0.26 () {54 vars in 925 bytes} [Thu Oct 20 13:33:38 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:33:38.635211 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026a077-5c87-434b-87c1-4ca0a3f3a4da None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:38.635500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026a077-5c87-434b-87c1-4ca0a3f3a4da None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:38.635778 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9026a077-5c87-434b-87c1-4ca0a3f3a4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:38.695895 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-9026a077-5c87-434b-87c1-4ca0a3f3a4da None None] MFA Rules not processed for user `a00f0b4cee8d49a48a95317aec9f647c`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:33:38.697150 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9026a077-5c87-434b-87c1-4ca0a3f3a4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:33:38.713658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:33:38.767586 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 598/1195] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Oct 20 13:33:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:33:42.297063 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a159a-0501-4153-88a2-4ee2ec3ec282 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:42.297507 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a159a-0501-4153-88a2-4ee2ec3ec282 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:42.297682 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a159a-0501-4153-88a2-4ee2ec3ec282 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:42.299135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 598/1196] 10.222.0.36 () {54 vars in 961 bytes} [Thu Oct 20 13:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:33:42.304648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10f746-8533-467f-896f-b15448072705 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:42.305083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10f746-8533-467f-896f-b15448072705 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:42.305182 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10f746-8533-467f-896f-b15448072705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:42.329194 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-ea10f746-8533-467f-896f-b15448072705 None None] MFA Rules not processed for user `a00f0b4cee8d49a48a95317aec9f647c`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:33:42.331109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-ea10f746-8533-467f-896f-b15448072705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:33:42.340090 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 599/1197] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Oct 20 13:33:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:33:42.348110 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a159a-0501-4153-88a2-4ee2ec3ec282 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:33:42.361702 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a159a-0501-4153-88a2-4ee2ec3ec282 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:33:42.366586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9796671-cbb6-455d-838c-30a051de042b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a00f0b4cee8d49a48a95317aec9f647c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:33:42.367203 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9796671-cbb6-455d-838c-30a051de042b service placement] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:42.367477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9796671-cbb6-455d-838c-30a051de042b service placement] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:42.367743 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9796671-cbb6-455d-838c-30a051de042b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:42.376426 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9796671-cbb6-455d-838c-30a051de042b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:33:42.377981 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9796671-cbb6-455d-838c-30a051de042b service placement] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:33:42.387530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 599/1198] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:33:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:33:49.765122 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c5e23-7411-4c8d-96ec-67658410fcf4 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:49.765663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c5e23-7411-4c8d-96ec-67658410fcf4 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:49.765663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c5e23-7411-4c8d-96ec-67658410fcf4 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:49.767021 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 600/1199] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 13:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:33:49.773078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade7b0f-a1e8-42c3-a692-ff27b29aa5b8 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:49.773520 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade7b0f-a1e8-42c3-a692-ff27b29aa5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:49.773622 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade7b0f-a1e8-42c3-a692-ff27b29aa5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:49.793453 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5ade7b0f-a1e8-42c3-a692-ff27b29aa5b8 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:33:49.794647 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5ade7b0f-a1e8-42c3-a692-ff27b29aa5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:33:49.802714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 600/1200] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 13:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:33:49.959645 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c5e23-7411-4c8d-96ec-67658410fcf4 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:33:49.975313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c5e23-7411-4c8d-96ec-67658410fcf4 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:33:49.981083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610608d-f068-47ef-838d-0dee76557af0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:33:49.981680 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610608d-f068-47ef-838d-0dee76557af0 service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:49.981964 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610608d-f068-47ef-838d-0dee76557af0 service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:49.982233 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610608d-f068-47ef-838d-0dee76557af0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:49.990128 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610608d-f068-47ef-838d-0dee76557af0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:33:49.991744 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610608d-f068-47ef-838d-0dee76557af0 service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:33:50.001761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 601/1201] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:33:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:33:51.081665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0be4e-3ec5-489f-bc1d-a4e0b3e7aaad None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:51.082299 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0be4e-3ec5-489f-bc1d-a4e0b3e7aaad None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:51.082299 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0be4e-3ec5-489f-bc1d-a4e0b3e7aaad None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:51.083621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 601/1202] 127.0.0.1 () {54 vars in 901 bytes} [Thu Oct 20 13:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:33:51.090559 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4339ed-c000-42c5-963b-487494178eb8 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:51.091022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4339ed-c000-42c5-963b-487494178eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:51.091176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4339ed-c000-42c5-963b-487494178eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:51.110811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-3c4339ed-c000-42c5-963b-487494178eb8 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:33:51.112042 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-3c4339ed-c000-42c5-963b-487494178eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:33:51.119898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 602/1203] 127.0.0.1 () {58 vars in 998 bytes} [Thu Oct 20 13:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:33:51.272220 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0be4e-3ec5-489f-bc1d-a4e0b3e7aaad None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:33:51.287197 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0be4e-3ec5-489f-bc1d-a4e0b3e7aaad None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:33:51.293104 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7f125-3ec7-487d-9d1e-57dbcf9dde66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:33:51.293685 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7f125-3ec7-487d-9d1e-57dbcf9dde66 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:51.293960 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7f125-3ec7-487d-9d1e-57dbcf9dde66 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:51.294226 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7f125-3ec7-487d-9d1e-57dbcf9dde66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:51.302243 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7f125-3ec7-487d-9d1e-57dbcf9dde66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:33:51.303878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7f125-3ec7-487d-9d1e-57dbcf9dde66 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:33:51.313548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 602/1204] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:33:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:33:55.126656 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414b874-ef9a-4727-bd3a-8e3964beebb6 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:55.127261 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414b874-ef9a-4727-bd3a-8e3964beebb6 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:55.127261 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414b874-ef9a-4727-bd3a-8e3964beebb6 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:55.128607 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 603/1205] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 13:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:33:55.133948 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf094d-c81a-4795-bf00-33b5c8f3d11f None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:55.134880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf094d-c81a-4795-bf00-33b5c8f3d11f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:55.135021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf094d-c81a-4795-bf00-33b5c8f3d11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:55.154477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-6baf094d-c81a-4795-bf00-33b5c8f3d11f None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:33:55.155750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6baf094d-c81a-4795-bf00-33b5c8f3d11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:33:55.163521 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 603/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 13:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:33:55.451173 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414b874-ef9a-4727-bd3a-8e3964beebb6 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:33:55.452887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8414b874-ef9a-4727-bd3a-8e3964beebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:33:55.529967 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414b874-ef9a-4727-bd3a-8e3964beebb6 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:33:55.533513 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11997799-beab-4c70-ad31-cf67963d8ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:33:55.534109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11997799-beab-4c70-ad31-cf67963d8ccf service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:55.534388 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11997799-beab-4c70-ad31-cf67963d8ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:55.534656 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11997799-beab-4c70-ad31-cf67963d8ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:55.543982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11997799-beab-4c70-ad31-cf67963d8ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:33:55.545418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11997799-beab-4c70-ad31-cf67963d8ccf service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:33:55.554756 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 604/1207] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:33:57.708164 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749b3ac-6224-4d8c-903d-d689f27ff09c None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:57.708751 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749b3ac-6224-4d8c-903d-d689f27ff09c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:57.708751 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c749b3ac-6224-4d8c-903d-d689f27ff09c None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:57.710065 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 604/1208] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 13:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:33:57.715756 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec35e7-c535-499e-a4fc-ffdf70804c00 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:57.716194 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec35e7-c535-499e-a4fc-ffdf70804c00 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:57.716305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec35e7-c535-499e-a4fc-ffdf70804c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:57.736584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-62ec35e7-c535-499e-a4fc-ffdf70804c00 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:33:57.737774 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-62ec35e7-c535-499e-a4fc-ffdf70804c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:33:57.745962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 605/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 13:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:33:58.032294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749b3ac-6224-4d8c-903d-d689f27ff09c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:33:58.043824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c749b3ac-6224-4d8c-903d-d689f27ff09c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:33:58.047366 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec81a4d-d97d-4bec-8db1-41dea9618a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:33:58.047953 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec81a4d-d97d-4bec-8db1-41dea9618a6a service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:33:58.048255 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec81a4d-d97d-4bec-8db1-41dea9618a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:33:58.048526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec81a4d-d97d-4bec-8db1-41dea9618a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:33:58.058039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec81a4d-d97d-4bec-8db1-41dea9618a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:33:58.059477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec81a4d-d97d-4bec-8db1-41dea9618a6a service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:33:58.068618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 605/1210] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:33:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:34:01.606239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa931-c40d-4d62-91b8-ec5c5fd31bd9 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:34:01.606800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa931-c40d-4d62-91b8-ec5c5fd31bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:34:01.606800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aa931-c40d-4d62-91b8-ec5c5fd31bd9 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:34:01.608154 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 606/1211] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 13:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:34:01.613302 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e49442-6e96-4f9b-b60b-66c620810297 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:34:01.613725 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e49442-6e96-4f9b-b60b-66c620810297 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:34:01.613864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e49442-6e96-4f9b-b60b-66c620810297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:34:01.632886 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-49e49442-6e96-4f9b-b60b-66c620810297 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:34:01.634576 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-49e49442-6e96-4f9b-b60b-66c620810297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:34:01.642395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 606/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 13:34:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:34:01.945762 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7aa931-c40d-4d62-91b8-ec5c5fd31bd9 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:34:01.948523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8a7aa931-c40d-4d62-91b8-ec5c5fd31bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:34:02.014135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:34:02.027700 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7aa931-c40d-4d62-91b8-ec5c5fd31bd9 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:34:02.031264 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506d9e0-36e0-43de-8729-880c4ab77683 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:34:02.031870 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506d9e0-36e0-43de-8729-880c4ab77683 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:34:02.032152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506d9e0-36e0-43de-8729-880c4ab77683 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:34:02.032428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506d9e0-36e0-43de-8729-880c4ab77683 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:34:02.041640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506d9e0-36e0-43de-8729-880c4ab77683 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:34:02.043085 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506d9e0-36e0-43de-8729-880c4ab77683 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:34:02.052559 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 607/1213] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:34:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:34:04.190590 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5f64d-387c-4b10-b571-a7459734ca5d None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:34:04.191187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5f64d-387c-4b10-b571-a7459734ca5d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:34:04.191187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5f64d-387c-4b10-b571-a7459734ca5d None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:34:04.192417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 607/1214] 127.0.0.1 () {54 vars in 917 bytes} [Thu Oct 20 13:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:34:04.198089 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8a5ef-443b-4778-a183-942002f00f02 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:34:04.198530 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8a5ef-443b-4778-a183-942002f00f02 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:34:04.198657 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8a5ef-443b-4778-a183-942002f00f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:34:04.218676 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-2bc8a5ef-443b-4778-a183-942002f00f02 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:34:04.219915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-2bc8a5ef-443b-4778-a183-942002f00f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:34:04.229208 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 608/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Oct 20 13:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:34:04.534664 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5f64d-387c-4b10-b571-a7459734ca5d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:34:04.536474 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-22d5f64d-387c-4b10-b571-a7459734ca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:34:04.550056 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5f64d-387c-4b10-b571-a7459734ca5d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:34:04.553809 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bc9ab-6b51-4c65-990c-95fcce9a2524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:34:04.554401 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bc9ab-6b51-4c65-990c-95fcce9a2524 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:34:04.554683 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bc9ab-6b51-4c65-990c-95fcce9a2524 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:34:04.554976 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bc9ab-6b51-4c65-990c-95fcce9a2524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:34:04.563619 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bc9ab-6b51-4c65-990c-95fcce9a2524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:34:04.565016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bc9ab-6b51-4c65-990c-95fcce9a2524 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:34:04.574911 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 608/1216] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:34:14.213912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=11 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:34:14.570671 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:30.423699 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5f9c7-9a2a-4ba8-964d-7215abdf8c2f None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:30.424880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5f9c7-9a2a-4ba8-964d-7215abdf8c2f None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:30.425388 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5f9c7-9a2a-4ba8-964d-7215abdf8c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:30.452815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-a1a5f9c7-9a2a-4ba8-964d-7215abdf8c2f None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:30.454069 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a1a5f9c7-9a2a-4ba8-964d-7215abdf8c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:30.465582 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 609/1217] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:30.478896 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cd9a6-da79-4adf-8a7b-760c9e2e2074 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:30.479531 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cd9a6-da79-4adf-8a7b-760c9e2e2074 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:30.479531 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cd9a6-da79-4adf-8a7b-760c9e2e2074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:30.514031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-a68cd9a6-da79-4adf-8a7b-760c9e2e2074 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:30.515382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a68cd9a6-da79-4adf-8a7b-760c9e2e2074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:30.534345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 609/1218] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:30.539533 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5f9c7-9a2a-4ba8-964d-7215abdf8c2f None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:30.555919 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5f9c7-9a2a-4ba8-964d-7215abdf8c2f None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:30.567713 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3d19c-bb64-4936-a5c2-c6dd5bdeda95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:30.568353 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3d19c-bb64-4936-a5c2-c6dd5bdeda95 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:30.568638 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3d19c-bb64-4936-a5c2-c6dd5bdeda95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:30.568909 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3d19c-bb64-4936-a5c2-c6dd5bdeda95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:30.569566 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3d19c-bb64-4936-a5c2-c6dd5bdeda95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:35:30.569876 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3d19c-bb64-4936-a5c2-c6dd5bdeda95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:30.571524 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3d19c-bb64-4936-a5c2-c6dd5bdeda95 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:30.593074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 610/1219] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:35:30.603685 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cd9a6-da79-4adf-8a7b-760c9e2e2074 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:30.618160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cd9a6-da79-4adf-8a7b-760c9e2e2074 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:30.627630 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db336029-4b5e-43c3-ad93-e5883fdadc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:30.628401 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db336029-4b5e-43c3-ad93-e5883fdadc98 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:30.628685 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db336029-4b5e-43c3-ad93-e5883fdadc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:30.628959 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db336029-4b5e-43c3-ad93-e5883fdadc98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:30.629606 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db336029-4b5e-43c3-ad93-e5883fdadc98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:30.640011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db336029-4b5e-43c3-ad93-e5883fdadc98 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:30.702597 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 610/1220] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:30 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:30.706834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3d19c-bb64-4936-a5c2-c6dd5bdeda95 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:30.728349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3d19c-bb64-4936-a5c2-c6dd5bdeda95 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:30.735877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe58815-4c21-46df-8426-5011ca384e4c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:30.736220 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe58815-4c21-46df-8426-5011ca384e4c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:30.736442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe58815-4c21-46df-8426-5011ca384e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:30.784658 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-bbe58815-4c21-46df-8426-5011ca384e4c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:30.785554 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-bbe58815-4c21-46df-8426-5011ca384e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:30.821948 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e2e63-1aca-47b8-bd1b-7ffb73e47679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:30.822584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e2e63-1aca-47b8-bd1b-7ffb73e47679 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:30.822866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e2e63-1aca-47b8-bd1b-7ffb73e47679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:30.823170 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e2e63-1aca-47b8-bd1b-7ffb73e47679 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:30.824120 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e2e63-1aca-47b8-bd1b-7ffb73e47679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:30.827319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e2e63-1aca-47b8-bd1b-7ffb73e47679 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:30.869293 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 611/1221] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:30 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:30.870932 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4ea55-a89d-4d48-9ff9-531fea2ce39a None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:30.870932 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4ea55-a89d-4d48-9ff9-531fea2ce39a None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:30.871154 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4ea55-a89d-4d48-9ff9-531fea2ce39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:30.906941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-b4b4ea55-a89d-4d48-9ff9-531fea2ce39a None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:30.916746 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b4b4ea55-a89d-4d48-9ff9-531fea2ce39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:30.926305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 612/1222] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:30.932770 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999595d-66c8-48ff-b1bf-4b3da499c19a None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:30.933060 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999595d-66c8-48ff-b1bf-4b3da499c19a None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:30.933344 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3999595d-66c8-48ff-b1bf-4b3da499c19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:30.971937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-3999595d-66c8-48ff-b1bf-4b3da499c19a None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:30.973072 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-3999595d-66c8-48ff-b1bf-4b3da499c19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:30.977804 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 611/1223] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:35:30.978684 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe58815-4c21-46df-8426-5011ca384e4c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:30.992655 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 613/1224] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:30.994244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cf1e6-a594-4355-91dc-c8c9cf3d30b2 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:30.995362 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe58815-4c21-46df-8426-5011ca384e4c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:30.996533 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cf1e6-a594-4355-91dc-c8c9cf3d30b2 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:30.997139 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cf1e6-a594-4355-91dc-c8c9cf3d30b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.004760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d822b-015c-4521-aa43-8db49270d758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.006199 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d822b-015c-4521-aa43-8db49270d758 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.007187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d822b-015c-4521-aa43-8db49270d758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.009612 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d822b-015c-4521-aa43-8db49270d758 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.010499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d822b-015c-4521-aa43-8db49270d758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.014047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d822b-015c-4521-aa43-8db49270d758 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.026578 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 612/1225] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:31.028214 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12419924-1357-477d-90b0-0e8432b10c33 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.028754 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12419924-1357-477d-90b0-0e8432b10c33 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.029712 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12419924-1357-477d-90b0-0e8432b10c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.030220 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-cb4cf1e6-a594-4355-91dc-c8c9cf3d30b2 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:31.031943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-cb4cf1e6-a594-4355-91dc-c8c9cf3d30b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:31.039986 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 614/1226] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:31.041153 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde6f17-0104-40d4-81c5-9ec077487634 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.041443 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde6f17-0104-40d4-81c5-9ec077487634 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.041722 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde6f17-0104-40d4-81c5-9ec077487634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.050778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-12419924-1357-477d-90b0-0e8432b10c33 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:31.052064 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-12419924-1357-477d-90b0-0e8432b10c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:31.061838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 613/1227] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:31.063143 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0e01a-9279-4a76-be21-b622ca96a9a0 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.063429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0e01a-9279-4a76-be21-b622ca96a9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.063700 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0e01a-9279-4a76-be21-b622ca96a9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.066470 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-bbde6f17-0104-40d4-81c5-9ec077487634 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:31.067788 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-bbde6f17-0104-40d4-81c5-9ec077487634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:31.076058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 615/1228] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:31.077344 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fab4f-e68c-4cc1-89ca-8bd7c1eaf1c6 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.077634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fab4f-e68c-4cc1-89ca-8bd7c1eaf1c6 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.077907 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fab4f-e68c-4cc1-89ca-8bd7c1eaf1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.083863 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-b8e0e01a-9279-4a76-be21-b622ca96a9a0 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:31.085066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b8e0e01a-9279-4a76-be21-b622ca96a9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:31.093310 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 614/1229] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:31.094491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8de018-9e9c-4bc7-8115-ca719682d639 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.094776 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8de018-9e9c-4bc7-8115-ca719682d639 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.095168 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8de018-9e9c-4bc7-8115-ca719682d639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.097995 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-134fab4f-e68c-4cc1-89ca-8bd7c1eaf1c6 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:31.099231 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-134fab4f-e68c-4cc1-89ca-8bd7c1eaf1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:31.115074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 616/1230] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:31.115074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fab4f-e68c-4cc1-89ca-8bd7c1eaf1c6 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.116158 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-9b8de018-9e9c-4bc7-8115-ca719682d639 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:31.117366 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9b8de018-9e9c-4bc7-8115-ca719682d639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:31.118208 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fab4f-e68c-4cc1-89ca-8bd7c1eaf1c6 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.122860 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71bf3c-e477-41c4-a126-738e3ef61b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.123496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71bf3c-e477-41c4-a126-738e3ef61b19 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.123776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71bf3c-e477-41c4-a126-738e3ef61b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.124044 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71bf3c-e477-41c4-a126-738e3ef61b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.124676 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71bf3c-e477-41c4-a126-738e3ef61b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.126116 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 615/1231] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:31.126444 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71bf3c-e477-41c4-a126-738e3ef61b19 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.127150 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934352f-4bac-4d26-9c55-a4ba0f7511bf None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.127432 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934352f-4bac-4d26-9c55-a4ba0f7511bf None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.127707 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934352f-4bac-4d26-9c55-a4ba0f7511bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.136915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 617/1232] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:31.137876 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71bf3c-e477-41c4-a126-738e3ef61b19 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.147407 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71bf3c-e477-41c4-a126-738e3ef61b19 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.149338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-b934352f-4bac-4d26-9c55-a4ba0f7511bf None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:31.150521 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b934352f-4bac-4d26-9c55-a4ba0f7511bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:31.151959 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ca873-4fd8-46ad-87b5-3789849631af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.152544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ca873-4fd8-46ad-87b5-3789849631af admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.152830 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ca873-4fd8-46ad-87b5-3789849631af admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.153103 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ca873-4fd8-46ad-87b5-3789849631af admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.154273 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ca873-4fd8-46ad-87b5-3789849631af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:35:31.154560 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ca873-4fd8-46ad-87b5-3789849631af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.156165 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ca873-4fd8-46ad-87b5-3789849631af admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.159413 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 616/1233] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:31.160587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696534-3b87-4ff3-a69e-77fced81dc78 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.160863 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696534-3b87-4ff3-a69e-77fced81dc78 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.161129 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd696534-3b87-4ff3-a69e-77fced81dc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.168839 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 618/1234] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:35:31.169985 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ca873-4fd8-46ad-87b5-3789849631af admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.179803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ca873-4fd8-46ad-87b5-3789849631af admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.181565 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-cd696534-3b87-4ff3-a69e-77fced81dc78 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:31.182745 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-cd696534-3b87-4ff3-a69e-77fced81dc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:31.184943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd82894-d81e-41f1-9058-ced82cc3ac1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.185527 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd82894-d81e-41f1-9058-ced82cc3ac1e admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.185815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd82894-d81e-41f1-9058-ced82cc3ac1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.186065 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd82894-d81e-41f1-9058-ced82cc3ac1e admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.186702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd82894-d81e-41f1-9058-ced82cc3ac1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:35:31.187030 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd82894-d81e-41f1-9058-ced82cc3ac1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.188619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd82894-d81e-41f1-9058-ced82cc3ac1e admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.191610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 617/1235] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:31.195322 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd696534-3b87-4ff3-a69e-77fced81dc78 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.200686 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 619/1236] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:35:31.201973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262aa75-7952-4aca-813f-76bd0fe79a3e None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.202264 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262aa75-7952-4aca-813f-76bd0fe79a3e None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.202541 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262aa75-7952-4aca-813f-76bd0fe79a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.205464 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd696534-3b87-4ff3-a69e-77fced81dc78 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.210792 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c1d0b-8c2a-484f-9815-2b22f905c865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.211427 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c1d0b-8c2a-484f-9815-2b22f905c865 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.211703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c1d0b-8c2a-484f-9815-2b22f905c865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.211977 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c1d0b-8c2a-484f-9815-2b22f905c865 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.212638 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c1d0b-8c2a-484f-9815-2b22f905c865 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:35:31.212939 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c1d0b-8c2a-484f-9815-2b22f905c865 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.213936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: WARNING py.warnings [None req-a32c1d0b-8c2a-484f-9815-2b22f905c865 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 20 13:35:31.213936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: warnings.warn(msg) Oct 20 13:35:31.213936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: Oct 20 13:35:31.214806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c1d0b-8c2a-484f-9815-2b22f905c865 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.224101 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-e262aa75-7952-4aca-813f-76bd0fe79a3e None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:31.225239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e262aa75-7952-4aca-813f-76bd0fe79a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:31.235005 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 618/1237] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:35:31.235005 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40553ce3-f0e7-4866-a9b2-ef534bff1ed5 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.235005 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40553ce3-f0e7-4866-a9b2-ef534bff1ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.235005 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40553ce3-f0e7-4866-a9b2-ef534bff1ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.235404 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 620/1238] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:31.235404 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262aa75-7952-4aca-813f-76bd0fe79a3e None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.244438 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262aa75-7952-4aca-813f-76bd0fe79a3e None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.249526 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91214cb-411a-4644-a76b-a096743ac691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.250172 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91214cb-411a-4644-a76b-a096743ac691 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.250449 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91214cb-411a-4644-a76b-a096743ac691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.250722 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91214cb-411a-4644-a76b-a096743ac691 admin admin] PATH_INFO: `/v3/projects/0d7c94a0bc144aa68e03416e0de7b1a8/users/db089c7485f74a819ff8569429bea15b/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.253036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-40553ce3-f0e7-4866-a9b2-ef534bff1ed5 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:31.254224 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-40553ce3-f0e7-4866-a9b2-ef534bff1ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:31.261985 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 619/1239] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:31.263632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3cbcf-8fe2-45e9-b5d3-b580f73cd50f None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.263632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3cbcf-8fe2-45e9-b5d3-b580f73cd50f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.263803 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3cbcf-8fe2-45e9-b5d3-b580f73cd50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.270960 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91214cb-411a-4644-a76b-a096743ac691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7c94a0bc144aa68e03416e0de7b1a8, user_id=db089c7485f74a819ff8569429bea15b, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.273616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91214cb-411a-4644-a76b-a096743ac691 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.286717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0ea3cbcf-8fe2-45e9-b5d3-b580f73cd50f None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:31.287743 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 621/1240] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:31 2022] PUT /identity/v3/projects/0d7c94a0bc144aa68e03416e0de7b1a8/users/db089c7485f74a819ff8569429bea15b/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:31.287980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0ea3cbcf-8fe2-45e9-b5d3-b580f73cd50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:31.288599 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91214cb-411a-4644-a76b-a096743ac691 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.327691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:31.350411 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:31.360886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91214cb-411a-4644-a76b-a096743ac691 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.363837 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 620/1241] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:31.364487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3cbcf-8fe2-45e9-b5d3-b580f73cd50f None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.365544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc13b2-5fe4-4f76-a186-b1a9bee37e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.366162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc13b2-5fe4-4f76-a186-b1a9bee37e8a admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.366442 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc13b2-5fe4-4f76-a186-b1a9bee37e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.366714 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc13b2-5fe4-4f76-a186-b1a9bee37e8a admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.367392 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc13b2-5fe4-4f76-a186-b1a9bee37e8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.368410 dv-cinder-862136-1-smb devstack@keystone.service[81426]: WARNING py.warnings [None req-93dc13b2-5fe4-4f76-a186-b1a9bee37e8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 13:35:31.368410 dv-cinder-862136-1-smb devstack@keystone.service[81426]: warnings.warn(msg) Oct 20 13:35:31.368410 dv-cinder-862136-1-smb devstack@keystone.service[81426]: Oct 20 13:35:31.369601 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc13b2-5fe4-4f76-a186-b1a9bee37e8a admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.373822 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3cbcf-8fe2-45e9-b5d3-b580f73cd50f None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.378325 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170901ba-137d-46b4-aa19-24fb3398a3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.378998 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170901ba-137d-46b4-aa19-24fb3398a3dd admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.379283 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170901ba-137d-46b4-aa19-24fb3398a3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.379551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170901ba-137d-46b4-aa19-24fb3398a3dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.380178 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170901ba-137d-46b4-aa19-24fb3398a3dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:35:31.380506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170901ba-137d-46b4-aa19-24fb3398a3dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.382200 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170901ba-137d-46b4-aa19-24fb3398a3dd admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.396356 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 621/1242] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:35:31.397152 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170901ba-137d-46b4-aa19-24fb3398a3dd admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.401228 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 622/1243] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:31.402135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc13b2-5fe4-4f76-a186-b1a9bee37e8a admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.407554 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170901ba-137d-46b4-aa19-24fb3398a3dd admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.463441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567f107-c79f-47a5-b372-0aa38aff5811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.464045 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567f107-c79f-47a5-b372-0aa38aff5811 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.464327 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567f107-c79f-47a5-b372-0aa38aff5811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.464603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567f107-c79f-47a5-b372-0aa38aff5811 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.464770 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc13b2-5fe4-4f76-a186-b1a9bee37e8a admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.465246 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567f107-c79f-47a5-b372-0aa38aff5811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.467709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f567f107-c79f-47a5-b372-0aa38aff5811 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.469991 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dad6f3-40f0-417a-b83e-ec8c23b1d8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.470611 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dad6f3-40f0-417a-b83e-ec8c23b1d8dd admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.470896 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dad6f3-40f0-417a-b83e-ec8c23b1d8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.471205 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dad6f3-40f0-417a-b83e-ec8c23b1d8dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.471849 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dad6f3-40f0-417a-b83e-ec8c23b1d8dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.473786 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dad6f3-40f0-417a-b83e-ec8c23b1d8dd admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.496294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 622/1244] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:31.497770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567f107-c79f-47a5-b372-0aa38aff5811 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.502840 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 623/1245] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:31.503749 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dad6f3-40f0-417a-b83e-ec8c23b1d8dd admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.561433 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567f107-c79f-47a5-b372-0aa38aff5811 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.565312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dad6f3-40f0-417a-b83e-ec8c23b1d8dd admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.566108 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c17f2-baad-4fbf-8eae-bbe70d8a0c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.566717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c17f2-baad-4fbf-8eae-bbe70d8a0c6b admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.567019 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c17f2-baad-4fbf-8eae-bbe70d8a0c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.567296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c17f2-baad-4fbf-8eae-bbe70d8a0c6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.567940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c17f2-baad-4fbf-8eae-bbe70d8a0c6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:35:31.568244 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c17f2-baad-4fbf-8eae-bbe70d8a0c6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.569821 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c17f2-baad-4fbf-8eae-bbe70d8a0c6b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.570065 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8799e9f-a4cd-4a46-a7b6-8a812112b7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.570660 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8799e9f-a4cd-4a46-a7b6-8a812112b7cd admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.570936 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8799e9f-a4cd-4a46-a7b6-8a812112b7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.572111 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8799e9f-a4cd-4a46-a7b6-8a812112b7cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.572111 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8799e9f-a4cd-4a46-a7b6-8a812112b7cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:35:31.572111 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8799e9f-a4cd-4a46-a7b6-8a812112b7cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.573703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8799e9f-a4cd-4a46-a7b6-8a812112b7cd admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.583291 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 623/1246] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:35:31.584581 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f937ec-e896-4c37-958f-b2d2c67db4ee None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.584864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f937ec-e896-4c37-958f-b2d2c67db4ee None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.585139 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f937ec-e896-4c37-958f-b2d2c67db4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.591888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 624/1247] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:35:31.592983 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8799e9f-a4cd-4a46-a7b6-8a812112b7cd admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.602995 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8799e9f-a4cd-4a46-a7b6-8a812112b7cd admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.607967 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c31581-9d03-4d9e-b4e5-59b17a404405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.608574 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c31581-9d03-4d9e-b4e5-59b17a404405 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.608856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c31581-9d03-4d9e-b4e5-59b17a404405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.609132 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c31581-9d03-4d9e-b4e5-59b17a404405 admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.609774 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c31581-9d03-4d9e-b4e5-59b17a404405 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:35:31.610113 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c31581-9d03-4d9e-b4e5-59b17a404405 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.612014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c31581-9d03-4d9e-b4e5-59b17a404405 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.613153 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-18f937ec-e896-4c37-958f-b2d2c67db4ee None None] MFA Rules not processed for user `db089c7485f74a819ff8569429bea15b`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:31.614365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-18f937ec-e896-4c37-958f-b2d2c67db4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:31.624359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 625/1248] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:35:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:35:31.625508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c31581-9d03-4d9e-b4e5-59b17a404405 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.635050 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c31581-9d03-4d9e-b4e5-59b17a404405 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.640100 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512fb26-3865-43bd-85ee-f33a55fbe0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.640691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512fb26-3865-43bd-85ee-f33a55fbe0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.640969 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512fb26-3865-43bd-85ee-f33a55fbe0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.641242 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512fb26-3865-43bd-85ee-f33a55fbe0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.641864 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512fb26-3865-43bd-85ee-f33a55fbe0d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.643803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512fb26-3865-43bd-85ee-f33a55fbe0d6 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.666233 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 626/1249] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/users => generated 288 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:31.667100 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512fb26-3865-43bd-85ee-f33a55fbe0d6 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.674300 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:31.679195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:31.680454 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512fb26-3865-43bd-85ee-f33a55fbe0d6 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.687032 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897a071-1afe-48b3-87d2-be77aa17b2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.687705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897a071-1afe-48b3-87d2-be77aa17b2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.688056 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897a071-1afe-48b3-87d2-be77aa17b2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.688482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897a071-1afe-48b3-87d2-be77aa17b2d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.689171 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897a071-1afe-48b3-87d2-be77aa17b2d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.689973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 624/1250] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:31.691076 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f937ec-e896-4c37-958f-b2d2c67db4ee None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.691327 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897a071-1afe-48b3-87d2-be77aa17b2d7 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.702423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f937ec-e896-4c37-958f-b2d2c67db4ee None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.707184 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee768b2-6936-4486-9c70-5f2712e85e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.707792 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee768b2-6936-4486-9c70-5f2712e85e64 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.708072 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee768b2-6936-4486-9c70-5f2712e85e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.708825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee768b2-6936-4486-9c70-5f2712e85e64 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.709008 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee768b2-6936-4486-9c70-5f2712e85e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.710055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: WARNING py.warnings [None req-9ee768b2-6936-4486-9c70-5f2712e85e64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 13:35:31.710055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: warnings.warn(msg) Oct 20 13:35:31.710055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: Oct 20 13:35:31.711515 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee768b2-6936-4486-9c70-5f2712e85e64 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.724425 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 627/1251] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:31.725577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897a071-1afe-48b3-87d2-be77aa17b2d7 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.739647 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 625/1252] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/users => generated 289 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:31.740513 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee768b2-6936-4486-9c70-5f2712e85e64 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.750383 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee768b2-6936-4486-9c70-5f2712e85e64 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.793243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897a071-1afe-48b3-87d2-be77aa17b2d7 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.798707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c8af4-c4da-474c-bfa6-99dbf3669980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.799351 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8af4-c4da-474c-bfa6-99dbf3669980 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.799635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8af4-c4da-474c-bfa6-99dbf3669980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.799914 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8af4-c4da-474c-bfa6-99dbf3669980 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.800538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c8af4-c4da-474c-bfa6-99dbf3669980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.802454 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c8af4-c4da-474c-bfa6-99dbf3669980 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.809058 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c9062-b781-4a1b-a377-3421159d2723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.810253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c9062-b781-4a1b-a377-3421159d2723 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.810545 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c9062-b781-4a1b-a377-3421159d2723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.810823 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c9062-b781-4a1b-a377-3421159d2723 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.811491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c9062-b781-4a1b-a377-3421159d2723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.813891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c9062-b781-4a1b-a377-3421159d2723 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.823967 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 628/1253] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:31.824941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c8af4-c4da-474c-bfa6-99dbf3669980 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.835400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c8af4-c4da-474c-bfa6-99dbf3669980 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.841139 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bdfed-828e-4e35-ae33-f917f74727fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.841880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bdfed-828e-4e35-ae33-f917f74727fe admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.842257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bdfed-828e-4e35-ae33-f917f74727fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.842604 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260bdfed-828e-4e35-ae33-f917f74727fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.843329 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bdfed-828e-4e35-ae33-f917f74727fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.845422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260bdfed-828e-4e35-ae33-f917f74727fe admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.850039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 626/1254] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:31.850039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c9062-b781-4a1b-a377-3421159d2723 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.875760 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 629/1255] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:31.876604 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bdfed-828e-4e35-ae33-f917f74727fe admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.917726 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c9062-b781-4a1b-a377-3421159d2723 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.940070 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260bdfed-828e-4e35-ae33-f917f74727fe admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.945129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61275fdb-be5b-4968-b761-56139347c461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.945738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61275fdb-be5b-4968-b761-56139347c461 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.946021 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61275fdb-be5b-4968-b761-56139347c461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.946297 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61275fdb-be5b-4968-b761-56139347c461 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.946937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61275fdb-be5b-4968-b761-56139347c461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.948573 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61275fdb-be5b-4968-b761-56139347c461 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.958513 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 630/1256] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:31.959757 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c3504-5ce8-4e18-85f1-28dd7c3f99d2 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.960044 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c3504-5ce8-4e18-85f1-28dd7c3f99d2 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.960319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c3504-5ce8-4e18-85f1-28dd7c3f99d2 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.961685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 631/1257] 10.222.0.36 () {54 vars in 961 bytes} [Thu Oct 20 13:35:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:35:31.962197 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c3504-5ce8-4e18-85f1-28dd7c3f99d2 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:31.976497 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c3504-5ce8-4e18-85f1-28dd7c3f99d2 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:31.977749 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30105ca6-f423-4e47-982c-80f6aeee2960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.978363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30105ca6-f423-4e47-982c-80f6aeee2960 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.978644 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30105ca6-f423-4e47-982c-80f6aeee2960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.978914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30105ca6-f423-4e47-982c-80f6aeee2960 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.979587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30105ca6-f423-4e47-982c-80f6aeee2960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.981160 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf63c3-8303-412c-a1eb-ef2d39c668ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:31.982084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30105ca6-f423-4e47-982c-80f6aeee2960 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.982621 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf63c3-8303-412c-a1eb-ef2d39c668ea admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:31.983284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf63c3-8303-412c-a1eb-ef2d39c668ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:31.983563 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf63c3-8303-412c-a1eb-ef2d39c668ea admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:31.984531 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf63c3-8303-412c-a1eb-ef2d39c668ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:31.986785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf63c3-8303-412c-a1eb-ef2d39c668ea admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:31.997508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:32.013178 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 632/1258] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/users => generated 292 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:32.013178 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf63c3-8303-412c-a1eb-ef2d39c668ea admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.013560 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 627/1259] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:31 2022] POST /identity/v3/projects => generated 403 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:32.014429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30105ca6-f423-4e47-982c-80f6aeee2960 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.020496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf63c3-8303-412c-a1eb-ef2d39c668ea admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.043612 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:32.076885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30105ca6-f423-4e47-982c-80f6aeee2960 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.077312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ff3e3-53c4-467e-9279-536563c5972c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.077950 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ff3e3-53c4-467e-9279-536563c5972c admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.078229 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ff3e3-53c4-467e-9279-536563c5972c admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.078498 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ff3e3-53c4-467e-9279-536563c5972c admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.079160 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ff3e3-53c4-467e-9279-536563c5972c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.080749 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ff3e3-53c4-467e-9279-536563c5972c admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.081689 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcaf23-36c7-4adb-be74-395aaaeae7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.082680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcaf23-36c7-4adb-be74-395aaaeae7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.082984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcaf23-36c7-4adb-be74-395aaaeae7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.083271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcaf23-36c7-4adb-be74-395aaaeae7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.083916 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcaf23-36c7-4adb-be74-395aaaeae7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.085562 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcaf23-36c7-4adb-be74-395aaaeae7d0 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.091882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 633/1260] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:32.092699 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ff3e3-53c4-467e-9279-536563c5972c admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.099420 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 628/1261] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:32.099420 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcaf23-36c7-4adb-be74-395aaaeae7d0 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.103719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ff3e3-53c4-467e-9279-536563c5972c admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.107963 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcaf23-36c7-4adb-be74-395aaaeae7d0 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.109485 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c977c69-24e8-4a21-8031-ecdd4d65b01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.110084 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c977c69-24e8-4a21-8031-ecdd4d65b01e admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.110362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c977c69-24e8-4a21-8031-ecdd4d65b01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.110663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c977c69-24e8-4a21-8031-ecdd4d65b01e admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.111311 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c977c69-24e8-4a21-8031-ecdd4d65b01e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.112487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397282b-52d9-47d8-8b75-d2b43206be15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.113070 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397282b-52d9-47d8-8b75-d2b43206be15 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.113178 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c977c69-24e8-4a21-8031-ecdd4d65b01e admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.113348 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397282b-52d9-47d8-8b75-d2b43206be15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.113621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397282b-52d9-47d8-8b75-d2b43206be15 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.114237 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397282b-52d9-47d8-8b75-d2b43206be15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.116145 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397282b-52d9-47d8-8b75-d2b43206be15 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.135005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 634/1262] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:32 2022] POST /identity/v3/users => generated 296 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:32.135958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c977c69-24e8-4a21-8031-ecdd4d65b01e admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.139135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 629/1263] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:32 2022] POST /identity/v3/users => generated 291 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:32.140497 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778cbe8-13e0-475c-8385-e07f637bf738 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.140791 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778cbe8-13e0-475c-8385-e07f637bf738 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.141066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778cbe8-13e0-475c-8385-e07f637bf738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.146167 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c977c69-24e8-4a21-8031-ecdd4d65b01e admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.151946 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1911df8-b307-4fa9-a4aa-dbf7bb716f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.152546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1911df8-b307-4fa9-a4aa-dbf7bb716f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.152824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1911df8-b307-4fa9-a4aa-dbf7bb716f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.153095 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1911df8-b307-4fa9-a4aa-dbf7bb716f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.154258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1911df8-b307-4fa9-a4aa-dbf7bb716f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.156410 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1911df8-b307-4fa9-a4aa-dbf7bb716f59 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.167077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 635/1264] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:32.168669 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1911df8-b307-4fa9-a4aa-dbf7bb716f59 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.179793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1911df8-b307-4fa9-a4aa-dbf7bb716f59 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.180107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-a778cbe8-13e0-475c-8385-e07f637bf738 None None] MFA Rules not processed for user `674c5b25932a41309428ba6c6c72ed02`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:32.181321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a778cbe8-13e0-475c-8385-e07f637bf738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:32.184458 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48a433-a1e9-43fc-a969-ebda5cd367ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.185226 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48a433-a1e9-43fc-a969-ebda5cd367ab admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.185501 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48a433-a1e9-43fc-a969-ebda5cd367ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.185853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48a433-a1e9-43fc-a969-ebda5cd367ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.186485 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48a433-a1e9-43fc-a969-ebda5cd367ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.188125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48a433-a1e9-43fc-a969-ebda5cd367ab admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.202398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 636/1265] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:32.202398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48a433-a1e9-43fc-a969-ebda5cd367ab admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.212772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48a433-a1e9-43fc-a969-ebda5cd367ab admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.217844 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf490a-ef04-4eeb-bff3-868ff0439b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.218430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf490a-ef04-4eeb-bff3-868ff0439b11 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.218709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf490a-ef04-4eeb-bff3-868ff0439b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.218997 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf490a-ef04-4eeb-bff3-868ff0439b11 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.219617 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf490a-ef04-4eeb-bff3-868ff0439b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.221500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf490a-ef04-4eeb-bff3-868ff0439b11 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.243288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 637/1266] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:32 2022] POST /identity/v3/users => generated 302 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:32.244078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf490a-ef04-4eeb-bff3-868ff0439b11 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.253616 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 630/1267] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Oct 20 13:35:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:32.254708 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778cbe8-13e0-475c-8385-e07f637bf738 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.255481 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf490a-ef04-4eeb-bff3-868ff0439b11 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.260019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da9f6c-260d-4c13-a58d-a7f66fafc98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.261069 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da9f6c-260d-4c13-a58d-a7f66fafc98d admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.261069 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da9f6c-260d-4c13-a58d-a7f66fafc98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.261312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da9f6c-260d-4c13-a58d-a7f66fafc98d admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.261734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da9f6c-260d-4c13-a58d-a7f66fafc98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.264085 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da9f6c-260d-4c13-a58d-a7f66fafc98d admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.266395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778cbe8-13e0-475c-8385-e07f637bf738 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.271479 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d235bb1-567d-4eb1-9746-21a8e9a8bcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.272069 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d235bb1-567d-4eb1-9746-21a8e9a8bcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.272344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d235bb1-567d-4eb1-9746-21a8e9a8bcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.272612 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d235bb1-567d-4eb1-9746-21a8e9a8bcc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.273233 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d235bb1-567d-4eb1-9746-21a8e9a8bcc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.274269 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 638/1268] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:32.274803 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d235bb1-567d-4eb1-9746-21a8e9a8bcc7 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.275083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da9f6c-260d-4c13-a58d-a7f66fafc98d admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.284381 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da9f6c-260d-4c13-a58d-a7f66fafc98d admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.286834 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 631/1269] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:32.287700 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d235bb1-567d-4eb1-9746-21a8e9a8bcc7 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.291927 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68d4ec-0aea-4fe9-b872-38ba433f6473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.292508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68d4ec-0aea-4fe9-b872-38ba433f6473 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.292781 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68d4ec-0aea-4fe9-b872-38ba433f6473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.293048 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68d4ec-0aea-4fe9-b872-38ba433f6473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.293678 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68d4ec-0aea-4fe9-b872-38ba433f6473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.295878 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68d4ec-0aea-4fe9-b872-38ba433f6473 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.297552 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d235bb1-567d-4eb1-9746-21a8e9a8bcc7 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.302110 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405d978-6445-491d-b434-483ed47d8550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.302682 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405d978-6445-491d-b434-483ed47d8550 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.303244 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405d978-6445-491d-b434-483ed47d8550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.303511 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405d978-6445-491d-b434-483ed47d8550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.304266 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405d978-6445-491d-b434-483ed47d8550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.305818 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405d978-6445-491d-b434-483ed47d8550 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.306580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 639/1270] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:32.307576 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68d4ec-0aea-4fe9-b872-38ba433f6473 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.316019 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 632/1271] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:32.316820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405d978-6445-491d-b434-483ed47d8550 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.318009 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68d4ec-0aea-4fe9-b872-38ba433f6473 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.323328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe517dc6-b164-4e7c-9f3c-14ffdffa9581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.323980 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe517dc6-b164-4e7c-9f3c-14ffdffa9581 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.324424 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe517dc6-b164-4e7c-9f3c-14ffdffa9581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.324701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe517dc6-b164-4e7c-9f3c-14ffdffa9581 admin admin] PATH_INFO: `/v3/projects/066aae5e3d3f4e6fbc2e750a2248a7fb/users/274bdb52067d4788a0c628e6d900c2df/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.326837 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405d978-6445-491d-b434-483ed47d8550 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.331584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3c0ff-f94a-4689-a464-88bec55c4dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.332167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3c0ff-f94a-4689-a464-88bec55c4dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.332444 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3c0ff-f94a-4689-a464-88bec55c4dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.332716 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3c0ff-f94a-4689-a464-88bec55c4dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.333347 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3c0ff-f94a-4689-a464-88bec55c4dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.334924 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3c0ff-f94a-4689-a464-88bec55c4dc2 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.340611 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe517dc6-b164-4e7c-9f3c-14ffdffa9581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=066aae5e3d3f4e6fbc2e750a2248a7fb, user_id=274bdb52067d4788a0c628e6d900c2df, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.344001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe517dc6-b164-4e7c-9f3c-14ffdffa9581 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.345467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 633/1272] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:32.346176 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3c0ff-f94a-4689-a464-88bec55c4dc2 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.356200 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3c0ff-f94a-4689-a464-88bec55c4dc2 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.358152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 640/1273] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:32 2022] PUT /identity/v3/projects/066aae5e3d3f4e6fbc2e750a2248a7fb/users/274bdb52067d4788a0c628e6d900c2df/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:32.358727 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe517dc6-b164-4e7c-9f3c-14ffdffa9581 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.374710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:32.416251 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0020d-2b94-44e7-9957-83c2018cd739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.416856 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0020d-2b94-44e7-9957-83c2018cd739 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.417130 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0020d-2b94-44e7-9957-83c2018cd739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.417527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0020d-2b94-44e7-9957-83c2018cd739 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.418157 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0020d-2b94-44e7-9957-83c2018cd739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.420339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0020d-2b94-44e7-9957-83c2018cd739 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.430230 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 634/1274] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:32.430853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe517dc6-b164-4e7c-9f3c-14ffdffa9581 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.431067 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0020d-2b94-44e7-9957-83c2018cd739 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.437111 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80ee44-dab8-4315-9150-140b5ca56ca6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.437804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80ee44-dab8-4315-9150-140b5ca56ca6 service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.438181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80ee44-dab8-4315-9150-140b5ca56ca6 service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.438513 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80ee44-dab8-4315-9150-140b5ca56ca6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.440393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0020d-2b94-44e7-9957-83c2018cd739 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.444885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9221e-844b-41b7-b4f7-138c71c4b8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.445500 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9221e-844b-41b7-b4f7-138c71c4b8e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.445779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9221e-844b-41b7-b4f7-138c71c4b8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.446047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9221e-844b-41b7-b4f7-138c71c4b8e5 admin admin] PATH_INFO: `/v3/projects/0a187d79a34348969024e69cd93247ef/users/c876087fad0e47878030edc53e43c39d/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.453733 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:32.461520 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9221e-844b-41b7-b4f7-138c71c4b8e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a187d79a34348969024e69cd93247ef, user_id=c876087fad0e47878030edc53e43c39d, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.464192 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9221e-844b-41b7-b4f7-138c71c4b8e5 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.477339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 635/1275] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:32 2022] PUT /identity/v3/projects/0a187d79a34348969024e69cd93247ef/users/c876087fad0e47878030edc53e43c39d/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:32.481400 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9221e-844b-41b7-b4f7-138c71c4b8e5 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.503724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80ee44-dab8-4315-9150-140b5ca56ca6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.505318 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f80ee44-dab8-4315-9150-140b5ca56ca6 service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.514885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 641/1276] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:32.515657 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80ee44-dab8-4315-9150-140b5ca56ca6 service nova] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.525345 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f80ee44-dab8-4315-9150-140b5ca56ca6 service nova] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.541648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9221e-844b-41b7-b4f7-138c71c4b8e5 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.547967 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d280d7-1a3d-45ef-bb7d-0a2f06e8ff2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.548726 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d280d7-1a3d-45ef-bb7d-0a2f06e8ff2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.549104 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d280d7-1a3d-45ef-bb7d-0a2f06e8ff2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.549476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d280d7-1a3d-45ef-bb7d-0a2f06e8ff2f admin admin] PATH_INFO: `/v3/projects/226c257b21904e8a920f96c983779465/users/80f35c5b020a4347bda01e4ea26c6270/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.566119 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d280d7-1a3d-45ef-bb7d-0a2f06e8ff2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=226c257b21904e8a920f96c983779465, user_id=80f35c5b020a4347bda01e4ea26c6270, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.568948 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d280d7-1a3d-45ef-bb7d-0a2f06e8ff2f admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.584295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 636/1277] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:32 2022] PUT /identity/v3/projects/226c257b21904e8a920f96c983779465/users/80f35c5b020a4347bda01e4ea26c6270/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:32.585386 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d280d7-1a3d-45ef-bb7d-0a2f06e8ff2f admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.592065 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d74885-a1cc-4b09-bf8d-66a7cadf9860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.592793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d74885-a1cc-4b09-bf8d-66a7cadf9860 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.593175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d74885-a1cc-4b09-bf8d-66a7cadf9860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.593536 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d74885-a1cc-4b09-bf8d-66a7cadf9860 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.594271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d74885-a1cc-4b09-bf8d-66a7cadf9860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.596061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d74885-a1cc-4b09-bf8d-66a7cadf9860 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.609633 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 642/1278] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:32.609633 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d74885-a1cc-4b09-bf8d-66a7cadf9860 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.617702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d74885-a1cc-4b09-bf8d-66a7cadf9860 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.663570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d280d7-1a3d-45ef-bb7d-0a2f06e8ff2f admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.669139 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aef645-e68a-4a49-b9cd-45fba94fc82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.669845 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aef645-e68a-4a49-b9cd-45fba94fc82b admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.670150 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aef645-e68a-4a49-b9cd-45fba94fc82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.670388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aef645-e68a-4a49-b9cd-45fba94fc82b admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.671130 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aef645-e68a-4a49-b9cd-45fba94fc82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.672782 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aef645-e68a-4a49-b9cd-45fba94fc82b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.681287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127edc3-3d74-441a-a615-1703bfcd44b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.682148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127edc3-3d74-441a-a615-1703bfcd44b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.682427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127edc3-3d74-441a-a615-1703bfcd44b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.682702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127edc3-3d74-441a-a615-1703bfcd44b1 admin admin] PATH_INFO: `/v3/projects/d3b6b166bcec4341958b0fae2b102b0c/users/5a5e3fbff7fa4bb0aa4644fb9a69198a/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.683253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 637/1279] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:32.685128 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d3948-76ec-4601-b226-0f8b2fb464ee None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.685407 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d3948-76ec-4601-b226-0f8b2fb464ee None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.685685 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d3948-76ec-4601-b226-0f8b2fb464ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.705326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127edc3-3d74-441a-a615-1703bfcd44b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b6b166bcec4341958b0fae2b102b0c, user_id=5a5e3fbff7fa4bb0aa4644fb9a69198a, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.708313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127edc3-3d74-441a-a615-1703bfcd44b1 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.709436 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0d8d3948-76ec-4601-b226-0f8b2fb464ee None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:32.710683 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0d8d3948-76ec-4601-b226-0f8b2fb464ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:32.722864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 638/1280] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:32.722864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d3948-76ec-4601-b226-0f8b2fb464ee None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.728013 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 643/1281] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:32 2022] PUT /identity/v3/projects/d3b6b166bcec4341958b0fae2b102b0c/users/5a5e3fbff7fa4bb0aa4644fb9a69198a/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:32.729733 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde90ad4-6e76-44f8-9305-449b35d444bb None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.730147 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde90ad4-6e76-44f8-9305-449b35d444bb None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.730544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde90ad4-6e76-44f8-9305-449b35d444bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.739105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d3948-76ec-4601-b226-0f8b2fb464ee None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.740196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:32.759117 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-bde90ad4-6e76-44f8-9305-449b35d444bb None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:32.760332 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-bde90ad4-6e76-44f8-9305-449b35d444bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:32.792188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:32.802445 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339e6d1-64b3-4760-86ab-a1a77e343733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.803365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339e6d1-64b3-4760-86ab-a1a77e343733 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.803644 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339e6d1-64b3-4760-86ab-a1a77e343733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.803916 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339e6d1-64b3-4760-86ab-a1a77e343733 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.804553 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339e6d1-64b3-4760-86ab-a1a77e343733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.806123 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339e6d1-64b3-4760-86ab-a1a77e343733 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.816653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 639/1282] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:32.817839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7eb45-f311-4af9-b8d9-7e3abb8008dc None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.818176 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7eb45-f311-4af9-b8d9-7e3abb8008dc None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.818479 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7eb45-f311-4af9-b8d9-7e3abb8008dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.825783 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 644/1283] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:32.829043 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde90ad4-6e76-44f8-9305-449b35d444bb None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.836263 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde90ad4-6e76-44f8-9305-449b35d444bb None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.841386 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd80ad-2840-4f21-ba92-4696e7c75054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.842046 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd80ad-2840-4f21-ba92-4696e7c75054 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.842324 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd80ad-2840-4f21-ba92-4696e7c75054 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.842596 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd80ad-2840-4f21-ba92-4696e7c75054 admin admin] PATH_INFO: `/v3/projects/a6b5308342dc4c809406290d79bccfe9/users/4019f657541a4c2ab6e6cdf2bb82a99e/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.847383 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-2ca7eb45-f311-4af9-b8d9-7e3abb8008dc None None] MFA Rules not processed for user `80f35c5b020a4347bda01e4ea26c6270`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:32.848604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2ca7eb45-f311-4af9-b8d9-7e3abb8008dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:32.858150 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd80ad-2840-4f21-ba92-4696e7c75054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b5308342dc4c809406290d79bccfe9, user_id=4019f657541a4c2ab6e6cdf2bb82a99e, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.860813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd80ad-2840-4f21-ba92-4696e7c75054 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.878250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 645/1284] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:32 2022] PUT /identity/v3/projects/a6b5308342dc4c809406290d79bccfe9/users/4019f657541a4c2ab6e6cdf2bb82a99e/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:32.879127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd80ad-2840-4f21-ba92-4696e7c75054 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.917365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 640/1285] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:32.918224 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7eb45-f311-4af9-b8d9-7e3abb8008dc None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:32.920558 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2ca7eb45-f311-4af9-b8d9-7e3abb8008dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:32.945359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd80ad-2840-4f21-ba92-4696e7c75054 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.950572 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd31f92-943e-416b-89c9-e23e7437f65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:32.951721 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd31f92-943e-416b-89c9-e23e7437f65a admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.951997 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd31f92-943e-416b-89c9-e23e7437f65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.952279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd31f92-943e-416b-89c9-e23e7437f65a admin admin] PATH_INFO: `/v3/projects/b5312c113df844828b89745c232f4302/users/47e87b58a1424c199052992cdea6e747/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:32.966918 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd31f92-943e-416b-89c9-e23e7437f65a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5312c113df844828b89745c232f4302, user_id=47e87b58a1424c199052992cdea6e747, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:32.969602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd31f92-943e-416b-89c9-e23e7437f65a admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:32.976530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7eb45-f311-4af9-b8d9-7e3abb8008dc None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:32.982530 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 646/1286] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:32 2022] PUT /identity/v3/projects/b5312c113df844828b89745c232f4302/users/47e87b58a1424c199052992cdea6e747/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:32.984350 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4aec92-a1b0-4f06-9297-f4f206bb1236 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:32.984640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4aec92-a1b0-4f06-9297-f4f206bb1236 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:32.984937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4aec92-a1b0-4f06-9297-f4f206bb1236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.014117 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-af4aec92-a1b0-4f06-9297-f4f206bb1236 None None] MFA Rules not processed for user `5a5e3fbff7fa4bb0aa4644fb9a69198a`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:33.015375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-af4aec92-a1b0-4f06-9297-f4f206bb1236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:33.030578 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:33.036456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46fb48-6ed1-4fd2-b0ba-effa0d75a90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:33.037066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46fb48-6ed1-4fd2-b0ba-effa0d75a90f service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.037346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46fb48-6ed1-4fd2-b0ba-effa0d75a90f service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.037625 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46fb48-6ed1-4fd2-b0ba-effa0d75a90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.080622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 647/1287] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:33.081800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e9269-c8ff-407e-8ff1-f2dae77c59f4 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.082089 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e9269-c8ff-407e-8ff1-f2dae77c59f4 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.082364 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e9269-c8ff-407e-8ff1-f2dae77c59f4 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.083620 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 648/1288] 10.222.0.36 () {54 vars in 912 bytes} [Thu Oct 20 13:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:35:33.084283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e9269-c8ff-407e-8ff1-f2dae77c59f4 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:33.107883 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46fb48-6ed1-4fd2-b0ba-effa0d75a90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:33.110036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46fb48-6ed1-4fd2-b0ba-effa0d75a90f service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:33.115602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:33.122715 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 641/1289] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:33.123764 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46fb48-6ed1-4fd2-b0ba-effa0d75a90f service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:33.131990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46fb48-6ed1-4fd2-b0ba-effa0d75a90f service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:33.136087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6983432b-fba1-42c3-86fd-a5d5022c25ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:33.136739 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983432b-fba1-42c3-86fd-a5d5022c25ac service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.137016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983432b-fba1-42c3-86fd-a5d5022c25ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.137317 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6983432b-fba1-42c3-86fd-a5d5022c25ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.146867 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983432b-fba1-42c3-86fd-a5d5022c25ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:33.148410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6983432b-fba1-42c3-86fd-a5d5022c25ac service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:33.157713 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e9269-c8ff-407e-8ff1-f2dae77c59f4 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:33.158395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 642/1290] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:33.159736 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44238e-c069-4b21-831a-0bbb3a77fc30 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.160027 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44238e-c069-4b21-831a-0bbb3a77fc30 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.160312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44238e-c069-4b21-831a-0bbb3a77fc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.162942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731973b-e155-4b94-8d78-86a150458249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:33.163637 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731973b-e155-4b94-8d78-86a150458249 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.163964 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731973b-e155-4b94-8d78-86a150458249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.164196 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731973b-e155-4b94-8d78-86a150458249 admin admin] PATH_INFO: `/v3/projects/5a722d04911a4165bc61c38271a09aca/users/0176d88da55447e9be312ff577f4d56a/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.180630 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731973b-e155-4b94-8d78-86a150458249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a722d04911a4165bc61c38271a09aca, user_id=0176d88da55447e9be312ff577f4d56a, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:33.181906 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-1f44238e-c069-4b21-831a-0bbb3a77fc30 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:33.183243 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1f44238e-c069-4b21-831a-0bbb3a77fc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:33.183491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731973b-e155-4b94-8d78-86a150458249 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:33.194379 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 643/1291] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:33.198725 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44238e-c069-4b21-831a-0bbb3a77fc30 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:33.201758 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 649/1292] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:33 2022] PUT /identity/v3/projects/5a722d04911a4165bc61c38271a09aca/users/0176d88da55447e9be312ff577f4d56a/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:33.203397 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6069b5-38a5-4cf0-82a4-f861704a7a3d None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.203783 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6069b5-38a5-4cf0-82a4-f861704a7a3d None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.204061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6069b5-38a5-4cf0-82a4-f861704a7a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.209215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44238e-c069-4b21-831a-0bbb3a77fc30 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:33.234650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-6e6069b5-38a5-4cf0-82a4-f861704a7a3d None None] MFA Rules not processed for user `47e87b58a1424c199052992cdea6e747`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:33.236147 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6e6069b5-38a5-4cf0-82a4-f861704a7a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:33.272956 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effc1a19-0bf6-49fc-bc65-11b8e4a3fe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:33.273858 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc1a19-0bf6-49fc-bc65-11b8e4a3fe1d admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.274231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc1a19-0bf6-49fc-bc65-11b8e4a3fe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.275237 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effc1a19-0bf6-49fc-bc65-11b8e4a3fe1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.275919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc1a19-0bf6-49fc-bc65-11b8e4a3fe1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:33.278017 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effc1a19-0bf6-49fc-bc65-11b8e4a3fe1d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:33.311704 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 644/1293] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:33 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:33.313439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2bccb-4f09-46ca-9f3f-7df57cfc50ca None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.313798 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2bccb-4f09-46ca-9f3f-7df57cfc50ca None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.314383 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2bccb-4f09-46ca-9f3f-7df57cfc50ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.321683 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 650/1294] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:33.323739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702f3b7-dc13-468c-b609-d722c87f3ae4 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.324323 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702f3b7-dc13-468c-b609-d722c87f3ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.325566 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702f3b7-dc13-468c-b609-d722c87f3ae4 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.327396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 651/1295] 10.222.0.36 () {54 vars in 961 bytes} [Thu Oct 20 13:35:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:35:33.328858 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d03b0d-f09f-422c-aec3-0c6b5363297d None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.329350 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d03b0d-f09f-422c-aec3-0c6b5363297d None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.329795 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d03b0d-f09f-422c-aec3-0c6b5363297d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.337736 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-cda2bccb-4f09-46ca-9f3f-7df57cfc50ca None None] MFA Rules not processed for user `674c5b25932a41309428ba6c6c72ed02`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:33.338889 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-cda2bccb-4f09-46ca-9f3f-7df57cfc50ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:33.354818 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-58d03b0d-f09f-422c-aec3-0c6b5363297d None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:33.356075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-58d03b0d-f09f-422c-aec3-0c6b5363297d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:33.411366 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:33.429490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 645/1296] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Oct 20 13:35:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:33.430508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2bccb-4f09-46ca-9f3f-7df57cfc50ca None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:33.430896 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 652/1297] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:33.431862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d03b0d-f09f-422c-aec3-0c6b5363297d None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:33.443793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d03b0d-f09f-422c-aec3-0c6b5363297d None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:33.451740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f8d11-9f02-46d0-96eb-766dd2a49544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:33.452555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f8d11-9f02-46d0-96eb-766dd2a49544 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.452827 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f8d11-9f02-46d0-96eb-766dd2a49544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.453328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f8d11-9f02-46d0-96eb-766dd2a49544 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.454203 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f8d11-9f02-46d0-96eb-766dd2a49544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:33.456776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f8d11-9f02-46d0-96eb-766dd2a49544 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:33.486533 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 653/1298] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:33 2022] POST /identity/v3/users => generated 293 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:33.487748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f8d11-9f02-46d0-96eb-766dd2a49544 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:33.498972 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f8d11-9f02-46d0-96eb-766dd2a49544 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:33.502001 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2bccb-4f09-46ca-9f3f-7df57cfc50ca None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:33.503922 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6c79b-eced-420b-99fc-9246954a1e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:33.504522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6c79b-eced-420b-99fc-9246954a1e49 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.504795 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6c79b-eced-420b-99fc-9246954a1e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.505077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6c79b-eced-420b-99fc-9246954a1e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.505690 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6c79b-eced-420b-99fc-9246954a1e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:33.507625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6c79b-eced-420b-99fc-9246954a1e49 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:33.509473 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a7595-0aba-4b19-a71a-6abc0d239416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:33.510545 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a7595-0aba-4b19-a71a-6abc0d239416 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.511041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a7595-0aba-4b19-a71a-6abc0d239416 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.511504 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a7595-0aba-4b19-a71a-6abc0d239416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.525400 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a7595-0aba-4b19-a71a-6abc0d239416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:33.527630 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a7595-0aba-4b19-a71a-6abc0d239416 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:33.531537 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:33.545327 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 654/1299] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:33 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:33.545327 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0013346-fed3-4c15-9921-9947f2972e6f None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.545327 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0013346-fed3-4c15-9921-9947f2972e6f None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.545327 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0013346-fed3-4c15-9921-9947f2972e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.547138 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 646/1300] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:33.548718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a7595-0aba-4b19-a71a-6abc0d239416 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:33.560700 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a7595-0aba-4b19-a71a-6abc0d239416 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:33.570333 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-d0013346-fed3-4c15-9921-9947f2972e6f None None] MFA Rules not processed for user `674c5b25932a41309428ba6c6c72ed02`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:33.572746 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d0013346-fed3-4c15-9921-9947f2972e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:33.658474 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf1eb1-8103-447d-8e7f-598865ae72b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:33.660262 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf1eb1-8103-447d-8e7f-598865ae72b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.660648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf1eb1-8103-447d-8e7f-598865ae72b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.661051 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf1eb1-8103-447d-8e7f-598865ae72b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.696106 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 655/1301] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Oct 20 13:35:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:33.697316 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0013346-fed3-4c15-9921-9947f2972e6f None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:33.757817 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf1eb1-8103-447d-8e7f-598865ae72b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:33.759491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf1eb1-8103-447d-8e7f-598865ae72b2 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:33.772573 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 647/1302] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:33.773843 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf1eb1-8103-447d-8e7f-598865ae72b2 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:33.780012 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0013346-fed3-4c15-9921-9947f2972e6f None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:33.785149 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24da364-cd29-4391-b156-c82e91807776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:33.785870 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24da364-cd29-4391-b156-c82e91807776 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.786153 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24da364-cd29-4391-b156-c82e91807776 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.786424 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24da364-cd29-4391-b156-c82e91807776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.787241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf1eb1-8103-447d-8e7f-598865ae72b2 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:33.793095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee3fb7-ec23-4717-8bc4-f94f776b7089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:33.794089 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee3fb7-ec23-4717-8bc4-f94f776b7089 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.794610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee3fb7-ec23-4717-8bc4-f94f776b7089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.795246 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee3fb7-ec23-4717-8bc4-f94f776b7089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.796016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee3fb7-ec23-4717-8bc4-f94f776b7089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:33.798046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee3fb7-ec23-4717-8bc4-f94f776b7089 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:33.799491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24da364-cd29-4391-b156-c82e91807776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:33.801438 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24da364-cd29-4391-b156-c82e91807776 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:33.815196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 648/1303] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:33.815196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee3fb7-ec23-4717-8bc4-f94f776b7089 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:33.817616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 656/1304] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:33.818524 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24da364-cd29-4391-b156-c82e91807776 service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:33.827082 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee3fb7-ec23-4717-8bc4-f94f776b7089 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:33.834798 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba03eb1-09b9-410b-b7cd-9653459a66bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:33.835782 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba03eb1-09b9-410b-b7cd-9653459a66bf admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.836576 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24da364-cd29-4391-b156-c82e91807776 service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:33.837061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba03eb1-09b9-410b-b7cd-9653459a66bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.837549 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba03eb1-09b9-410b-b7cd-9653459a66bf admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.838441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba03eb1-09b9-410b-b7cd-9653459a66bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:33.841272 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba03eb1-09b9-410b-b7cd-9653459a66bf admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:33.843811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37057d-6a6f-4438-be63-fd45dce7beb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:33.844570 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37057d-6a6f-4438-be63-fd45dce7beb6 service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.845534 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37057d-6a6f-4438-be63-fd45dce7beb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.845659 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37057d-6a6f-4438-be63-fd45dce7beb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.881236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 649/1305] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:33 2022] POST /identity/v3/users => generated 297 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:33.881236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba03eb1-09b9-410b-b7cd-9653459a66bf admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:33.896458 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba03eb1-09b9-410b-b7cd-9653459a66bf admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:33.902936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edb41c-5c2f-487c-95cd-5b7bafc08213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:33.904485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edb41c-5c2f-487c-95cd-5b7bafc08213 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:33.904854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edb41c-5c2f-487c-95cd-5b7bafc08213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:33.905235 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edb41c-5c2f-487c-95cd-5b7bafc08213 admin admin] PATH_INFO: `/v3/projects/2f6174fe981b40908382f53bc247d95a/users/1e4835798da648eea00cf349c339f1cc/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:33.925161 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edb41c-5c2f-487c-95cd-5b7bafc08213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6174fe981b40908382f53bc247d95a, user_id=1e4835798da648eea00cf349c339f1cc, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:33.928710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edb41c-5c2f-487c-95cd-5b7bafc08213 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:33.931574 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:33.941524 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37057d-6a6f-4438-be63-fd45dce7beb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:33.944779 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37057d-6a6f-4438-be63-fd45dce7beb6 service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:33.957460 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 650/1306] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:33 2022] PUT /identity/v3/projects/2f6174fe981b40908382f53bc247d95a/users/1e4835798da648eea00cf349c339f1cc/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:33.958662 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edb41c-5c2f-487c-95cd-5b7bafc08213 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:33.960402 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 657/1307] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:33.972310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37057d-6a6f-4438-be63-fd45dce7beb6 service nova] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:33.998384 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37057d-6a6f-4438-be63-fd45dce7beb6 service nova] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:34.076875 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:34.087950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edb41c-5c2f-487c-95cd-5b7bafc08213 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:34.103945 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc4ee4-f476-44bf-9334-2237f1d53979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:34.105258 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc4ee4-f476-44bf-9334-2237f1d53979 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:34.105398 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc4ee4-f476-44bf-9334-2237f1d53979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:34.107052 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc4ee4-f476-44bf-9334-2237f1d53979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:34.108095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc4ee4-f476-44bf-9334-2237f1d53979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:34.111916 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc4ee4-f476-44bf-9334-2237f1d53979 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:34.137053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 651/1308] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:34.140857 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc4ee4-f476-44bf-9334-2237f1d53979 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:34.151120 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4c600-07df-4a77-b3ff-a867d7fc999f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:34.151768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4c600-07df-4a77-b3ff-a867d7fc999f admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:34.152054 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4c600-07df-4a77-b3ff-a867d7fc999f admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:34.152330 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4c600-07df-4a77-b3ff-a867d7fc999f admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:34.152983 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4c600-07df-4a77-b3ff-a867d7fc999f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:34.155474 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce4c600-07df-4a77-b3ff-a867d7fc999f admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:34.166627 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc4ee4-f476-44bf-9334-2237f1d53979 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:34.179696 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aad0d3-0ecd-4e0e-a087-934978d8def7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:34.180379 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad0d3-0ecd-4e0e-a087-934978d8def7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:34.180507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 658/1309] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:33 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:34.184212 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad0d3-0ecd-4e0e-a087-934978d8def7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:34.184525 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4c600-07df-4a77-b3ff-a867d7fc999f admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:34.184659 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad0d3-0ecd-4e0e-a087-934978d8def7 admin admin] PATH_INFO: `/v3/projects/5a869cbd31344a2880926db2768176c2/users/7de377b33095469bb60bfcdac56e7dec/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:34.203605 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4c600-07df-4a77-b3ff-a867d7fc999f admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:34.203926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aad0d3-0ecd-4e0e-a087-934978d8def7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a869cbd31344a2880926db2768176c2, user_id=7de377b33095469bb60bfcdac56e7dec, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:34.207032 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aad0d3-0ecd-4e0e-a087-934978d8def7 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:34.214379 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effc7a1-9096-4b64-882f-4ab760f0f72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:34.215401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effc7a1-9096-4b64-882f-4ab760f0f72d admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:34.216620 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effc7a1-9096-4b64-882f-4ab760f0f72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:34.216944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effc7a1-9096-4b64-882f-4ab760f0f72d admin admin] PATH_INFO: `/v3/projects/2f6174fe981b40908382f53bc247d95a/users/1e4835798da648eea00cf349c339f1cc/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:34.219644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effc7a1-9096-4b64-882f-4ab760f0f72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6174fe981b40908382f53bc247d95a, user_id=1e4835798da648eea00cf349c339f1cc, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:34.223582 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effc7a1-9096-4b64-882f-4ab760f0f72d admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:34.230561 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 652/1310] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:34 2022] PUT /identity/v3/projects/5a869cbd31344a2880926db2768176c2/users/7de377b33095469bb60bfcdac56e7dec/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:34.245954 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 659/1311] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:34 2022] PUT /identity/v3/projects/2f6174fe981b40908382f53bc247d95a/users/1e4835798da648eea00cf349c339f1cc/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:34.248420 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de23bf-8f5a-41d4-8756-03d040da4d92 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:34.248782 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de23bf-8f5a-41d4-8756-03d040da4d92 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:34.249251 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de23bf-8f5a-41d4-8756-03d040da4d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:34.251310 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aad0d3-0ecd-4e0e-a087-934978d8def7 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:34.323252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-05de23bf-8f5a-41d4-8756-03d040da4d92 None None] MFA Rules not processed for user `1e4835798da648eea00cf349c339f1cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:34.327843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-05de23bf-8f5a-41d4-8756-03d040da4d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:34.367360 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aad0d3-0ecd-4e0e-a087-934978d8def7 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:34.477697 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce56c17-71bd-4ac7-81cd-99971165ade5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:34.479411 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce56c17-71bd-4ac7-81cd-99971165ade5 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:34.479835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce56c17-71bd-4ac7-81cd-99971165ade5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:34.480188 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce56c17-71bd-4ac7-81cd-99971165ade5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:34.481191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce56c17-71bd-4ac7-81cd-99971165ade5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:34.483994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce56c17-71bd-4ac7-81cd-99971165ade5 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:34.485169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 660/1312] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:35:34.492445 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919ee86-183f-4ec4-9aaf-c77d9df192aa None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:34.492445 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919ee86-183f-4ec4-9aaf-c77d9df192aa None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:34.492689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919ee86-183f-4ec4-9aaf-c77d9df192aa None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:34.494594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 661/1313] 10.222.0.36 () {54 vars in 912 bytes} [Thu Oct 20 13:35:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:35:34.502884 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece02d9-fc0c-4d93-9fa7-771e71814e8c None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:34.503835 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece02d9-fc0c-4d93-9fa7-771e71814e8c None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:34.504873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece02d9-fc0c-4d93-9fa7-771e71814e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:34.527744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 653/1314] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:35:34.529546 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce56c17-71bd-4ac7-81cd-99971165ade5 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:34.535298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-aece02d9-fc0c-4d93-9fa7-771e71814e8c None None] MFA Rules not processed for user `674c5b25932a41309428ba6c6c72ed02`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:34.536681 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-aece02d9-fc0c-4d93-9fa7-771e71814e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:34.559942 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:34.655877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce56c17-71bd-4ac7-81cd-99971165ade5 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:34.657368 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 662/1315] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Oct 20 13:35:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:35:34.658570 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece02d9-fc0c-4d93-9fa7-771e71814e8c None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:34.676353 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece02d9-fc0c-4d93-9fa7-771e71814e8c None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:34.679415 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecc430-eedb-4bd9-9bba-1b9cca34d2c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:34.680988 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecc430-eedb-4bd9-9bba-1b9cca34d2c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:34.682472 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecc430-eedb-4bd9-9bba-1b9cca34d2c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:34.683751 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecc430-eedb-4bd9-9bba-1b9cca34d2c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:34.687685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968dcb1e-a2aa-4c4e-a422-fcbc47cea05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:34.689071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dcb1e-a2aa-4c4e-a422-fcbc47cea05d admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:34.690582 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dcb1e-a2aa-4c4e-a422-fcbc47cea05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:34.690877 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968dcb1e-a2aa-4c4e-a422-fcbc47cea05d admin admin] PATH_INFO: `/v3/projects/5a869cbd31344a2880926db2768176c2/users/7de377b33095469bb60bfcdac56e7dec/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:34.696935 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968dcb1e-a2aa-4c4e-a422-fcbc47cea05d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a869cbd31344a2880926db2768176c2, user_id=7de377b33095469bb60bfcdac56e7dec, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:34.703578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968dcb1e-a2aa-4c4e-a422-fcbc47cea05d admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:34.706866 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecc430-eedb-4bd9-9bba-1b9cca34d2c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:34.709077 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ecc430-eedb-4bd9-9bba-1b9cca34d2c3 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:34.733340 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 654/1316] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:34.734171 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 663/1317] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:34 2022] PUT /identity/v3/projects/5a869cbd31344a2880926db2768176c2/users/7de377b33095469bb60bfcdac56e7dec/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:34.744489 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a09adc-1575-4183-bd4b-6fa986b91a81 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:34.745114 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a09adc-1575-4183-bd4b-6fa986b91a81 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:34.745598 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a09adc-1575-4183-bd4b-6fa986b91a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:34.788260 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c8a09adc-1575-4183-bd4b-6fa986b91a81 None None] MFA Rules not processed for user `7de377b33095469bb60bfcdac56e7dec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:34.790918 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c8a09adc-1575-4183-bd4b-6fa986b91a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:34.824957 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968dcb1e-a2aa-4c4e-a422-fcbc47cea05d admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:34.866321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:34.927726 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968dcb1e-a2aa-4c4e-a422-fcbc47cea05d admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:34.932611 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718c857-b8f7-4a0f-862d-7fc4557aae8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:34.933222 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718c857-b8f7-4a0f-862d-7fc4557aae8f service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:34.933675 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718c857-b8f7-4a0f-862d-7fc4557aae8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:34.935404 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718c857-b8f7-4a0f-862d-7fc4557aae8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:34.976760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 655/1318] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:35:35.076209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718c857-b8f7-4a0f-862d-7fc4557aae8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:35.077738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718c857-b8f7-4a0f-862d-7fc4557aae8f service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:35.092438 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 664/1319] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:35:35.130262 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a09adc-1575-4183-bd4b-6fa986b91a81 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:35.158438 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a09adc-1575-4183-bd4b-6fa986b91a81 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:35.175130 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776d057-bd71-430a-8968-4de922fd96d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:35.175769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776d057-bd71-430a-8968-4de922fd96d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:35.176048 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776d057-bd71-430a-8968-4de922fd96d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:35.176321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776d057-bd71-430a-8968-4de922fd96d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:35.199396 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776d057-bd71-430a-8968-4de922fd96d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:35.200949 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776d057-bd71-430a-8968-4de922fd96d6 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:35.225732 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 656/1320] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:35.300210 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718c857-b8f7-4a0f-862d-7fc4557aae8f service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:35.309641 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718c857-b8f7-4a0f-862d-7fc4557aae8f service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:35.322860 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60d493-fba3-4b6d-ac8f-198070dcba44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:35.323533 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60d493-fba3-4b6d-ac8f-198070dcba44 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:35.324292 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60d493-fba3-4b6d-ac8f-198070dcba44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:35.324593 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60d493-fba3-4b6d-ac8f-198070dcba44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:35.440178 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60d493-fba3-4b6d-ac8f-198070dcba44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:35.442310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb60d493-fba3-4b6d-ac8f-198070dcba44 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:35.458738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 665/1321] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:36.310200 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b1f50-7662-40ca-a7ee-79c7859247ca None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:36.314774 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b1f50-7662-40ca-a7ee-79c7859247ca None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:36.315379 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b1f50-7662-40ca-a7ee-79c7859247ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:36.385521 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-837b1f50-7662-40ca-a7ee-79c7859247ca None None] MFA Rules not processed for user `0176d88da55447e9be312ff577f4d56a`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:36.387587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-837b1f50-7662-40ca-a7ee-79c7859247ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:36.588083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60d493-fba3-4b6d-ac8f-198070dcba44 service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:36.589727 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 657/1322] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:36 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:36.732888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:36.741141 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60d493-fba3-4b6d-ac8f-198070dcba44 service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:36.760948 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b1f50-7662-40ca-a7ee-79c7859247ca None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:36.767836 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ab7ce-90bc-4739-9c5f-2aa049bd27ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:36.768677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ab7ce-90bc-4739-9c5f-2aa049bd27ef admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:36.768971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ab7ce-90bc-4739-9c5f-2aa049bd27ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:36.769246 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ab7ce-90bc-4739-9c5f-2aa049bd27ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:36.770256 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ab7ce-90bc-4739-9c5f-2aa049bd27ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:36.774874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ab7ce-90bc-4739-9c5f-2aa049bd27ef admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:36.777409 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b1f50-7662-40ca-a7ee-79c7859247ca None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:36.783891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca7dde-ea40-4df8-b65d-ef4eb559bf25 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7de377b33095469bb60bfcdac56e7dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a869cbd31344a2880926db2768176c2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:36.785033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca7dde-ea40-4df8-b65d-ef4eb559bf25 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:36.786117 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca7dde-ea40-4df8-b65d-ef4eb559bf25 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:36.786668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca7dde-ea40-4df8-b65d-ef4eb559bf25 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:36.790321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca7dde-ea40-4df8-b65d-ef4eb559bf25 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:35:36.794214 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca7dde-ea40-4df8-b65d-ef4eb559bf25 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:36.797314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca7dde-ea40-4df8-b65d-ef4eb559bf25 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:36.811772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:36.816175 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 658/1323] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:35:36.820036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca7dde-ea40-4df8-b65d-ef4eb559bf25 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:36.821941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 666/1324] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:36 2022] POST /identity/v3/projects => generated 401 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:35:36.826804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ab7ce-90bc-4739-9c5f-2aa049bd27ef admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:36.850450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca7dde-ea40-4df8-b65d-ef4eb559bf25 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:36.982323 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ab7ce-90bc-4739-9c5f-2aa049bd27ef admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:36.990228 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd9e22-946b-4854-921a-b709d6628500 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7de377b33095469bb60bfcdac56e7dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a869cbd31344a2880926db2768176c2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:36.990853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd9e22-946b-4854-921a-b709d6628500 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:36.991158 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd9e22-946b-4854-921a-b709d6628500 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:37.004832 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd9e22-946b-4854-921a-b709d6628500 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:37.006331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd9e22-946b-4854-921a-b709d6628500 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:37.008155 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb265c6-2be8-4793-b281-cde9d442f8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:37.009422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb265c6-2be8-4793-b281-cde9d442f8f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:37.009685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb265c6-2be8-4793-b281-cde9d442f8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:37.009980 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb265c6-2be8-4793-b281-cde9d442f8f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:37.010586 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb265c6-2be8-4793-b281-cde9d442f8f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:37.013935 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd9e22-946b-4854-921a-b709d6628500 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:37.022191 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb265c6-2be8-4793-b281-cde9d442f8f2 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:37.099179 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 667/1325] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:36 2022] POST /identity/v3/users => generated 307 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:37.104772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb265c6-2be8-4793-b281-cde9d442f8f2 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:37.109395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 659/1326] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:36 2022] POST /identity/v3/projects => generated 354 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:37.110570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd9e22-946b-4854-921a-b709d6628500 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:37.117370 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb265c6-2be8-4793-b281-cde9d442f8f2 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:37.244278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd9e22-946b-4854-921a-b709d6628500 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:37.258888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04968075-15e3-4783-879a-9651f1389eb3 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7de377b33095469bb60bfcdac56e7dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a869cbd31344a2880926db2768176c2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:37.259555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04968075-15e3-4783-879a-9651f1389eb3 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:37.259837 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04968075-15e3-4783-879a-9651f1389eb3 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:37.260111 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04968075-15e3-4783-879a-9651f1389eb3 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:37.261577 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04968075-15e3-4783-879a-9651f1389eb3 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:35:37.261675 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528f964-4d99-4370-9a2f-9bf4dc309ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:37.261902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04968075-15e3-4783-879a-9651f1389eb3 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:37.262267 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528f964-4d99-4370-9a2f-9bf4dc309ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:37.262715 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528f964-4d99-4370-9a2f-9bf4dc309ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:37.263634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528f964-4d99-4370-9a2f-9bf4dc309ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:37.265865 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528f964-4d99-4370-9a2f-9bf4dc309ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:37.266229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04968075-15e3-4783-879a-9651f1389eb3 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:37.267565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528f964-4d99-4370-9a2f-9bf4dc309ad4 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:37.295004 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 668/1327] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:37.295192 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 660/1328] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:35:37.297426 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528f964-4d99-4370-9a2f-9bf4dc309ad4 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:37.310778 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528f964-4d99-4370-9a2f-9bf4dc309ad4 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:37.316919 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e3e5e-a62a-4cab-96cb-442ab50c9129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:37.317676 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e3e5e-a62a-4cab-96cb-442ab50c9129 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:37.318004 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e3e5e-a62a-4cab-96cb-442ab50c9129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:37.318976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e3e5e-a62a-4cab-96cb-442ab50c9129 admin admin] PATH_INFO: `/v3/projects/23d0ed9044f844ab8b47597a6d3ca085/users/5999999c86db4cf29dae237b7c765101/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:37.389712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e3e5e-a62a-4cab-96cb-442ab50c9129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d0ed9044f844ab8b47597a6d3ca085, user_id=5999999c86db4cf29dae237b7c765101, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:37.392792 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e3e5e-a62a-4cab-96cb-442ab50c9129 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:37.424139 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 669/1329] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:37 2022] PUT /identity/v3/projects/23d0ed9044f844ab8b47597a6d3ca085/users/5999999c86db4cf29dae237b7c765101/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:35:37.428424 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04968075-15e3-4783-879a-9651f1389eb3 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:37.455214 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04968075-15e3-4783-879a-9651f1389eb3 tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:37.603485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baf660-70b6-4d55-a593-3ce8fb0204f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:37.604050 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baf660-70b6-4d55-a593-3ce8fb0204f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:37.604328 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baf660-70b6-4d55-a593-3ce8fb0204f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:37.604610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3baf660-70b6-4d55-a593-3ce8fb0204f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:37.609283 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baf660-70b6-4d55-a593-3ce8fb0204f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:37.613828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3baf660-70b6-4d55-a593-3ce8fb0204f8 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:37.632843 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 661/1330] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:37 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:35:37.637034 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e3e5e-a62a-4cab-96cb-442ab50c9129 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:37.650008 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e3e5e-a62a-4cab-96cb-442ab50c9129 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:37.657841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3098b-f627-4ab0-9568-dc72ab4efd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:37.664995 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3098b-f627-4ab0-9568-dc72ab4efd1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:37.678944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3098b-f627-4ab0-9568-dc72ab4efd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:37.680446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3098b-f627-4ab0-9568-dc72ab4efd1f admin admin] PATH_INFO: `/v3/projects/23d0ed9044f844ab8b47597a6d3ca085/users/5999999c86db4cf29dae237b7c765101/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:37.691566 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3098b-f627-4ab0-9568-dc72ab4efd1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d0ed9044f844ab8b47597a6d3ca085, user_id=5999999c86db4cf29dae237b7c765101, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:37.701373 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3098b-f627-4ab0-9568-dc72ab4efd1f admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:37.730313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 670/1331] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:37 2022] PUT /identity/v3/projects/23d0ed9044f844ab8b47597a6d3ca085/users/5999999c86db4cf29dae237b7c765101/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:37.796602 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baf660-70b6-4d55-a593-3ce8fb0204f8 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:37.841737 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:37.943757 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3098b-f627-4ab0-9568-dc72ab4efd1f admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:37.998493 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3baf660-70b6-4d55-a593-3ce8fb0204f8 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:38.002829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:38.086364 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3098b-f627-4ab0-9568-dc72ab4efd1f admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:38.093205 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0876564-f8bf-4ba9-8005-4f324ec97e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:38.094352 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0876564-f8bf-4ba9-8005-4f324ec97e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:38.095075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0876564-f8bf-4ba9-8005-4f324ec97e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:38.096023 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0876564-f8bf-4ba9-8005-4f324ec97e83 admin admin] PATH_INFO: `/v3/users/db089c7485f74a819ff8569429bea15b` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:38.097495 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0876564-f8bf-4ba9-8005-4f324ec97e83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db089c7485f74a819ff8569429bea15b)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:38.099164 dv-cinder-862136-1-smb devstack@keystone.service[81426]: WARNING py.warnings [None req-d0876564-f8bf-4ba9-8005-4f324ec97e83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 13:35:38.099164 dv-cinder-862136-1-smb devstack@keystone.service[81426]: warnings.warn(msg) Oct 20 13:35:38.099164 dv-cinder-862136-1-smb devstack@keystone.service[81426]: Oct 20 13:35:38.101473 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0876564-f8bf-4ba9-8005-4f324ec97e83 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:38.135618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7de377b33095469bb60bfcdac56e7dec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a869cbd31344a2880926db2768176c2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:38.136864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:38.137144 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:38.137445 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] PATH_INFO: `/v3/projects/e163928f1a8b48d8ad2ddce35e601856` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:38.141539 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e163928f1a8b48d8ad2ddce35e601856)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:38.143771 dv-cinder-862136-1-smb devstack@keystone.service[81427]: WARNING py.warnings [None req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 20 13:35:38.143771 dv-cinder-862136-1-smb devstack@keystone.service[81427]: warnings.warn(msg) Oct 20 13:35:38.143771 dv-cinder-862136-1-smb devstack@keystone.service[81427]: Oct 20 13:35:38.148989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:38.222798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d0876564-f8bf-4ba9-8005-4f324ec97e83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db089c7485f74a819ff8569429bea15b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:38.223577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d0876564-f8bf-4ba9-8005-4f324ec97e83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db089c7485f74a819ff8569429bea15b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:38.269911 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d0876564-f8bf-4ba9-8005-4f324ec97e83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db089c7485f74a819ff8569429bea15b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:38.316153 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d0876564-f8bf-4ba9-8005-4f324ec97e83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db089c7485f74a819ff8569429bea15b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:38.319275 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d0876564-f8bf-4ba9-8005-4f324ec97e83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db089c7485f74a819ff8569429bea15b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:38.321256 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e163928f1a8b48d8ad2ddce35e601856', 'request_id': 'req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:38.341067 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e163928f1a8b48d8ad2ddce35e601856', 'request_id': 'req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:38.344316 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 671/1332] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:35:37 2022] DELETE /identity/v3/users/db089c7485f74a819ff8569429bea15b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:38.349636 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23360d-0130-4506-85a7-d23852bd95df None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:38.350193 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23360d-0130-4506-85a7-d23852bd95df None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:38.350889 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23360d-0130-4506-85a7-d23852bd95df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:38.367688 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e163928f1a8b48d8ad2ddce35e601856', 'request_id': 'req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:38.409286 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-6f23360d-0130-4506-85a7-d23852bd95df None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:38.410630 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6f23360d-0130-4506-85a7-d23852bd95df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:38.416508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] The token cache is being invalidate because project e163928f1a8b48d8ad2ddce35e601856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:35:38.417873 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:38.421094 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:38.426042 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 662/1333] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:35:37 2022] DELETE /identity/v3/projects/e163928f1a8b48d8ad2ddce35e601856 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:38.560662 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 672/1334] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:38.625804 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:38.628543 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:38.760283 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f477ec4-64b5-4e25-a0c2-1c004836ddfe tempest-VolumeQuotaClassesTest-1834217701 tempest-VolumeQuotaClassesTest-1834217701-project-admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:38.776926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:38.820381 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23360d-0130-4506-85a7-d23852bd95df None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:38.822466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6f23360d-0130-4506-85a7-d23852bd95df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:38.841691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23360d-0130-4506-85a7-d23852bd95df None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:38.854863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838452e-fb29-4cd0-a6c7-129e94eeffc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:38.856004 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838452e-fb29-4cd0-a6c7-129e94eeffc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:38.856859 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838452e-fb29-4cd0-a6c7-129e94eeffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:38.857351 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838452e-fb29-4cd0-a6c7-129e94eeffc5 admin admin] PATH_INFO: `/v3/users/47e87b58a1424c199052992cdea6e747` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:38.859219 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838452e-fb29-4cd0-a6c7-129e94eeffc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e87b58a1424c199052992cdea6e747)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:38.861716 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070e651-50e8-4139-a007-11d8611ee6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:38.862441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070e651-50e8-4139-a007-11d8611ee6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:38.863080 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070e651-50e8-4139-a007-11d8611ee6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:38.863475 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070e651-50e8-4139-a007-11d8611ee6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:38.863728 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838452e-fb29-4cd0-a6c7-129e94eeffc5 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:38.886344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070e651-50e8-4139-a007-11d8611ee6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:38.888819 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3070e651-50e8-4139-a007-11d8611ee6e6 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:38.904610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 663/1335] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:38.960392 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:38.962635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6838452e-fb29-4cd0-a6c7-129e94eeffc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e87b58a1424c199052992cdea6e747'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:38.965408 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6838452e-fb29-4cd0-a6c7-129e94eeffc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e87b58a1424c199052992cdea6e747'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:38.979219 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6838452e-fb29-4cd0-a6c7-129e94eeffc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e87b58a1424c199052992cdea6e747'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:39.008740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6838452e-fb29-4cd0-a6c7-129e94eeffc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e87b58a1424c199052992cdea6e747'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:39.012264 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6838452e-fb29-4cd0-a6c7-129e94eeffc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e87b58a1424c199052992cdea6e747'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:39.063405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17f98d-fa67-49ac-a39e-abaa8d278954 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:39.063700 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17f98d-fa67-49ac-a39e-abaa8d278954 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:39.063982 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17f98d-fa67-49ac-a39e-abaa8d278954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:39.068144 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 673/1336] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:35:38 2022] DELETE /identity/v3/users/47e87b58a1424c199052992cdea6e747 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:39.090798 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-cd17f98d-fa67-49ac-a39e-abaa8d278954 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:39.092354 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-cd17f98d-fa67-49ac-a39e-abaa8d278954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:39.431907 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 664/1337] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:39.505463 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838452e-fb29-4cd0-a6c7-129e94eeffc5 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:39.514349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6838452e-fb29-4cd0-a6c7-129e94eeffc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:39.733049 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838452e-fb29-4cd0-a6c7-129e94eeffc5 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:39.740901 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f75bd6-1f14-4905-be04-662c0b51a1ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:39.741731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f75bd6-1f14-4905-be04-662c0b51a1ad service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:39.742140 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f75bd6-1f14-4905-be04-662c0b51a1ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:39.742512 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f75bd6-1f14-4905-be04-662c0b51a1ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:39.757368 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f75bd6-1f14-4905-be04-662c0b51a1ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:39.770226 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cff55b-b678-448f-abbb-66784b4d8c3d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:39.770759 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cff55b-b678-448f-abbb-66784b4d8c3d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:39.770857 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cff55b-b678-448f-abbb-66784b4d8c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:39.776165 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f75bd6-1f14-4905-be04-662c0b51a1ad service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:39.808060 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 674/1338] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:39.850857 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-e5cff55b-b678-448f-abbb-66784b4d8c3d None None] MFA Rules not processed for user `5999999c86db4cf29dae237b7c765101`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:39.852564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e5cff55b-b678-448f-abbb-66784b4d8c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:39.978479 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 665/1339] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:39 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:35:40.581909 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f75bd6-1f14-4905-be04-662c0b51a1ad service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:40.583558 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-18f75bd6-1f14-4905-be04-662c0b51a1ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:40.604294 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f75bd6-1f14-4905-be04-662c0b51a1ad service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:40.610666 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b28bd-bf34-41c1-aae0-f7a36ff584d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:40.611740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b28bd-bf34-41c1-aae0-f7a36ff584d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:40.612340 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b28bd-bf34-41c1-aae0-f7a36ff584d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:40.612761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b28bd-bf34-41c1-aae0-f7a36ff584d5 admin admin] PATH_INFO: `/v3/projects/0d7c94a0bc144aa68e03416e0de7b1a8` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:40.614549 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b28bd-bf34-41c1-aae0-f7a36ff584d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d7c94a0bc144aa68e03416e0de7b1a8)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:40.617269 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479b28bd-bf34-41c1-aae0-f7a36ff584d5 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:40.685444 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-479b28bd-bf34-41c1-aae0-f7a36ff584d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d7c94a0bc144aa68e03416e0de7b1a8', 'request_id': 'req-479b28bd-bf34-41c1-aae0-f7a36ff584d5'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:40.695814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-479b28bd-bf34-41c1-aae0-f7a36ff584d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d7c94a0bc144aa68e03416e0de7b1a8', 'request_id': 'req-479b28bd-bf34-41c1-aae0-f7a36ff584d5'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:40.704393 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-479b28bd-bf34-41c1-aae0-f7a36ff584d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d7c94a0bc144aa68e03416e0de7b1a8', 'request_id': 'req-479b28bd-bf34-41c1-aae0-f7a36ff584d5'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:40.722511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-479b28bd-bf34-41c1-aae0-f7a36ff584d5 admin admin] The token cache is being invalidate because project 0d7c94a0bc144aa68e03416e0de7b1a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:35:40.723037 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-479b28bd-bf34-41c1-aae0-f7a36ff584d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:40.723872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-479b28bd-bf34-41c1-aae0-f7a36ff584d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:40.725866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 675/1340] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:35:40 2022] DELETE /identity/v3/projects/0d7c94a0bc144aa68e03416e0de7b1a8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:40.733319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72322b-54d7-4a27-b7ae-23227418f712 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:40.733689 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72322b-54d7-4a27-b7ae-23227418f712 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:40.735202 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72322b-54d7-4a27-b7ae-23227418f712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:40.778999 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-4f72322b-54d7-4a27-b7ae-23227418f712 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:40.782260 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-4f72322b-54d7-4a27-b7ae-23227418f712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:40.812770 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b28bd-bf34-41c1-aae0-f7a36ff584d5 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:40.814486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-479b28bd-bf34-41c1-aae0-f7a36ff584d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:40.949447 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:41.032103 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:41.044301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 666/1341] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:41.055832 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5ab2e-01d5-4b0f-b406-f744c6ec1919 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:41.055832 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5ab2e-01d5-4b0f-b406-f744c6ec1919 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:41.055832 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5ab2e-01d5-4b0f-b406-f744c6ec1919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:41.077682 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479b28bd-bf34-41c1-aae0-f7a36ff584d5 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:41.096016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-08e5ab2e-01d5-4b0f-b406-f744c6ec1919 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:41.097261 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-08e5ab2e-01d5-4b0f-b406-f744c6ec1919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:41.099835 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:41.103803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:41.105917 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 667/1342] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:41.107156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:41.107500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1 admin admin] PATH_INFO: `/v3/projects/b5312c113df844828b89745c232f4302` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:41.110246 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5ab2e-01d5-4b0f-b406-f744c6ec1919 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:41.110392 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5312c113df844828b89745c232f4302)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:41.112423 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:41.155170 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5ab2e-01d5-4b0f-b406-f744c6ec1919 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:41.163125 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3240ac-fab1-4da4-ac7d-1ccb3d0129e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:41.164605 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3240ac-fab1-4da4-ac7d-1ccb3d0129e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:41.165247 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3240ac-fab1-4da4-ac7d-1ccb3d0129e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:41.165678 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3240ac-fab1-4da4-ac7d-1ccb3d0129e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:41.166502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3240ac-fab1-4da4-ac7d-1ccb3d0129e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:35:41.167106 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3240ac-fab1-4da4-ac7d-1ccb3d0129e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:41.170824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3240ac-fab1-4da4-ac7d-1ccb3d0129e1 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:41.194817 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 668/1343] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:35:41.196210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3240ac-fab1-4da4-ac7d-1ccb3d0129e1 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:41.201601 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-de3240ac-fab1-4da4-ac7d-1ccb3d0129e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:41.220679 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3240ac-fab1-4da4-ac7d-1ccb3d0129e1 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:41.233702 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c8f33-b05c-43b5-8b26-866987d60128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:41.234793 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c8f33-b05c-43b5-8b26-866987d60128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:41.235145 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c8f33-b05c-43b5-8b26-866987d60128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:41.241437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c8f33-b05c-43b5-8b26-866987d60128 admin admin] PATH_INFO: `/v3/users/5a5e3fbff7fa4bb0aa4644fb9a69198a` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:41.243801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c8f33-b05c-43b5-8b26-866987d60128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a5e3fbff7fa4bb0aa4644fb9a69198a)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:41.246154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c8f33-b05c-43b5-8b26-866987d60128 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:41.295337 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5312c113df844828b89745c232f4302', 'request_id': 'req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:41.316962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5312c113df844828b89745c232f4302', 'request_id': 'req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:41.334261 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5312c113df844828b89745c232f4302', 'request_id': 'req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:41.368739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1 admin admin] The token cache is being invalidate because project b5312c113df844828b89745c232f4302 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:35:41.369334 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:41.371236 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:41.376445 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 676/1344] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:35:40 2022] DELETE /identity/v3/projects/b5312c113df844828b89745c232f4302 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:41.377819 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:41.377936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f10c8f33-b05c-43b5-8b26-866987d60128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a5e3fbff7fa4bb0aa4644fb9a69198a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:41.378602 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f10c8f33-b05c-43b5-8b26-866987d60128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a5e3fbff7fa4bb0aa4644fb9a69198a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:41.383953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:41.407034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f10c8f33-b05c-43b5-8b26-866987d60128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a5e3fbff7fa4bb0aa4644fb9a69198a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:41.449615 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f10c8f33-b05c-43b5-8b26-866987d60128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a5e3fbff7fa4bb0aa4644fb9a69198a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:41.450445 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f10c8f33-b05c-43b5-8b26-866987d60128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a5e3fbff7fa4bb0aa4644fb9a69198a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:41.475843 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 669/1345] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:35:41 2022] DELETE /identity/v3/users/5a5e3fbff7fa4bb0aa4644fb9a69198a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:41.479144 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c8f33-b05c-43b5-8b26-866987d60128 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:41.479358 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f10c8f33-b05c-43b5-8b26-866987d60128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:41.565668 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794ad7a-d7b7-484b-99eb-0a9bacd699b1 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:41.637240 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c8f33-b05c-43b5-8b26-866987d60128 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:41.661348 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986977c6-d755-452e-a9c8-3c09b73f29a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:41.662016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986977c6-d755-452e-a9c8-3c09b73f29a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:41.662296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986977c6-d755-452e-a9c8-3c09b73f29a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:41.662571 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986977c6-d755-452e-a9c8-3c09b73f29a2 admin admin] PATH_INFO: `/v3/users/7de377b33095469bb60bfcdac56e7dec` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:41.664263 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986977c6-d755-452e-a9c8-3c09b73f29a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7de377b33095469bb60bfcdac56e7dec)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:41.666038 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986977c6-d755-452e-a9c8-3c09b73f29a2 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:41.769706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:41.793504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb4e42-e5a2-4809-af1b-282505cdf008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:41.795170 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb4e42-e5a2-4809-af1b-282505cdf008 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:41.796394 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb4e42-e5a2-4809-af1b-282505cdf008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:41.797566 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb4e42-e5a2-4809-af1b-282505cdf008 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:41.800860 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb4e42-e5a2-4809-af1b-282505cdf008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:41.804643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-986977c6-d755-452e-a9c8-3c09b73f29a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7de377b33095469bb60bfcdac56e7dec'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:41.806034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-986977c6-d755-452e-a9c8-3c09b73f29a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7de377b33095469bb60bfcdac56e7dec'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:41.807669 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb4e42-e5a2-4809-af1b-282505cdf008 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:41.828533 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-986977c6-d755-452e-a9c8-3c09b73f29a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7de377b33095469bb60bfcdac56e7dec'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:41.876696 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-986977c6-d755-452e-a9c8-3c09b73f29a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7de377b33095469bb60bfcdac56e7dec'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:41.887887 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-986977c6-d755-452e-a9c8-3c09b73f29a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7de377b33095469bb60bfcdac56e7dec'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:41.896746 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 677/1346] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:41 2022] POST /identity/v3/projects => generated 367 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:41.899680 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07198a10-ab12-412b-932a-b668501d0e91 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:41.900393 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07198a10-ab12-412b-932a-b668501d0e91 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:41.901862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07198a10-ab12-412b-932a-b668501d0e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:41.931056 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 670/1347] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:35:41 2022] DELETE /identity/v3/users/7de377b33095469bb60bfcdac56e7dec => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:41.933295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986977c6-d755-452e-a9c8-3c09b73f29a2 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:41.936600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-986977c6-d755-452e-a9c8-3c09b73f29a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:41.957711 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-07198a10-ab12-412b-932a-b668501d0e91 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:41.960472 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-07198a10-ab12-412b-932a-b668501d0e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:41.974569 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:42.115362 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986977c6-d755-452e-a9c8-3c09b73f29a2 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:42.124569 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e603534-1b42-48f6-9af5-3f0f5f833720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:42.125219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e603534-1b42-48f6-9af5-3f0f5f833720 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:42.125498 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e603534-1b42-48f6-9af5-3f0f5f833720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:42.125769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e603534-1b42-48f6-9af5-3f0f5f833720 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:42.130877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e603534-1b42-48f6-9af5-3f0f5f833720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:42.131468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 678/1348] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:42.132968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e603534-1b42-48f6-9af5-3f0f5f833720 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:42.176218 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07198a10-ab12-412b-932a-b668501d0e91 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:42.180330 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-07198a10-ab12-412b-932a-b668501d0e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:42.198899 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 671/1349] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:41 2022] POST /identity/v3/users => generated 284 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:42.205876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e603534-1b42-48f6-9af5-3f0f5f833720 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:42.242773 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e603534-1b42-48f6-9af5-3f0f5f833720 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:42.257674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4de5a-6670-4770-83a0-b89284b510b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:42.258612 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4de5a-6670-4770-83a0-b89284b510b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:42.259089 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4de5a-6670-4770-83a0-b89284b510b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:42.259466 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4de5a-6670-4770-83a0-b89284b510b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:42.261456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4de5a-6670-4770-83a0-b89284b510b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:42.266212 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4de5a-6670-4770-83a0-b89284b510b8 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:42.300723 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 672/1350] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:42.301732 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4de5a-6670-4770-83a0-b89284b510b8 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:42.325917 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4de5a-6670-4770-83a0-b89284b510b8 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:42.327323 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07198a10-ab12-412b-932a-b668501d0e91 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:42.332768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249e8a1-9fe2-491c-ab93-8eb84c748863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:42.333239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405094a9-55a4-4111-a465-fd4a111be0a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:42.333798 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249e8a1-9fe2-491c-ab93-8eb84c748863 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:42.334075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405094a9-55a4-4111-a465-fd4a111be0a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:42.334402 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249e8a1-9fe2-491c-ab93-8eb84c748863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:42.334555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405094a9-55a4-4111-a465-fd4a111be0a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:42.334941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405094a9-55a4-4111-a465-fd4a111be0a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:42.335195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249e8a1-9fe2-491c-ab93-8eb84c748863 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:42.338749 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249e8a1-9fe2-491c-ab93-8eb84c748863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:42.340938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249e8a1-9fe2-491c-ab93-8eb84c748863 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:42.347872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405094a9-55a4-4111-a465-fd4a111be0a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:42.350577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405094a9-55a4-4111-a465-fd4a111be0a7 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:42.366970 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 679/1351] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:42.389327 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 673/1352] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:42.390162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405094a9-55a4-4111-a465-fd4a111be0a7 service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:42.402337 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405094a9-55a4-4111-a465-fd4a111be0a7 service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:42.410709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a624c6-9a0b-49b8-813a-0cdf5c26eb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:42.411517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a624c6-9a0b-49b8-813a-0cdf5c26eb3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:42.411918 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a624c6-9a0b-49b8-813a-0cdf5c26eb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:42.412424 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a624c6-9a0b-49b8-813a-0cdf5c26eb3c admin admin] PATH_INFO: `/v3/projects/9dd43c20131249c49f14f5f4d589b16b/users/7c9db1bba6354059ba0d8b7a05eda842/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:42.433078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a624c6-9a0b-49b8-813a-0cdf5c26eb3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd43c20131249c49f14f5f4d589b16b, user_id=7c9db1bba6354059ba0d8b7a05eda842, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:42.436577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a624c6-9a0b-49b8-813a-0cdf5c26eb3c admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:42.459678 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 680/1353] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:42 2022] PUT /identity/v3/projects/9dd43c20131249c49f14f5f4d589b16b/users/7c9db1bba6354059ba0d8b7a05eda842/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:42.477352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cbe7d-c626-4aaa-a7d6-58d9e334d86b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:42.478247 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cbe7d-c626-4aaa-a7d6-58d9e334d86b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:42.478995 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cbe7d-c626-4aaa-a7d6-58d9e334d86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:42.524756 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-017cbe7d-c626-4aaa-a7d6-58d9e334d86b None None] MFA Rules not processed for user `7c9db1bba6354059ba0d8b7a05eda842`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:42.527264 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-017cbe7d-c626-4aaa-a7d6-58d9e334d86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:42.691841 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 674/1354] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:42.705646 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a624c6-9a0b-49b8-813a-0cdf5c26eb3c admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:42.708738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-78a624c6-9a0b-49b8-813a-0cdf5c26eb3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:42.823260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a624c6-9a0b-49b8-813a-0cdf5c26eb3c admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:42.839721 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96beb7-21f5-469f-bc29-1bd09ef6fdd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:42.840354 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96beb7-21f5-469f-bc29-1bd09ef6fdd3 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:42.840731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96beb7-21f5-469f-bc29-1bd09ef6fdd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:42.841049 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96beb7-21f5-469f-bc29-1bd09ef6fdd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:42.853447 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96beb7-21f5-469f-bc29-1bd09ef6fdd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:42.855059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96beb7-21f5-469f-bc29-1bd09ef6fdd3 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:42.881547 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 681/1355] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:42.948614 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46623ca4-40ba-4a57-a5d7-08842ba30693 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:42.949030 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46623ca4-40ba-4a57-a5d7-08842ba30693 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:42.949548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46623ca4-40ba-4a57-a5d7-08842ba30693 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:42.952524 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 675/1356] 10.222.0.36 () {54 vars in 921 bytes} [Thu Oct 20 13:35:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:35:42.980420 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919cd26-861f-49c0-9a33-9b47c4c78933 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:42.980784 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919cd26-861f-49c0-9a33-9b47c4c78933 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:42.981705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919cd26-861f-49c0-9a33-9b47c4c78933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:43.031579 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-9919cd26-861f-49c0-9a33-9b47c4c78933 None None] MFA Rules not processed for user `a00f0b4cee8d49a48a95317aec9f647c`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:43.035203 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9919cd26-861f-49c0-9a33-9b47c4c78933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:43.109940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:43.217216 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 682/1357] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Oct 20 13:35:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:43.382700 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46623ca4-40ba-4a57-a5d7-08842ba30693 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:43.384993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-46623ca4-40ba-4a57-a5d7-08842ba30693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:43.442044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46623ca4-40ba-4a57-a5d7-08842ba30693 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:43.454392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a066b-2e46-49a4-8893-d1f4e445b1fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a00f0b4cee8d49a48a95317aec9f647c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:43.455226 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a066b-2e46-49a4-8893-d1f4e445b1fe service placement] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:43.455605 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a066b-2e46-49a4-8893-d1f4e445b1fe service placement] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:43.455980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a066b-2e46-49a4-8893-d1f4e445b1fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:43.471258 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:43.480359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a066b-2e46-49a4-8893-d1f4e445b1fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:43.487253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a066b-2e46-49a4-8893-d1f4e445b1fe service placement] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:43.511455 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 676/1358] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:44.102389 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919cd26-861f-49c0-9a33-9b47c4c78933 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:44.104432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9919cd26-861f-49c0-9a33-9b47c4c78933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:44.171190 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a066b-2e46-49a4-8893-d1f4e445b1fe service placement] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:44.173227 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ab5a066b-2e46-49a4-8893-d1f4e445b1fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:44.311901 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919cd26-861f-49c0-9a33-9b47c4c78933 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:44.326782 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886455b2-9a1f-4b62-96f7-68a1ab754f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:44.333820 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886455b2-9a1f-4b62-96f7-68a1ab754f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:44.335851 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886455b2-9a1f-4b62-96f7-68a1ab754f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:44.336969 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886455b2-9a1f-4b62-96f7-68a1ab754f8f admin admin] PATH_INFO: `/v3/projects/d3b6b166bcec4341958b0fae2b102b0c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:44.341836 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886455b2-9a1f-4b62-96f7-68a1ab754f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b6b166bcec4341958b0fae2b102b0c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:44.350044 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886455b2-9a1f-4b62-96f7-68a1ab754f8f admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:44.362937 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a066b-2e46-49a4-8893-d1f4e445b1fe service placement] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:44.377456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55ab1e-eb1d-47cc-a121-1c92a35f476c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:44.378753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55ab1e-eb1d-47cc-a121-1c92a35f476c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:44.379063 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55ab1e-eb1d-47cc-a121-1c92a35f476c admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:44.379503 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55ab1e-eb1d-47cc-a121-1c92a35f476c admin admin] PATH_INFO: `/v3/projects/5a869cbd31344a2880926db2768176c2` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:44.384300 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55ab1e-eb1d-47cc-a121-1c92a35f476c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a869cbd31344a2880926db2768176c2)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:44.386756 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55ab1e-eb1d-47cc-a121-1c92a35f476c admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:44.528482 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-af55ab1e-eb1d-47cc-a121-1c92a35f476c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a869cbd31344a2880926db2768176c2', 'request_id': 'req-af55ab1e-eb1d-47cc-a121-1c92a35f476c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:44.554296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-af55ab1e-eb1d-47cc-a121-1c92a35f476c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a869cbd31344a2880926db2768176c2', 'request_id': 'req-af55ab1e-eb1d-47cc-a121-1c92a35f476c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:44.568210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-af55ab1e-eb1d-47cc-a121-1c92a35f476c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a869cbd31344a2880926db2768176c2', 'request_id': 'req-af55ab1e-eb1d-47cc-a121-1c92a35f476c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:44.572478 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-886455b2-9a1f-4b62-96f7-68a1ab754f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b6b166bcec4341958b0fae2b102b0c', 'request_id': 'req-886455b2-9a1f-4b62-96f7-68a1ab754f8f'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:44.596976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-886455b2-9a1f-4b62-96f7-68a1ab754f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b6b166bcec4341958b0fae2b102b0c', 'request_id': 'req-886455b2-9a1f-4b62-96f7-68a1ab754f8f'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:44.613841 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-af55ab1e-eb1d-47cc-a121-1c92a35f476c admin admin] The token cache is being invalidate because project 5a869cbd31344a2880926db2768176c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:35:44.614625 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-af55ab1e-eb1d-47cc-a121-1c92a35f476c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:44.617155 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-886455b2-9a1f-4b62-96f7-68a1ab754f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b6b166bcec4341958b0fae2b102b0c', 'request_id': 'req-886455b2-9a1f-4b62-96f7-68a1ab754f8f'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:44.617405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-af55ab1e-eb1d-47cc-a121-1c92a35f476c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:44.623704 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 677/1359] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:35:44 2022] DELETE /identity/v3/projects/5a869cbd31344a2880926db2768176c2 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:35:44.634856 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8011f9e-0f96-485d-849e-5aeeaf9d8030 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:44.636425 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8011f9e-0f96-485d-849e-5aeeaf9d8030 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:44.637679 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8011f9e-0f96-485d-849e-5aeeaf9d8030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:44.644053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-886455b2-9a1f-4b62-96f7-68a1ab754f8f admin admin] The token cache is being invalidate because project d3b6b166bcec4341958b0fae2b102b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:35:44.644950 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-886455b2-9a1f-4b62-96f7-68a1ab754f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:44.646199 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-886455b2-9a1f-4b62-96f7-68a1ab754f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:44.665879 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 683/1360] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:35:44 2022] DELETE /identity/v3/projects/d3b6b166bcec4341958b0fae2b102b0c => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:44.667738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aba1f7-83c7-4e02-95c5-478d69bc6911 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:44.668023 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aba1f7-83c7-4e02-95c5-478d69bc6911 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:44.669534 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aba1f7-83c7-4e02-95c5-478d69bc6911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:44.731869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-16aba1f7-83c7-4e02-95c5-478d69bc6911 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:44.731869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-16aba1f7-83c7-4e02-95c5-478d69bc6911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:44.744933 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-e8011f9e-0f96-485d-849e-5aeeaf9d8030 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:44.748374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e8011f9e-0f96-485d-849e-5aeeaf9d8030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:44.894613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:44.926608 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 684/1361] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:35:44.936284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b76fbd-2b43-4b38-b9ab-f4ace4db4690 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:44.936579 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b76fbd-2b43-4b38-b9ab-f4ace4db4690 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:44.936862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b76fbd-2b43-4b38-b9ab-f4ace4db4690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:44.942367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 678/1362] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:44.953303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245578e-01eb-4d9f-a2ce-baf2741fd108 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:44.953586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245578e-01eb-4d9f-a2ce-baf2741fd108 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:44.953862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245578e-01eb-4d9f-a2ce-baf2741fd108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:45.011296 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-63b76fbd-2b43-4b38-b9ab-f4ace4db4690 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:45.011810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c245578e-01eb-4d9f-a2ce-baf2741fd108 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:45.013555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c245578e-01eb-4d9f-a2ce-baf2741fd108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:45.013933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-63b76fbd-2b43-4b38-b9ab-f4ace4db4690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:45.041598 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 679/1363] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:45.042874 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245578e-01eb-4d9f-a2ce-baf2741fd108 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:45.059863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 685/1364] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:45.061256 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b76fbd-2b43-4b38-b9ab-f4ace4db4690 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:45.062012 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245578e-01eb-4d9f-a2ce-baf2741fd108 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:45.080198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cf796-9a45-4821-b608-a52e3739af0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:45.080484 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b76fbd-2b43-4b38-b9ab-f4ace4db4690 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:45.081958 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cf796-9a45-4821-b608-a52e3739af0a admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:45.082382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cf796-9a45-4821-b608-a52e3739af0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:45.083257 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cf796-9a45-4821-b608-a52e3739af0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:45.084716 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b7058-854d-422f-9e3e-31658d25abf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:45.084876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cf796-9a45-4821-b608-a52e3739af0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:35:45.085100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cf796-9a45-4821-b608-a52e3739af0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:45.085347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b7058-854d-422f-9e3e-31658d25abf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:45.085633 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b7058-854d-422f-9e3e-31658d25abf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:45.085909 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b7058-854d-422f-9e3e-31658d25abf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:45.086569 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b7058-854d-422f-9e3e-31658d25abf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:35:45.086678 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cf796-9a45-4821-b608-a52e3739af0a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:45.086891 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b7058-854d-422f-9e3e-31658d25abf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:45.088530 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b7058-854d-422f-9e3e-31658d25abf9 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:45.119286 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 680/1365] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:35:45.120606 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 686/1366] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:35:45.123563 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cf796-9a45-4821-b608-a52e3739af0a admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:45.123771 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b7058-854d-422f-9e3e-31658d25abf9 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:45.137137 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:45.144684 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b7058-854d-422f-9e3e-31658d25abf9 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:45.147493 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cf796-9a45-4821-b608-a52e3739af0a admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:45.157906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14295fa2-2601-43bb-881e-65b054a5e59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:45.158544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14295fa2-2601-43bb-881e-65b054a5e59e admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:45.158917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14295fa2-2601-43bb-881e-65b054a5e59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:45.159401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14295fa2-2601-43bb-881e-65b054a5e59e admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:45.160195 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14295fa2-2601-43bb-881e-65b054a5e59e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:45.161030 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c3efc-efd1-473d-9cae-59722e1ff127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:45.162272 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c3efc-efd1-473d-9cae-59722e1ff127 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:45.162558 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c3efc-efd1-473d-9cae-59722e1ff127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:45.162835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c3efc-efd1-473d-9cae-59722e1ff127 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:45.163518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c3efc-efd1-473d-9cae-59722e1ff127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:45.163737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14295fa2-2601-43bb-881e-65b054a5e59e admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:45.165460 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c3efc-efd1-473d-9cae-59722e1ff127 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:45.236965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 687/1367] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:45 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:45.238287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14295fa2-2601-43bb-881e-65b054a5e59e admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:45.240821 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 681/1368] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:45 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:45.245695 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c3efc-efd1-473d-9cae-59722e1ff127 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:45.396505 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14295fa2-2601-43bb-881e-65b054a5e59e admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:45.482526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c3efc-efd1-473d-9cae-59722e1ff127 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:45.505853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85a182-d96e-415e-9b92-551ace0eff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:45.506984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85a182-d96e-415e-9b92-551ace0eff25 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:45.507908 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85a182-d96e-415e-9b92-551ace0eff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:45.509058 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85a182-d96e-415e-9b92-551ace0eff25 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:45.510902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85a182-d96e-415e-9b92-551ace0eff25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:45.525490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85a182-d96e-415e-9b92-551ace0eff25 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:45.568811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ca065-c96d-46bb-82c8-72909175e74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:45.569636 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ca065-c96d-46bb-82c8-72909175e74e admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:45.570069 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ca065-c96d-46bb-82c8-72909175e74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:45.570539 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ca065-c96d-46bb-82c8-72909175e74e admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:45.571818 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ca065-c96d-46bb-82c8-72909175e74e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:45.574691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ca065-c96d-46bb-82c8-72909175e74e admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:45.584527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 682/1369] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:45 2022] POST /identity/v3/users => generated 288 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:45.589210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85a182-d96e-415e-9b92-551ace0eff25 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:45.605744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85a182-d96e-415e-9b92-551ace0eff25 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:45.616730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 688/1370] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:45 2022] POST /identity/v3/users => generated 288 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:45.618313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ca065-c96d-46bb-82c8-72909175e74e admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:45.619660 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1196f3b-37e2-4549-9b22-40ad88ecd2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:45.620291 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1196f3b-37e2-4549-9b22-40ad88ecd2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:45.620570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1196f3b-37e2-4549-9b22-40ad88ecd2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:45.620839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1196f3b-37e2-4549-9b22-40ad88ecd2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:45.622489 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1196f3b-37e2-4549-9b22-40ad88ecd2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:45.623940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1196f3b-37e2-4549-9b22-40ad88ecd2a1 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:45.652311 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ca065-c96d-46bb-82c8-72909175e74e admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:45.659678 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 683/1371] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:45.662941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1196f3b-37e2-4549-9b22-40ad88ecd2a1 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:45.666746 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe29802-b752-4bdf-897f-d3c0b984dcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:45.667810 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29802-b752-4bdf-897f-d3c0b984dcde admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:45.668396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29802-b752-4bdf-897f-d3c0b984dcde admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:45.670521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29802-b752-4bdf-897f-d3c0b984dcde admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:45.671754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe29802-b752-4bdf-897f-d3c0b984dcde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:45.674566 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe29802-b752-4bdf-897f-d3c0b984dcde admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:45.687330 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1196f3b-37e2-4549-9b22-40ad88ecd2a1 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:45.694029 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 689/1372] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:45.705274 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe29802-b752-4bdf-897f-d3c0b984dcde admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:45.707717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c841194-19f9-4db0-8f91-8ae8a27a6c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:45.711119 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c841194-19f9-4db0-8f91-8ae8a27a6c90 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:45.713435 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c841194-19f9-4db0-8f91-8ae8a27a6c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:45.713742 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c841194-19f9-4db0-8f91-8ae8a27a6c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:45.714423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c841194-19f9-4db0-8f91-8ae8a27a6c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:45.722866 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c841194-19f9-4db0-8f91-8ae8a27a6c90 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:45.723947 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe29802-b752-4bdf-897f-d3c0b984dcde admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:45.730968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43436050-9607-44d7-b6c8-217c24acedc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:45.732656 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43436050-9607-44d7-b6c8-217c24acedc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:45.733285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43436050-9607-44d7-b6c8-217c24acedc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:45.733665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43436050-9607-44d7-b6c8-217c24acedc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:45.735200 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43436050-9607-44d7-b6c8-217c24acedc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:45.737463 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43436050-9607-44d7-b6c8-217c24acedc6 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:45.753043 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 684/1373] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:45.756369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c841194-19f9-4db0-8f91-8ae8a27a6c90 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:45.773432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 690/1374] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:45.773746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c841194-19f9-4db0-8f91-8ae8a27a6c90 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:45.776566 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43436050-9607-44d7-b6c8-217c24acedc6 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:45.780765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba52d5-d528-41bd-9111-e34242d83bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:45.781876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba52d5-d528-41bd-9111-e34242d83bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:45.781876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba52d5-d528-41bd-9111-e34242d83bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:45.782581 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba52d5-d528-41bd-9111-e34242d83bf8 admin admin] PATH_INFO: `/v3/projects/746d12d413464ed08daeef07e2b2940a/users/280345f7b63d474294236431b5b5dedf/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:45.795044 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43436050-9607-44d7-b6c8-217c24acedc6 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:45.803522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8492702-adcc-4ea0-8f0a-e840c1827e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:45.804272 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8492702-adcc-4ea0-8f0a-e840c1827e37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:45.804604 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8492702-adcc-4ea0-8f0a-e840c1827e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:45.804809 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba52d5-d528-41bd-9111-e34242d83bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=746d12d413464ed08daeef07e2b2940a, user_id=280345f7b63d474294236431b5b5dedf, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:45.804947 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8492702-adcc-4ea0-8f0a-e840c1827e37 admin admin] PATH_INFO: `/v3/projects/3ce43e9fcd344f5caabc83e2ebb0e71a/users/311fe8a4d0b447b7b461771c9cd2faeb/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:45.808404 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba52d5-d528-41bd-9111-e34242d83bf8 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:45.827658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8492702-adcc-4ea0-8f0a-e840c1827e37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce43e9fcd344f5caabc83e2ebb0e71a, user_id=311fe8a4d0b447b7b461771c9cd2faeb, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:45.832681 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8492702-adcc-4ea0-8f0a-e840c1827e37 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:45.837824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 685/1375] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:45 2022] PUT /identity/v3/projects/746d12d413464ed08daeef07e2b2940a/users/280345f7b63d474294236431b5b5dedf/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:35:45.850756 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed271-809d-47cd-9cf6-2f7cc2bc31ba None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:45.851142 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed271-809d-47cd-9cf6-2f7cc2bc31ba None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:45.851453 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baed271-809d-47cd-9cf6-2f7cc2bc31ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:45.874723 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 691/1376] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:45 2022] PUT /identity/v3/projects/3ce43e9fcd344f5caabc83e2ebb0e71a/users/311fe8a4d0b447b7b461771c9cd2faeb/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:45.886997 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcdafb-a137-4ccf-9ca4-d535639bb13e None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:45.886997 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcdafb-a137-4ccf-9ca4-d535639bb13e None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:45.887265 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbcdafb-a137-4ccf-9ca4-d535639bb13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:45.934813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:45.957295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-4cbcdafb-a137-4ccf-9ca4-d535639bb13e None None] MFA Rules not processed for user `311fe8a4d0b447b7b461771c9cd2faeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:45.958773 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-4cbcdafb-a137-4ccf-9ca4-d535639bb13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:45.958942 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0baed271-809d-47cd-9cf6-2f7cc2bc31ba None None] MFA Rules not processed for user `280345f7b63d474294236431b5b5dedf`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:45.962747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0baed271-809d-47cd-9cf6-2f7cc2bc31ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:46.128391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 692/1377] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:35:46.133956 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcdafb-a137-4ccf-9ca4-d535639bb13e None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:46.180968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 686/1378] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:46.182095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baed271-809d-47cd-9cf6-2f7cc2bc31ba None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:46.232238 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:46.275634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbcdafb-a137-4ccf-9ca4-d535639bb13e None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:46.290916 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa9058-7eb8-47ef-a148-e532af41c1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:46.291215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa9058-7eb8-47ef-a148-e532af41c1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:46.291524 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa9058-7eb8-47ef-a148-e532af41c1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:46.291638 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa9058-7eb8-47ef-a148-e532af41c1f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:46.292239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa9058-7eb8-47ef-a148-e532af41c1f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:46.300088 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa9058-7eb8-47ef-a148-e532af41c1f5 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:46.347867 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baed271-809d-47cd-9cf6-2f7cc2bc31ba None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:46.361086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1d4e9-9a70-4bbb-9621-f9466952e73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:46.363357 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d4e9-9a70-4bbb-9621-f9466952e73b admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:46.372595 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d4e9-9a70-4bbb-9621-f9466952e73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:46.372595 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1d4e9-9a70-4bbb-9621-f9466952e73b admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:46.373358 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1d4e9-9a70-4bbb-9621-f9466952e73b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:46.377744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1d4e9-9a70-4bbb-9621-f9466952e73b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:46.389861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 693/1379] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:46 2022] POST /identity/v3/projects => generated 375 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:46.394118 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa9058-7eb8-47ef-a148-e532af41c1f5 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:46.472087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 687/1380] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:46 2022] POST /identity/v3/projects => generated 377 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:46.476437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1d4e9-9a70-4bbb-9621-f9466952e73b admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:46.620380 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa9058-7eb8-47ef-a148-e532af41c1f5 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:46.703505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1d4e9-9a70-4bbb-9621-f9466952e73b admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:46.782326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:46.782567 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdaee44-ac48-4e6e-aef1-dddb5e2b7383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:46.783537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaee44-ac48-4e6e-aef1-dddb5e2b7383 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:46.784042 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaee44-ac48-4e6e-aef1-dddb5e2b7383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:46.784784 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdaee44-ac48-4e6e-aef1-dddb5e2b7383 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:46.786420 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdaee44-ac48-4e6e-aef1-dddb5e2b7383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:46.789129 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdaee44-ac48-4e6e-aef1-dddb5e2b7383 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:46.859357 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 688/1381] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:46 2022] POST /identity/v3/users => generated 289 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:46.865670 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdaee44-ac48-4e6e-aef1-dddb5e2b7383 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:46.888471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3fdaee44-ac48-4e6e-aef1-dddb5e2b7383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:46.905331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdaee44-ac48-4e6e-aef1-dddb5e2b7383 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:46.912661 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc614bc-1175-46d5-a868-07671582bcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:46.913412 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc614bc-1175-46d5-a868-07671582bcba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:46.913876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc614bc-1175-46d5-a868-07671582bcba admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:46.914228 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc614bc-1175-46d5-a868-07671582bcba admin admin] PATH_INFO: `/v3/users/0176d88da55447e9be312ff577f4d56a` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:46.916677 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc614bc-1175-46d5-a868-07671582bcba admin admin] RBAC: Authorizing `identity:delete_user(user_id=0176d88da55447e9be312ff577f4d56a)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:46.923424 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e887a-db3c-4fb6-bbd7-e63725f9850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:46.924069 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e887a-db3c-4fb6-bbd7-e63725f9850d admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:46.924350 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e887a-db3c-4fb6-bbd7-e63725f9850d admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:46.924627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e887a-db3c-4fb6-bbd7-e63725f9850d admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:46.925226 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc614bc-1175-46d5-a868-07671582bcba admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:46.925353 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e887a-db3c-4fb6-bbd7-e63725f9850d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:46.933563 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e887a-db3c-4fb6-bbd7-e63725f9850d admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:46.991800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 694/1382] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:46 2022] POST /identity/v3/users => generated 294 bytes in 595 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:46.991800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e887a-db3c-4fb6-bbd7-e63725f9850d admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:47.021275 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e887a-db3c-4fb6-bbd7-e63725f9850d admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:47.033126 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e34f74-4730-4ef4-b1bb-eb84ec585977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:47.033767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e34f74-4730-4ef4-b1bb-eb84ec585977 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:47.035793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e34f74-4730-4ef4-b1bb-eb84ec585977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:47.036920 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e34f74-4730-4ef4-b1bb-eb84ec585977 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:47.037595 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e34f74-4730-4ef4-b1bb-eb84ec585977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:47.040159 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6cc614bc-1175-46d5-a868-07671582bcba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0176d88da55447e9be312ff577f4d56a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:47.041405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6cc614bc-1175-46d5-a868-07671582bcba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0176d88da55447e9be312ff577f4d56a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:47.045572 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e34f74-4730-4ef4-b1bb-eb84ec585977 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:47.060767 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6cc614bc-1175-46d5-a868-07671582bcba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0176d88da55447e9be312ff577f4d56a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:47.070419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 695/1383] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:47.074421 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e34f74-4730-4ef4-b1bb-eb84ec585977 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:47.089616 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6cc614bc-1175-46d5-a868-07671582bcba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0176d88da55447e9be312ff577f4d56a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:47.092388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6cc614bc-1175-46d5-a868-07671582bcba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0176d88da55447e9be312ff577f4d56a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:47.104829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e34f74-4730-4ef4-b1bb-eb84ec585977 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:47.123551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 689/1384] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:35:46 2022] DELETE /identity/v3/users/0176d88da55447e9be312ff577f4d56a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:47.124372 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc614bc-1175-46d5-a868-07671582bcba admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:47.127800 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6cc614bc-1175-46d5-a868-07671582bcba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:47.129523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947223b-82cd-4a3e-a16f-af1170f39d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:47.130370 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947223b-82cd-4a3e-a16f-af1170f39d77 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:47.130653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947223b-82cd-4a3e-a16f-af1170f39d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:47.130924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947223b-82cd-4a3e-a16f-af1170f39d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:47.131974 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947223b-82cd-4a3e-a16f-af1170f39d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:47.134383 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947223b-82cd-4a3e-a16f-af1170f39d77 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:47.140560 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:47.172693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 696/1385] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:47.173830 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947223b-82cd-4a3e-a16f-af1170f39d77 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:47.182015 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6947223b-82cd-4a3e-a16f-af1170f39d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:47.213354 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947223b-82cd-4a3e-a16f-af1170f39d77 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:47.314180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc614bc-1175-46d5-a868-07671582bcba admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:47.329580 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd4b42-d889-4aa6-989e-fb200feae4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:47.331609 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd4b42-d889-4aa6-989e-fb200feae4df admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:47.332046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd4b42-d889-4aa6-989e-fb200feae4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:47.332336 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd4b42-d889-4aa6-989e-fb200feae4df admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:47.333034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd4b42-d889-4aa6-989e-fb200feae4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:47.334790 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd4b42-d889-4aa6-989e-fb200feae4df admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:47.372474 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 690/1386] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:47.380668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd4b42-d889-4aa6-989e-fb200feae4df admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:47.394747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f1cf8-ce26-4415-a21d-ec60362b9981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:47.395921 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f1cf8-ce26-4415-a21d-ec60362b9981 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:47.396107 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f1cf8-ce26-4415-a21d-ec60362b9981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:47.397358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f1cf8-ce26-4415-a21d-ec60362b9981 admin admin] PATH_INFO: `/v3/projects/49a8e084137948109957c171e6b58ee7/users/e5f1117f1ea749d3b1240555562622c2/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:47.412532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd4b42-d889-4aa6-989e-fb200feae4df admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:47.430856 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3ae80-0e3b-4369-8e2c-5e3835c11e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:47.439936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3ae80-0e3b-4369-8e2c-5e3835c11e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:47.440236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3ae80-0e3b-4369-8e2c-5e3835c11e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:47.440524 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3ae80-0e3b-4369-8e2c-5e3835c11e59 admin admin] PATH_INFO: `/v3/projects/92dcaaaa8c9143afbd5d1e6e6faa34cc/users/fe53226cece345939f5149149eaca56f/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:47.462900 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f1cf8-ce26-4415-a21d-ec60362b9981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a8e084137948109957c171e6b58ee7, user_id=e5f1117f1ea749d3b1240555562622c2, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:47.466174 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f1cf8-ce26-4415-a21d-ec60362b9981 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:47.484133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3ae80-0e3b-4369-8e2c-5e3835c11e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92dcaaaa8c9143afbd5d1e6e6faa34cc, user_id=fe53226cece345939f5149149eaca56f, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:47.487278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3ae80-0e3b-4369-8e2c-5e3835c11e59 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:47.504084 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 697/1387] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:47 2022] PUT /identity/v3/projects/49a8e084137948109957c171e6b58ee7/users/e5f1117f1ea749d3b1240555562622c2/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:47.508354 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f1cf8-ce26-4415-a21d-ec60362b9981 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:47.552739 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 691/1388] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:47 2022] PUT /identity/v3/projects/92dcaaaa8c9143afbd5d1e6e6faa34cc/users/fe53226cece345939f5149149eaca56f/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:47.566330 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8b52-3327-44f3-9756-8a86fed8e174 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:47.566647 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8b52-3327-44f3-9756-8a86fed8e174 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:47.567110 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8b52-3327-44f3-9756-8a86fed8e174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:47.632368 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ec8c8b52-3327-44f3-9756-8a86fed8e174 None None] MFA Rules not processed for user `fe53226cece345939f5149149eaca56f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:47.636156 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ec8c8b52-3327-44f3-9756-8a86fed8e174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:47.769035 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f1cf8-ce26-4415-a21d-ec60362b9981 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:47.862483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:47.865715 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 692/1389] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:47.869929 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c8b52-3327-44f3-9756-8a86fed8e174 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:48.026141 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccf63c-caef-4c8e-bb88-33390f7b1042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:48.027736 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccf63c-caef-4c8e-bb88-33390f7b1042 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:48.028065 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccf63c-caef-4c8e-bb88-33390f7b1042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:48.028344 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccf63c-caef-4c8e-bb88-33390f7b1042 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:48.029025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccf63c-caef-4c8e-bb88-33390f7b1042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:48.038170 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccf63c-caef-4c8e-bb88-33390f7b1042 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:48.114406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 698/1390] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 606 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:48.125031 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccf63c-caef-4c8e-bb88-33390f7b1042 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:48.145488 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c8b52-3327-44f3-9756-8a86fed8e174 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:48.156475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccf63c-caef-4c8e-bb88-33390f7b1042 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:48.175276 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f46721-180b-4452-a58e-cbeaa79e0f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:48.176373 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f46721-180b-4452-a58e-cbeaa79e0f83 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:48.179252 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f46721-180b-4452-a58e-cbeaa79e0f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:48.180272 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f46721-180b-4452-a58e-cbeaa79e0f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:48.185655 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f46721-180b-4452-a58e-cbeaa79e0f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:48.189541 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfa07c-b55a-448c-b61d-2d3ea9e46259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:48.191534 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f46721-180b-4452-a58e-cbeaa79e0f83 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:48.192593 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfa07c-b55a-448c-b61d-2d3ea9e46259 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:48.195765 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfa07c-b55a-448c-b61d-2d3ea9e46259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:48.199018 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfa07c-b55a-448c-b61d-2d3ea9e46259 admin admin] PATH_INFO: `/v3/projects/49a8e084137948109957c171e6b58ee7/users/e5f1117f1ea749d3b1240555562622c2/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:48.207850 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfa07c-b55a-448c-b61d-2d3ea9e46259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a8e084137948109957c171e6b58ee7, user_id=e5f1117f1ea749d3b1240555562622c2, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:48.220004 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfa07c-b55a-448c-b61d-2d3ea9e46259 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:48.242576 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:48.289940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 699/1391] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:48 2022] PUT /identity/v3/projects/49a8e084137948109957c171e6b58ee7/users/e5f1117f1ea749d3b1240555562622c2/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:48.305823 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328bbf5-0ec9-4176-b1cd-09c6f554e024 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:48.306748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328bbf5-0ec9-4176-b1cd-09c6f554e024 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:48.307284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328bbf5-0ec9-4176-b1cd-09c6f554e024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:48.326674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 693/1392] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:47 2022] POST /identity/v3/projects => generated 371 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:48.337506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f46721-180b-4452-a58e-cbeaa79e0f83 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:48.453623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-6328bbf5-0ec9-4176-b1cd-09c6f554e024 None None] MFA Rules not processed for user `e5f1117f1ea749d3b1240555562622c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:48.468450 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6328bbf5-0ec9-4176-b1cd-09c6f554e024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:48.659217 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f46721-180b-4452-a58e-cbeaa79e0f83 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:48.675083 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6259f3-fbaa-475b-b49f-25d45a2f35dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:48.675722 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6259f3-fbaa-475b-b49f-25d45a2f35dc admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:48.682103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6259f3-fbaa-475b-b49f-25d45a2f35dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:48.683591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6259f3-fbaa-475b-b49f-25d45a2f35dc admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:48.685362 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6259f3-fbaa-475b-b49f-25d45a2f35dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:48.696350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6259f3-fbaa-475b-b49f-25d45a2f35dc admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:48.749502 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 700/1393] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:48.753110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328bbf5-0ec9-4176-b1cd-09c6f554e024 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:48.760393 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6328bbf5-0ec9-4176-b1cd-09c6f554e024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:48.760572 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 694/1394] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:48 2022] POST /identity/v3/users => generated 292 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:48.768817 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6259f3-fbaa-475b-b49f-25d45a2f35dc admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:48.781349 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6259f3-fbaa-475b-b49f-25d45a2f35dc admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:48.786276 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088c97e-bff5-406c-8a8d-d482124a9db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:48.787177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088c97e-bff5-406c-8a8d-d482124a9db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:48.787560 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088c97e-bff5-406c-8a8d-d482124a9db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:48.787928 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088c97e-bff5-406c-8a8d-d482124a9db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:48.788680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088c97e-bff5-406c-8a8d-d482124a9db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:48.790930 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088c97e-bff5-406c-8a8d-d482124a9db2 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:48.797181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328bbf5-0ec9-4176-b1cd-09c6f554e024 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:48.808868 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 695/1395] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:48.810409 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088c97e-bff5-406c-8a8d-d482124a9db2 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:48.825801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6088c97e-bff5-406c-8a8d-d482124a9db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:48.827541 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df42ae-05fb-4abb-a07e-8b23ccce2929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:48.828157 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df42ae-05fb-4abb-a07e-8b23ccce2929 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:48.828430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df42ae-05fb-4abb-a07e-8b23ccce2929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:48.828695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df42ae-05fb-4abb-a07e-8b23ccce2929 admin admin] PATH_INFO: `/v3/projects/5a722d04911a4165bc61c38271a09aca` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:48.832802 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df42ae-05fb-4abb-a07e-8b23ccce2929 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a722d04911a4165bc61c38271a09aca)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:48.834769 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df42ae-05fb-4abb-a07e-8b23ccce2929 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:48.929901 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088c97e-bff5-406c-8a8d-d482124a9db2 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:48.935149 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6d50e-d564-4eb7-8cf9-f078d1bd01d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:48.935783 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6d50e-d564-4eb7-8cf9-f078d1bd01d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:48.937493 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6d50e-d564-4eb7-8cf9-f078d1bd01d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:48.937781 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6d50e-d564-4eb7-8cf9-f078d1bd01d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:48.943561 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-74b6d50e-d564-4eb7-8cf9-f078d1bd01d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:49.036100 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c4df42ae-05fb-4abb-a07e-8b23ccce2929 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a722d04911a4165bc61c38271a09aca', 'request_id': 'req-c4df42ae-05fb-4abb-a07e-8b23ccce2929'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:49.051685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c4df42ae-05fb-4abb-a07e-8b23ccce2929 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a722d04911a4165bc61c38271a09aca', 'request_id': 'req-c4df42ae-05fb-4abb-a07e-8b23ccce2929'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:49.066134 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c4df42ae-05fb-4abb-a07e-8b23ccce2929 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a722d04911a4165bc61c38271a09aca', 'request_id': 'req-c4df42ae-05fb-4abb-a07e-8b23ccce2929'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:49.078592 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6d50e-d564-4eb7-8cf9-f078d1bd01d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:49.080376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6d50e-d564-4eb7-8cf9-f078d1bd01d1 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:49.090185 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c4df42ae-05fb-4abb-a07e-8b23ccce2929 admin admin] The token cache is being invalidate because project 5a722d04911a4165bc61c38271a09aca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:35:49.091373 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c4df42ae-05fb-4abb-a07e-8b23ccce2929 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:49.093041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c4df42ae-05fb-4abb-a07e-8b23ccce2929 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:49.094589 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 701/1396] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:35:48 2022] DELETE /identity/v3/projects/5a722d04911a4165bc61c38271a09aca => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:49.095622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df42ae-05fb-4abb-a07e-8b23ccce2929 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:49.098199 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-c4df42ae-05fb-4abb-a07e-8b23ccce2929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:49.103758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 696/1397] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:49.109689 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f365-80f7-4ab6-9389-dda62b66f64f None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:49.110075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f365-80f7-4ab6-9389-dda62b66f64f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:49.112238 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f365-80f7-4ab6-9389-dda62b66f64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:49.163698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-2181f365-80f7-4ab6-9389-dda62b66f64f None None] MFA Rules not processed for user `c876087fad0e47878030edc53e43c39d`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:49.165697 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2181f365-80f7-4ab6-9389-dda62b66f64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:49.183692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:49.193272 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:49.350650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df42ae-05fb-4abb-a07e-8b23ccce2929 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:49.363035 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 697/1398] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:49.364182 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181f365-80f7-4ab6-9389-dda62b66f64f None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:49.368093 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2181f365-80f7-4ab6-9389-dda62b66f64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:49.373487 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99891c53-10d6-43c0-8214-7af053a7a47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:49.374286 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99891c53-10d6-43c0-8214-7af053a7a47a admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:49.374764 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99891c53-10d6-43c0-8214-7af053a7a47a admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:49.375462 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99891c53-10d6-43c0-8214-7af053a7a47a admin admin] PATH_INFO: `/v3/projects/e989bc61b1584ddf877839528004616a/users/ac82ce78005d4d34a5adf0fb9e09b485/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:49.426412 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99891c53-10d6-43c0-8214-7af053a7a47a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e989bc61b1584ddf877839528004616a, user_id=ac82ce78005d4d34a5adf0fb9e09b485, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:49.427084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181f365-80f7-4ab6-9389-dda62b66f64f None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:49.430077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99891c53-10d6-43c0-8214-7af053a7a47a admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:49.450889 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6628e7b-d34b-46b3-b547-2d83dd5fd9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:49.472038 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6628e7b-d34b-46b3-b547-2d83dd5fd9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:49.472334 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6628e7b-d34b-46b3-b547-2d83dd5fd9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:49.472682 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6628e7b-d34b-46b3-b547-2d83dd5fd9fb admin admin] PATH_INFO: `/v3/users/5999999c86db4cf29dae237b7c765101` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:49.474243 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6628e7b-d34b-46b3-b547-2d83dd5fd9fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5999999c86db4cf29dae237b7c765101)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:49.483888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6628e7b-d34b-46b3-b547-2d83dd5fd9fb admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:49.506515 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 702/1399] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:49 2022] PUT /identity/v3/projects/e989bc61b1584ddf877839528004616a/users/ac82ce78005d4d34a5adf0fb9e09b485/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:49.508030 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0a784-7dd6-4931-a429-e05655e3eca8 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:49.508474 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0a784-7dd6-4931-a429-e05655e3eca8 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:49.508879 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0a784-7dd6-4931-a429-e05655e3eca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:49.622124 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f6628e7b-d34b-46b3-b547-2d83dd5fd9fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5999999c86db4cf29dae237b7c765101'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:49.626691 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f6628e7b-d34b-46b3-b547-2d83dd5fd9fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5999999c86db4cf29dae237b7c765101'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:49.629168 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-7ae0a784-7dd6-4931-a429-e05655e3eca8 None None] MFA Rules not processed for user `274bdb52067d4788a0c628e6d900c2df`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:49.630586 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7ae0a784-7dd6-4931-a429-e05655e3eca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:49.649903 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f6628e7b-d34b-46b3-b547-2d83dd5fd9fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5999999c86db4cf29dae237b7c765101'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:49.700377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f6628e7b-d34b-46b3-b547-2d83dd5fd9fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5999999c86db4cf29dae237b7c765101'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:49.701468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f6628e7b-d34b-46b3-b547-2d83dd5fd9fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5999999c86db4cf29dae237b7c765101'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:49.752140 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 698/1400] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:35:49 2022] DELETE /identity/v3/users/5999999c86db4cf29dae237b7c765101 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:49.763161 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907f2da-f2d1-459f-9de4-dd9818d51650 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:49.764155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907f2da-f2d1-459f-9de4-dd9818d51650 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:49.766444 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8907f2da-f2d1-459f-9de4-dd9818d51650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:49.826733 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-8907f2da-f2d1-459f-9de4-dd9818d51650 None None] MFA Rules not processed for user `c876087fad0e47878030edc53e43c39d`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:49.828065 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8907f2da-f2d1-459f-9de4-dd9818d51650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:49.883816 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 703/1401] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:49.884779 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0a784-7dd6-4931-a429-e05655e3eca8 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:49.887448 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7ae0a784-7dd6-4931-a429-e05655e3eca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:50.015248 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 699/1402] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:50.019635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907f2da-f2d1-459f-9de4-dd9818d51650 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:50.019635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8907f2da-f2d1-459f-9de4-dd9818d51650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:50.096167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:50.186912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0a784-7dd6-4931-a429-e05655e3eca8 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:50.257191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8907f2da-f2d1-459f-9de4-dd9818d51650 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:50.275246 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c2724-f077-4e0a-90db-9847a5ca5387 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:50.276105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2724-f077-4e0a-90db-9847a5ca5387 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:50.276347 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2724-f077-4e0a-90db-9847a5ca5387 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:50.276624 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2724-f077-4e0a-90db-9847a5ca5387 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:50.300305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:50.347706 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc81a74-d8b7-45aa-a4d3-c661eb6a9677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:50.348520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc81a74-d8b7-45aa-a4d3-c661eb6a9677 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:50.348807 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc81a74-d8b7-45aa-a4d3-c661eb6a9677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:50.349226 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc81a74-d8b7-45aa-a4d3-c661eb6a9677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:50.349892 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc81a74-d8b7-45aa-a4d3-c661eb6a9677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:50.352955 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc81a74-d8b7-45aa-a4d3-c661eb6a9677 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:50.386778 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 704/1403] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:49 2022] GET /identity/v3/roles => generated 1420 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:50.391032 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc81a74-d8b7-45aa-a4d3-c661eb6a9677 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:50.413763 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-dbc81a74-d8b7-45aa-a4d3-c661eb6a9677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:50.421571 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c2724-f077-4e0a-90db-9847a5ca5387 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:50.423456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c2724-f077-4e0a-90db-9847a5ca5387 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:50.452102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 700/1404] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:50.455823 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128e779-379a-4272-9e14-8da482a45ec3 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:50.456295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128e779-379a-4272-9e14-8da482a45ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:50.456582 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128e779-379a-4272-9e14-8da482a45ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:50.495336 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc81a74-d8b7-45aa-a4d3-c661eb6a9677 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:50.514290 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfee6f-fb5d-423b-a66a-192b21c68f7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:50.516804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfee6f-fb5d-423b-a66a-192b21c68f7a service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:50.517207 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfee6f-fb5d-423b-a66a-192b21c68f7a service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:50.517918 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfee6f-fb5d-423b-a66a-192b21c68f7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:50.522014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-8128e779-379a-4272-9e14-8da482a45ec3 None None] MFA Rules not processed for user `4019f657541a4c2ab6e6cdf2bb82a99e`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:50.522635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0adfee6f-fb5d-423b-a66a-192b21c68f7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:50.523624 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8128e779-379a-4272-9e14-8da482a45ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:50.549322 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfee6f-fb5d-423b-a66a-192b21c68f7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:50.551487 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfee6f-fb5d-423b-a66a-192b21c68f7a service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:50.578600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 705/1405] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:50.581368 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfee6f-fb5d-423b-a66a-192b21c68f7a service nova] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:50.602601 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfee6f-fb5d-423b-a66a-192b21c68f7a service nova] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:50.608999 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d52e8b-e153-443d-a8cc-2c1cea6d3c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:50.610072 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d52e8b-e153-443d-a8cc-2c1cea6d3c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:50.610658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d52e8b-e153-443d-a8cc-2c1cea6d3c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:50.611264 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d52e8b-e153-443d-a8cc-2c1cea6d3c49 admin admin] PATH_INFO: `/v3/projects/e989bc61b1584ddf877839528004616a/users/ac82ce78005d4d34a5adf0fb9e09b485/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:50.614703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d52e8b-e153-443d-a8cc-2c1cea6d3c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e989bc61b1584ddf877839528004616a, user_id=ac82ce78005d4d34a5adf0fb9e09b485, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:50.618764 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d52e8b-e153-443d-a8cc-2c1cea6d3c49 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:50.636210 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 706/1406] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:50 2022] PUT /identity/v3/projects/e989bc61b1584ddf877839528004616a/users/ac82ce78005d4d34a5adf0fb9e09b485/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:50.648014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d52e8b-e153-443d-a8cc-2c1cea6d3c49 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:50.651922 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e2d52e8b-e153-443d-a8cc-2c1cea6d3c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:50.705538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 701/1407] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:50.705538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4b7df-3f31-42a7-a0d4-009531eaec8b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:50.705538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4b7df-3f31-42a7-a0d4-009531eaec8b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:50.705538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4b7df-3f31-42a7-a0d4-009531eaec8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:50.787989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-fcc4b7df-3f31-42a7-a0d4-009531eaec8b None None] MFA Rules not processed for user `ac82ce78005d4d34a5adf0fb9e09b485`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:50.790251 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-fcc4b7df-3f31-42a7-a0d4-009531eaec8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:50.822126 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d52e8b-e153-443d-a8cc-2c1cea6d3c49 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:50.837849 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380908bb-ade7-4668-b53b-61e65a034298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:50.839349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380908bb-ade7-4668-b53b-61e65a034298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:50.840997 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380908bb-ade7-4668-b53b-61e65a034298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:50.841387 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380908bb-ade7-4668-b53b-61e65a034298 admin admin] PATH_INFO: `/v3/projects/23d0ed9044f844ab8b47597a6d3ca085` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:50.843828 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380908bb-ade7-4668-b53b-61e65a034298 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d0ed9044f844ab8b47597a6d3ca085)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:50.852186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380908bb-ade7-4668-b53b-61e65a034298 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:50.929420 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:51.015716 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 702/1408] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:51.022467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dbec0-0952-46c9-909e-fd1db403246b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:51.023118 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dbec0-0952-46c9-909e-fd1db403246b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:51.023864 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-380908bb-ade7-4668-b53b-61e65a034298 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d0ed9044f844ab8b47597a6d3ca085', 'request_id': 'req-380908bb-ade7-4668-b53b-61e65a034298'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:51.026486 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431dbec0-0952-46c9-909e-fd1db403246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:51.045939 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-380908bb-ade7-4668-b53b-61e65a034298 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d0ed9044f844ab8b47597a6d3ca085', 'request_id': 'req-380908bb-ade7-4668-b53b-61e65a034298'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:51.072124 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-380908bb-ade7-4668-b53b-61e65a034298 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d0ed9044f844ab8b47597a6d3ca085', 'request_id': 'req-380908bb-ade7-4668-b53b-61e65a034298'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:51.096621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-431dbec0-0952-46c9-909e-fd1db403246b None None] MFA Rules not processed for user `4019f657541a4c2ab6e6cdf2bb82a99e`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:51.099081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-431dbec0-0952-46c9-909e-fd1db403246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:51.108151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-380908bb-ade7-4668-b53b-61e65a034298 admin admin] The token cache is being invalidate because project 23d0ed9044f844ab8b47597a6d3ca085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:35:51.108676 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-380908bb-ade7-4668-b53b-61e65a034298 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:51.112381 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-380908bb-ade7-4668-b53b-61e65a034298 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:51.118080 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 707/1409] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:35:50 2022] DELETE /identity/v3/projects/23d0ed9044f844ab8b47597a6d3ca085 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:51.118080 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380908bb-ade7-4668-b53b-61e65a034298 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:51.118080 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-380908bb-ade7-4668-b53b-61e65a034298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:51.188213 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 703/1410] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:51.194632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07aa62-d36e-48c7-933d-7743810d22cb None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:51.194909 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07aa62-d36e-48c7-933d-7743810d22cb None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:51.195287 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07aa62-d36e-48c7-933d-7743810d22cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:51.218654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:51.232739 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-7d07aa62-d36e-48c7-933d-7743810d22cb None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:51.234998 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7d07aa62-d36e-48c7-933d-7743810d22cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:51.252249 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380908bb-ade7-4668-b53b-61e65a034298 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:51.261413 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e9016-2791-4486-884d-e3bbe8dd7e69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:51.263278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e9016-2791-4486-884d-e3bbe8dd7e69 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:51.263716 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e9016-2791-4486-884d-e3bbe8dd7e69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:51.265248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e9016-2791-4486-884d-e3bbe8dd7e69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:51.272909 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-f35e9016-2791-4486-884d-e3bbe8dd7e69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:51.365596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 704/1411] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:51.366843 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07aa62-d36e-48c7-933d-7743810d22cb None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:51.370170 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7d07aa62-d36e-48c7-933d-7743810d22cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:51.459237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e9016-2791-4486-884d-e3bbe8dd7e69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:51.464386 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e9016-2791-4486-884d-e3bbe8dd7e69 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:51.492640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 708/1412] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:51.507866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da030ea-483b-4299-b885-792527d99805 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:51.508488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da030ea-483b-4299-b885-792527d99805 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:51.508971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da030ea-483b-4299-b885-792527d99805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:51.579305 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07aa62-d36e-48c7-933d-7743810d22cb None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:51.587755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6e527-3e67-4c85-81ed-bab8ef30bfbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:51.589487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6e527-3e67-4c85-81ed-bab8ef30bfbc service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:51.591639 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6e527-3e67-4c85-81ed-bab8ef30bfbc service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:51.591948 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6e527-3e67-4c85-81ed-bab8ef30bfbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:51.596636 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-8da030ea-483b-4299-b885-792527d99805 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:51.598417 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8da030ea-483b-4299-b885-792527d99805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:51.611323 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e9d6e527-3e67-4c85-81ed-bab8ef30bfbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:51.622008 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 709/1413] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:51.623224 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da030ea-483b-4299-b885-792527d99805 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:51.648705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6e527-3e67-4c85-81ed-bab8ef30bfbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:51.648927 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da030ea-483b-4299-b885-792527d99805 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:51.650214 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6e527-3e67-4c85-81ed-bab8ef30bfbc service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:51.661635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ac700-b524-436b-bd20-5853b557dd95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:51.662173 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ac700-b524-436b-bd20-5853b557dd95 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:51.662462 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ac700-b524-436b-bd20-5853b557dd95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:51.662883 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ac700-b524-436b-bd20-5853b557dd95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:51.673725 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-482ac700-b524-436b-bd20-5853b557dd95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:51.677022 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 705/1414] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:51.708168 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da4254-3b8b-48b2-ae71-4aec1e3a9782 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:51.708712 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da4254-3b8b-48b2-ae71-4aec1e3a9782 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:51.708919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da4254-3b8b-48b2-ae71-4aec1e3a9782 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:51.710474 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 706/1415] 10.222.0.36 () {54 vars in 912 bytes} [Thu Oct 20 13:35:51 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:35:51.716522 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da4254-3b8b-48b2-ae71-4aec1e3a9782 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:51.761825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da4254-3b8b-48b2-ae71-4aec1e3a9782 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:51.771711 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2df6903-9906-4482-8b4f-efb67fe9c258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:51.772418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df6903-9906-4482-8b4f-efb67fe9c258 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:51.772710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df6903-9906-4482-8b4f-efb67fe9c258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:51.772870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2df6903-9906-4482-8b4f-efb67fe9c258 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:51.773510 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df6903-9906-4482-8b4f-efb67fe9c258 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:35:51.773824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df6903-9906-4482-8b4f-efb67fe9c258 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:51.781343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2df6903-9906-4482-8b4f-efb67fe9c258 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:51.800384 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ac700-b524-436b-bd20-5853b557dd95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:51.800839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:51.804730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ac700-b524-436b-bd20-5853b557dd95 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:51.820938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 707/1416] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:35:51.822253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bf2f3-7e4c-4f39-ae1c-c1af99cc99b5 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:51.822543 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bf2f3-7e4c-4f39-ae1c-c1af99cc99b5 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:51.822822 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75bf2f3-7e4c-4f39-ae1c-c1af99cc99b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:51.838292 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 710/1417] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:51.843763 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ac700-b524-436b-bd20-5853b557dd95 service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:51.901242 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ac700-b524-436b-bd20-5853b557dd95 service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:51.922361 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489462c-96fb-4290-923c-814c9d8b639f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:51.923027 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489462c-96fb-4290-923c-814c9d8b639f admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:51.923309 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489462c-96fb-4290-923c-814c9d8b639f admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:51.923571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489462c-96fb-4290-923c-814c9d8b639f admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:51.924221 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489462c-96fb-4290-923c-814c9d8b639f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:51.927527 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489462c-96fb-4290-923c-814c9d8b639f admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:51.953495 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c75bf2f3-7e4c-4f39-ae1c-c1af99cc99b5 None None] MFA Rules not processed for user `5852ff82962e4cea85b8aa8593f09d37`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:51.955002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c75bf2f3-7e4c-4f39-ae1c-c1af99cc99b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:52.016807 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 711/1418] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:51 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:52.027459 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489462c-96fb-4290-923c-814c9d8b639f admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:52.079406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 708/1419] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Oct 20 13:35:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:52.202683 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489462c-96fb-4290-923c-814c9d8b639f admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:52.213455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad41cc-073d-4e6c-9bc7-c16a4b1030c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:52.214284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad41cc-073d-4e6c-9bc7-c16a4b1030c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:52.214568 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad41cc-073d-4e6c-9bc7-c16a4b1030c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:52.214843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad41cc-073d-4e6c-9bc7-c16a4b1030c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:52.219083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad41cc-073d-4e6c-9bc7-c16a4b1030c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:52.221584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad41cc-073d-4e6c-9bc7-c16a4b1030c2 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:52.238534 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:52.274594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 712/1420] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:52 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:52.275505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bf2f3-7e4c-4f39-ae1c-c1af99cc99b5 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:52.288195 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad41cc-073d-4e6c-9bc7-c16a4b1030c2 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:52.290226 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-35ad41cc-073d-4e6c-9bc7-c16a4b1030c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:52.295971 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75bf2f3-7e4c-4f39-ae1c-c1af99cc99b5 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:52.314186 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc515-b729-47ad-a428-94565d6dd89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:52.315097 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc515-b729-47ad-a428-94565d6dd89f admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:52.315521 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc515-b729-47ad-a428-94565d6dd89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:52.316905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc515-b729-47ad-a428-94565d6dd89f admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:52.320780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbc515-b729-47ad-a428-94565d6dd89f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:52.328175 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbc515-b729-47ad-a428-94565d6dd89f admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:52.372530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 709/1421] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:35:52.376454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc515-b729-47ad-a428-94565d6dd89f admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:52.408037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbc515-b729-47ad-a428-94565d6dd89f admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:52.417581 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478d591-7872-4fd5-924f-3707d23a9455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:52.418441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478d591-7872-4fd5-924f-3707d23a9455 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:52.419138 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478d591-7872-4fd5-924f-3707d23a9455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:52.419529 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478d591-7872-4fd5-924f-3707d23a9455 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:52.420902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478d591-7872-4fd5-924f-3707d23a9455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:52.422798 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478d591-7872-4fd5-924f-3707d23a9455 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:52.439289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 710/1422] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:52.445117 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478d591-7872-4fd5-924f-3707d23a9455 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:52.469203 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478d591-7872-4fd5-924f-3707d23a9455 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:52.478028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6344ad1-ea52-4ae8-9613-32cdfa7a0637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:52.479201 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6344ad1-ea52-4ae8-9613-32cdfa7a0637 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:52.479757 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6344ad1-ea52-4ae8-9613-32cdfa7a0637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:52.482597 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6344ad1-ea52-4ae8-9613-32cdfa7a0637 admin admin] PATH_INFO: `/v3/projects/627a25952a244acdad6df2fa8c03ebde/users/4be193f401d74e7a8eab8a55ff42f118/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:52.500175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad41cc-073d-4e6c-9bc7-c16a4b1030c2 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:52.509186 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6344ad1-ea52-4ae8-9613-32cdfa7a0637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=627a25952a244acdad6df2fa8c03ebde, user_id=4be193f401d74e7a8eab8a55ff42f118, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:52.509549 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b0d8a-5894-47d3-953b-29ee7e0781a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:52.510205 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0d8a-5894-47d3-953b-29ee7e0781a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:52.510493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0d8a-5894-47d3-953b-29ee7e0781a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:52.510771 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b0d8a-5894-47d3-953b-29ee7e0781a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:52.516636 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6344ad1-ea52-4ae8-9613-32cdfa7a0637 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:52.542221 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b0d8a-5894-47d3-953b-29ee7e0781a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:52.545884 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b0d8a-5894-47d3-953b-29ee7e0781a5 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:52.563467 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 713/1423] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:52.564927 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 711/1424] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:52 2022] PUT /identity/v3/projects/627a25952a244acdad6df2fa8c03ebde/users/4be193f401d74e7a8eab8a55ff42f118/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:52.576981 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2816048-7cf8-44a5-a0ac-862bc8d8fc45 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:52.577243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2816048-7cf8-44a5-a0ac-862bc8d8fc45 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:52.577519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2816048-7cf8-44a5-a0ac-862bc8d8fc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:52.620561 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-b2816048-7cf8-44a5-a0ac-862bc8d8fc45 None None] MFA Rules not processed for user `4be193f401d74e7a8eab8a55ff42f118`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:52.622167 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b2816048-7cf8-44a5-a0ac-862bc8d8fc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:52.814978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf64a0d-3625-46e8-b5e1-c4bccac89603 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:52.814978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf64a0d-3625-46e8-b5e1-c4bccac89603 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:52.814978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf64a0d-3625-46e8-b5e1-c4bccac89603 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:52.816417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 712/1425] 10.222.0.36 () {54 vars in 912 bytes} [Thu Oct 20 13:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:35:52.837268 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64664f9f-88d8-4d93-b424-a98acc50936b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:52.837558 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64664f9f-88d8-4d93-b424-a98acc50936b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:52.838073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64664f9f-88d8-4d93-b424-a98acc50936b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:52.885452 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 714/1426] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:52.905242 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2816048-7cf8-44a5-a0ac-862bc8d8fc45 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:52.917747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-64664f9f-88d8-4d93-b424-a98acc50936b None None] MFA Rules not processed for user `5852ff82962e4cea85b8aa8593f09d37`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:52.925827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-64664f9f-88d8-4d93-b424-a98acc50936b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:53.124667 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 713/1427] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Oct 20 13:35:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:35:53.126638 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64664f9f-88d8-4d93-b424-a98acc50936b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:53.143514 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2816048-7cf8-44a5-a0ac-862bc8d8fc45 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:53.154475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56744eed-ceee-4f2c-be29-10097d35df32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:53.161546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56744eed-ceee-4f2c-be29-10097d35df32 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:53.162093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56744eed-ceee-4f2c-be29-10097d35df32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:53.162541 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56744eed-ceee-4f2c-be29-10097d35df32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:53.163443 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56744eed-ceee-4f2c-be29-10097d35df32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:53.167525 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56744eed-ceee-4f2c-be29-10097d35df32 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:53.243076 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 715/1428] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:52 2022] POST /identity/v3/projects => generated 371 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:53.245192 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56744eed-ceee-4f2c-be29-10097d35df32 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:53.257972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64664f9f-88d8-4d93-b424-a98acc50936b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:53.274014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:53.284348 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:53.376232 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93799a77-aba0-4171-89a8-b1f1a271faeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:53.378430 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799a77-aba0-4171-89a8-b1f1a271faeb service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:53.378997 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799a77-aba0-4171-89a8-b1f1a271faeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:53.379538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93799a77-aba0-4171-89a8-b1f1a271faeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:53.384998 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-93799a77-aba0-4171-89a8-b1f1a271faeb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:53.430703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56744eed-ceee-4f2c-be29-10097d35df32 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:53.447759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a209298-68cc-461d-8da4-07882bd6847c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:53.448447 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a209298-68cc-461d-8da4-07882bd6847c service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:53.448746 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a209298-68cc-461d-8da4-07882bd6847c service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:53.449021 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a209298-68cc-461d-8da4-07882bd6847c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:53.468355 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a209298-68cc-461d-8da4-07882bd6847c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:53.471948 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a209298-68cc-461d-8da4-07882bd6847c service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:53.494822 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 716/1429] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:53.496630 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a209298-68cc-461d-8da4-07882bd6847c service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:53.552705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93799a77-aba0-4171-89a8-b1f1a271faeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:53.554538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93799a77-aba0-4171-89a8-b1f1a271faeb service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:53.582646 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 714/1430] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:53.710595 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a209298-68cc-461d-8da4-07882bd6847c service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:53.734666 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a2986-005a-494b-a33f-e0c1c4dd1e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:53.735349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a2986-005a-494b-a33f-e0c1c4dd1e66 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:53.735638 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a2986-005a-494b-a33f-e0c1c4dd1e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:53.735916 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a2986-005a-494b-a33f-e0c1c4dd1e66 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:53.736567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a2986-005a-494b-a33f-e0c1c4dd1e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:53.739402 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79a2986-005a-494b-a33f-e0c1c4dd1e66 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:53.777412 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 717/1431] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:35:53 2022] POST /identity/v3/users => generated 292 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:35:53.781723 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93799a77-aba0-4171-89a8-b1f1a271faeb service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:53.795593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93799a77-aba0-4171-89a8-b1f1a271faeb service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:53.800116 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a2986-005a-494b-a33f-e0c1c4dd1e66 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:53.802542 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e79a2986-005a-494b-a33f-e0c1c4dd1e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:53.819989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d7b5d-2045-4a92-a748-9938966983d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:53.821161 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d7b5d-2045-4a92-a748-9938966983d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:53.822621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d7b5d-2045-4a92-a748-9938966983d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:53.823105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d7b5d-2045-4a92-a748-9938966983d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:53.825652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d7b5d-2045-4a92-a748-9938966983d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:53.836968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d7b5d-2045-4a92-a748-9938966983d1 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:53.871081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 715/1432] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:35:53.872681 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d7b5d-2045-4a92-a748-9938966983d1 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:53.925488 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d7b5d-2045-4a92-a748-9938966983d1 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:53.949967 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b8e7f-f647-473f-bbd2-0d6abb736a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:53.950899 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b8e7f-f647-473f-bbd2-0d6abb736a02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:53.951289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b8e7f-f647-473f-bbd2-0d6abb736a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:53.951567 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b8e7f-f647-473f-bbd2-0d6abb736a02 admin admin] PATH_INFO: `/v3/projects/b3d265f7be9c4de69eeae83487bb8b85/users/fddf2276afc042009b359b8dfeb8830c/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:54.006165 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79a2986-005a-494b-a33f-e0c1c4dd1e66 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:54.015166 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e1c36-b367-452d-b49e-0689dfba564a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a00f0b4cee8d49a48a95317aec9f647c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:54.015814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e1c36-b367-452d-b49e-0689dfba564a service placement] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:54.016359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e1c36-b367-452d-b49e-0689dfba564a service placement] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:54.016753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e1c36-b367-452d-b49e-0689dfba564a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:54.017300 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b8e7f-f647-473f-bbd2-0d6abb736a02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d265f7be9c4de69eeae83487bb8b85, user_id=fddf2276afc042009b359b8dfeb8830c, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:54.019356 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d69e1c36-b367-452d-b49e-0689dfba564a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:54.019986 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b8e7f-f647-473f-bbd2-0d6abb736a02 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:54.038409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e1c36-b367-452d-b49e-0689dfba564a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:54.040521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e1c36-b367-452d-b49e-0689dfba564a service placement] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:54.060455 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 716/1433] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:53 2022] PUT /identity/v3/projects/b3d265f7be9c4de69eeae83487bb8b85/users/fddf2276afc042009b359b8dfeb8830c/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:54.063160 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 718/1434] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:54.064015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b8e7f-f647-473f-bbd2-0d6abb736a02 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:54.281578 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b8e7f-f647-473f-bbd2-0d6abb736a02 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:54.292538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5199b16-a2aa-40b3-9665-d664fa2087c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:54.294089 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5199b16-a2aa-40b3-9665-d664fa2087c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:54.294615 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5199b16-a2aa-40b3-9665-d664fa2087c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:54.295182 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5199b16-a2aa-40b3-9665-d664fa2087c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:54.296407 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5199b16-a2aa-40b3-9665-d664fa2087c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:54.298657 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5199b16-a2aa-40b3-9665-d664fa2087c0 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:54.339381 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 717/1435] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:35:54.340709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e1c36-b367-452d-b49e-0689dfba564a service placement] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:54.356502 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e1c36-b367-452d-b49e-0689dfba564a service placement] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:54.367026 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ea4c3-9b8a-4d2d-a562-35de3eb96c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:54.367882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ea4c3-9b8a-4d2d-a562-35de3eb96c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:54.368168 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ea4c3-9b8a-4d2d-a562-35de3eb96c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:54.368447 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ea4c3-9b8a-4d2d-a562-35de3eb96c87 admin admin] PATH_INFO: `/v3/projects/b3d265f7be9c4de69eeae83487bb8b85/users/fddf2276afc042009b359b8dfeb8830c/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:54.371005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ea4c3-9b8a-4d2d-a562-35de3eb96c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3d265f7be9c4de69eeae83487bb8b85, user_id=fddf2276afc042009b359b8dfeb8830c, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:54.374856 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd8a22-f3a1-4b2d-a709-60cdfa9cf517 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:54.375763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd8a22-f3a1-4b2d-a709-60cdfa9cf517 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:54.375952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd8a22-f3a1-4b2d-a709-60cdfa9cf517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:54.391963 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ea4c3-9b8a-4d2d-a562-35de3eb96c87 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:54.435309 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5acd8a22-f3a1-4b2d-a709-60cdfa9cf517 None None] MFA Rules not processed for user `274bdb52067d4788a0c628e6d900c2df`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:54.439405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5acd8a22-f3a1-4b2d-a709-60cdfa9cf517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:54.464239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 719/1436] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:35:54 2022] PUT /identity/v3/projects/b3d265f7be9c4de69eeae83487bb8b85/users/fddf2276afc042009b359b8dfeb8830c/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:54.476142 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e562d0-4a2b-4e84-9d9f-4d6334936358 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:54.476527 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e562d0-4a2b-4e84-9d9f-4d6334936358 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:54.476943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e562d0-4a2b-4e84-9d9f-4d6334936358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:54.498832 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:54.584317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-44e562d0-4a2b-4e84-9d9f-4d6334936358 None None] MFA Rules not processed for user `fddf2276afc042009b359b8dfeb8830c`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:54.585678 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-44e562d0-4a2b-4e84-9d9f-4d6334936358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:54.609488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:54.630582 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 718/1437] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:35:54.832344 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 720/1438] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:54 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:35:54.932818 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f94c24-02e6-446e-bc84-d9f1b6683879 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:54.933376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f94c24-02e6-446e-bc84-d9f1b6683879 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:54.933376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f94c24-02e6-446e-bc84-d9f1b6683879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:55.037272 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-04f94c24-02e6-446e-bc84-d9f1b6683879 None None] MFA Rules not processed for user `4019f657541a4c2ab6e6cdf2bb82a99e`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:55.039741 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-04f94c24-02e6-446e-bc84-d9f1b6683879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:55.044301 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e562d0-4a2b-4e84-9d9f-4d6334936358 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:55.049205 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-44e562d0-4a2b-4e84-9d9f-4d6334936358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:55.230104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e562d0-4a2b-4e84-9d9f-4d6334936358 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:55.247098 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 719/1439] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:55.250785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c057ab-653d-43b5-ac5c-abe3f5f856b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:55.252845 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c057ab-653d-43b5-ac5c-abe3f5f856b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:55.253132 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c057ab-653d-43b5-ac5c-abe3f5f856b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:55.254695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c057ab-653d-43b5-ac5c-abe3f5f856b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:55.289596 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c057ab-653d-43b5-ac5c-abe3f5f856b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:55.297679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c057ab-653d-43b5-ac5c-abe3f5f856b0 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:55.351676 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 721/1440] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:56.515180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f94c24-02e6-446e-bc84-d9f1b6683879 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:56.516699 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-04f94c24-02e6-446e-bc84-d9f1b6683879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:56.714430 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f94c24-02e6-446e-bc84-d9f1b6683879 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:56.732560 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd09a30-fa9b-470a-834f-7a4190d14ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:56.736730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd09a30-fa9b-470a-834f-7a4190d14ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:56.740343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd09a30-fa9b-470a-834f-7a4190d14ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:56.740343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd09a30-fa9b-470a-834f-7a4190d14ca2 admin admin] PATH_INFO: `/v3/users/7c9db1bba6354059ba0d8b7a05eda842` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:56.745497 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd09a30-fa9b-470a-834f-7a4190d14ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9db1bba6354059ba0d8b7a05eda842)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:56.758987 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd09a30-fa9b-470a-834f-7a4190d14ca2 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:56.940488 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-9bd09a30-fa9b-470a-834f-7a4190d14ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9db1bba6354059ba0d8b7a05eda842'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:56.943799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-9bd09a30-fa9b-470a-834f-7a4190d14ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9db1bba6354059ba0d8b7a05eda842'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:56.967925 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-9bd09a30-fa9b-470a-834f-7a4190d14ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9db1bba6354059ba0d8b7a05eda842'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:57.014184 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-9bd09a30-fa9b-470a-834f-7a4190d14ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9db1bba6354059ba0d8b7a05eda842'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:57.016419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-9bd09a30-fa9b-470a-834f-7a4190d14ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9db1bba6354059ba0d8b7a05eda842'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:57.019832 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:57.057106 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 720/1441] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:35:56 2022] DELETE /identity/v3/users/7c9db1bba6354059ba0d8b7a05eda842 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:57.059168 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3eae8-9c1c-4a16-994c-54672c1d91af None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:57.059688 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3eae8-9c1c-4a16-994c-54672c1d91af None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:57.059767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3eae8-9c1c-4a16-994c-54672c1d91af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:57.114378 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-9ed3eae8-9c1c-4a16-994c-54672c1d91af None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:57.119445 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9ed3eae8-9c1c-4a16-994c-54672c1d91af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:57.359955 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd09a30-fa9b-470a-834f-7a4190d14ca2 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:57.361505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9bd09a30-fa9b-470a-834f-7a4190d14ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:57.390036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 722/1442] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:57.401831 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3eae8-9c1c-4a16-994c-54672c1d91af None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:57.404689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9ed3eae8-9c1c-4a16-994c-54672c1d91af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:57.408666 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd09a30-fa9b-470a-834f-7a4190d14ca2 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:57.467174 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3dd7a-1c57-4500-81c9-2e72330ce05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:57.469290 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3dd7a-1c57-4500-81c9-2e72330ce05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:57.473309 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3dd7a-1c57-4500-81c9-2e72330ce05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:57.473597 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3dd7a-1c57-4500-81c9-2e72330ce05a admin admin] PATH_INFO: `/v3/users/280345f7b63d474294236431b5b5dedf` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:57.490366 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3dd7a-1c57-4500-81c9-2e72330ce05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=280345f7b63d474294236431b5b5dedf)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:57.506884 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3dd7a-1c57-4500-81c9-2e72330ce05a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:57.710607 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:57.774564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f5b3dd7a-1c57-4500-81c9-2e72330ce05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280345f7b63d474294236431b5b5dedf'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:57.775816 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f5b3dd7a-1c57-4500-81c9-2e72330ce05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280345f7b63d474294236431b5b5dedf'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:57.789667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3eae8-9c1c-4a16-994c-54672c1d91af None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:57.795386 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f5b3dd7a-1c57-4500-81c9-2e72330ce05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280345f7b63d474294236431b5b5dedf'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:57.807045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb30ac-7ef6-45a1-b0b5-4f41456604f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:57.813681 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb30ac-7ef6-45a1-b0b5-4f41456604f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:57.814164 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb30ac-7ef6-45a1-b0b5-4f41456604f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:57.814450 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb30ac-7ef6-45a1-b0b5-4f41456604f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:57.862292 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb30ac-7ef6-45a1-b0b5-4f41456604f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:57.865578 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f5b3dd7a-1c57-4500-81c9-2e72330ce05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280345f7b63d474294236431b5b5dedf'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:57.875464 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb30ac-7ef6-45a1-b0b5-4f41456604f5 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:57.886406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f5b3dd7a-1c57-4500-81c9-2e72330ce05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280345f7b63d474294236431b5b5dedf'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:57.924559 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 721/1443] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:35:57 2022] DELETE /identity/v3/users/280345f7b63d474294236431b5b5dedf => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:57.927419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24055c9c-cfee-4494-8746-d3b3bdcf86e0 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:57.927860 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24055c9c-cfee-4494-8746-d3b3bdcf86e0 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:57.928154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24055c9c-cfee-4494-8746-d3b3bdcf86e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:57.930908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 723/1444] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:35:58.068611 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-24055c9c-cfee-4494-8746-d3b3bdcf86e0 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:58.073657 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-24055c9c-cfee-4494-8746-d3b3bdcf86e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:58.289362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb30ac-7ef6-45a1-b0b5-4f41456604f5 service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:58.291686 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7aeb30ac-7ef6-45a1-b0b5-4f41456604f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:58.312022 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 722/1445] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:58.330416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24055c9c-cfee-4494-8746-d3b3bdcf86e0 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:58.332487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-24055c9c-cfee-4494-8746-d3b3bdcf86e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:58.335316 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb30ac-7ef6-45a1-b0b5-4f41456604f5 service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:58.367745 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e99c62-80dc-489b-be76-89b48c7a17ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:58.368877 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e99c62-80dc-489b-be76-89b48c7a17ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:58.369808 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e99c62-80dc-489b-be76-89b48c7a17ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:58.370302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e99c62-80dc-489b-be76-89b48c7a17ab admin admin] PATH_INFO: `/v3/users/4be193f401d74e7a8eab8a55ff42f118` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:58.372191 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e99c62-80dc-489b-be76-89b48c7a17ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be193f401d74e7a8eab8a55ff42f118)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:58.376456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e99c62-80dc-489b-be76-89b48c7a17ab admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:58.521375 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24055c9c-cfee-4494-8746-d3b3bdcf86e0 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:58.556862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e92fdb-e3c7-4318-8ee6-1a632d91b479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:58.557955 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e92fdb-e3c7-4318-8ee6-1a632d91b479 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:58.560597 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e92fdb-e3c7-4318-8ee6-1a632d91b479 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:58.563765 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-e1e99c62-80dc-489b-be76-89b48c7a17ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be193f401d74e7a8eab8a55ff42f118'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:58.563957 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e92fdb-e3c7-4318-8ee6-1a632d91b479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:58.565015 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-e1e99c62-80dc-489b-be76-89b48c7a17ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be193f401d74e7a8eab8a55ff42f118'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:58.577877 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-e1e99c62-80dc-489b-be76-89b48c7a17ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be193f401d74e7a8eab8a55ff42f118'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:58.600172 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-e1e99c62-80dc-489b-be76-89b48c7a17ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be193f401d74e7a8eab8a55ff42f118'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:58.601590 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-e1e99c62-80dc-489b-be76-89b48c7a17ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be193f401d74e7a8eab8a55ff42f118'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:58.608312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e92fdb-e3c7-4318-8ee6-1a632d91b479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:58.615716 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e92fdb-e3c7-4318-8ee6-1a632d91b479 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:58.638711 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 724/1446] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:35:58 2022] DELETE /identity/v3/users/4be193f401d74e7a8eab8a55ff42f118 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:35:58.642667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23b7ad-cd0b-483e-ad6a-4186c98ce002 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:58.643163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23b7ad-cd0b-483e-ad6a-4186c98ce002 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:58.643657 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23b7ad-cd0b-483e-ad6a-4186c98ce002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:58.652222 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 723/1447] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:58.690783 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-1e23b7ad-cd0b-483e-ad6a-4186c98ce002 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:58.695363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-1e23b7ad-cd0b-483e-ad6a-4186c98ce002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:58.788296 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 725/1448] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:58.829193 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e92fdb-e3c7-4318-8ee6-1a632d91b479 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:58.845311 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e92fdb-e3c7-4318-8ee6-1a632d91b479 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:58.852293 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:58.859861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901937f2-c584-4e18-b1d0-8e2598fb8c37 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:58.860300 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901937f2-c584-4e18-b1d0-8e2598fb8c37 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:58.860654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901937f2-c584-4e18-b1d0-8e2598fb8c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:58.963795 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34f391-08b0-4fbb-8f4a-cb031d4bd633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:58.966792 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34f391-08b0-4fbb-8f4a-cb031d4bd633 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:58.967417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34f391-08b0-4fbb-8f4a-cb031d4bd633 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:58.968145 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34f391-08b0-4fbb-8f4a-cb031d4bd633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:58.983784 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34f391-08b0-4fbb-8f4a-cb031d4bd633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:58.985681 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34f391-08b0-4fbb-8f4a-cb031d4bd633 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:58.994708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-901937f2-c584-4e18-b1d0-8e2598fb8c37 None None] MFA Rules not processed for user `44342daa668c4516ae131d9f0160261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:59.002567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-901937f2-c584-4e18-b1d0-8e2598fb8c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:59.030215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 724/1449] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:35:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:35:59.098162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:35:59.163453 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 726/1450] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Oct 20 13:35:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:35:59.305508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34f391-08b0-4fbb-8f4a-cb031d4bd633 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:59.307904 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2f34f391-08b0-4fbb-8f4a-cb031d4bd633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:59.336108 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34f391-08b0-4fbb-8f4a-cb031d4bd633 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:59.344567 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32caf46-19c4-4928-bc9e-32290122ebb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:59.345658 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32caf46-19c4-4928-bc9e-32290122ebb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:59.356683 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32caf46-19c4-4928-bc9e-32290122ebb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:59.357639 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32caf46-19c4-4928-bc9e-32290122ebb2 admin admin] PATH_INFO: `/v3/projects/9dd43c20131249c49f14f5f4d589b16b` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:59.359847 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32caf46-19c4-4928-bc9e-32290122ebb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd43c20131249c49f14f5f4d589b16b)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:59.364701 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32caf46-19c4-4928-bc9e-32290122ebb2 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:59.464733 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901937f2-c584-4e18-b1d0-8e2598fb8c37 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:59.468382 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-901937f2-c584-4e18-b1d0-8e2598fb8c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:59.478117 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b32caf46-19c4-4928-bc9e-32290122ebb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd43c20131249c49f14f5f4d589b16b', 'request_id': 'req-b32caf46-19c4-4928-bc9e-32290122ebb2'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:59.503472 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b32caf46-19c4-4928-bc9e-32290122ebb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd43c20131249c49f14f5f4d589b16b', 'request_id': 'req-b32caf46-19c4-4928-bc9e-32290122ebb2'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:59.510614 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b32caf46-19c4-4928-bc9e-32290122ebb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd43c20131249c49f14f5f4d589b16b', 'request_id': 'req-b32caf46-19c4-4928-bc9e-32290122ebb2'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:59.532112 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b32caf46-19c4-4928-bc9e-32290122ebb2 admin admin] The token cache is being invalidate because project 9dd43c20131249c49f14f5f4d589b16b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:35:59.532404 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b32caf46-19c4-4928-bc9e-32290122ebb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:59.535449 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b32caf46-19c4-4928-bc9e-32290122ebb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:35:59.538024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 725/1451] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:35:59 2022] DELETE /identity/v3/projects/9dd43c20131249c49f14f5f4d589b16b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:35:59.542808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a968f6-d5c9-4978-87a9-306ec1f694b1 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:59.544113 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a968f6-d5c9-4978-87a9-306ec1f694b1 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:59.544775 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a968f6-d5c9-4978-87a9-306ec1f694b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:59.593301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c0a968f6-d5c9-4978-87a9-306ec1f694b1 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:59.597521 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c0a968f6-d5c9-4978-87a9-306ec1f694b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:59.749224 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901937f2-c584-4e18-b1d0-8e2598fb8c37 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:59.770925 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 726/1452] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:35:59.772735 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e8876-4041-452a-8400-9add58f7be46 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:59.773090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e8876-4041-452a-8400-9add58f7be46 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:59.773450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e8876-4041-452a-8400-9add58f7be46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:59.811958 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-1d1e8876-4041-452a-8400-9add58f7be46 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:35:59.813317 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1d1e8876-4041-452a-8400-9add58f7be46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:59.832629 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 727/1453] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:35:59.836917 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e8876-4041-452a-8400-9add58f7be46 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:59.850733 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e8876-4041-452a-8400-9add58f7be46 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:59.872469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55d438-d64d-4a82-8360-3d7b9e0f68dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:59.873386 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55d438-d64d-4a82-8360-3d7b9e0f68dd admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:59.873681 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55d438-d64d-4a82-8360-3d7b9e0f68dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:59.873958 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e55d438-d64d-4a82-8360-3d7b9e0f68dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:59.874684 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55d438-d64d-4a82-8360-3d7b9e0f68dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:35:59.875035 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55d438-d64d-4a82-8360-3d7b9e0f68dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:59.877239 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e55d438-d64d-4a82-8360-3d7b9e0f68dd admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:59.906350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 728/1454] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:35:59.908569 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55d438-d64d-4a82-8360-3d7b9e0f68dd admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:35:59.926408 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e55d438-d64d-4a82-8360-3d7b9e0f68dd admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:35:59.937805 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9d8a0-7273-42fe-bc71-10770d25e163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:59.939036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d8a0-7273-42fe-bc71-10770d25e163 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:59.939325 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d8a0-7273-42fe-bc71-10770d25e163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:59.939647 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9d8a0-7273-42fe-bc71-10770d25e163 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:59.941142 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9d8a0-7273-42fe-bc71-10770d25e163 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:35:59.945521 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce9d8a0-7273-42fe-bc71-10770d25e163 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:35:59.957221 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978c715-9833-4ab1-9547-18b702480eae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c893e6388ed340eca17da2e279ca34a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:35:59.957868 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978c715-9833-4ab1-9547-18b702480eae service swift] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:35:59.958262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978c715-9833-4ab1-9547-18b702480eae service swift] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:35:59.958629 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978c715-9833-4ab1-9547-18b702480eae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:35:59.960855 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-2978c715-9833-4ab1-9547-18b702480eae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:35:59.982364 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:00.019182 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 729/1455] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:35:59 2022] POST /identity/v3/projects => generated 405 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:00.022303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9d8a0-7273-42fe-bc71-10770d25e163 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:00.109326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:00.118017 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978c715-9833-4ab1-9547-18b702480eae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:00.123471 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978c715-9833-4ab1-9547-18b702480eae service swift] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:00.156539 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 727/1456] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Oct 20 13:35:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 692 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 13:36:00.208883 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9d8a0-7273-42fe-bc71-10770d25e163 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:00.216834 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5e089-1dbb-40ac-bf25-3a8b5b4a9315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:00.217661 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5e089-1dbb-40ac-bf25-3a8b5b4a9315 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:00.217934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5e089-1dbb-40ac-bf25-3a8b5b4a9315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:00.218295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5e089-1dbb-40ac-bf25-3a8b5b4a9315 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:00.219106 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5e089-1dbb-40ac-bf25-3a8b5b4a9315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:00.233318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5e089-1dbb-40ac-bf25-3a8b5b4a9315 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:00.331196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 730/1457] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:00 2022] POST /identity/v3/users => generated 303 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:00.333147 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978c715-9833-4ab1-9547-18b702480eae service swift] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:00.364703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978c715-9833-4ab1-9547-18b702480eae service swift] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:00.389251 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2765c5-af10-4900-b182-92b19745257d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:00.392681 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2765c5-af10-4900-b182-92b19745257d admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:00.394617 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2765c5-af10-4900-b182-92b19745257d admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:00.395172 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2765c5-af10-4900-b182-92b19745257d admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:00.395958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2765c5-af10-4900-b182-92b19745257d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:00.408181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2765c5-af10-4900-b182-92b19745257d admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:00.433193 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 728/1458] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:00.435705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5e089-1dbb-40ac-bf25-3a8b5b4a9315 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:00.452474 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5e089-1dbb-40ac-bf25-3a8b5b4a9315 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:00.470185 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdefbb-4d1c-45eb-a337-9b73336e5611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:00.471174 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdefbb-4d1c-45eb-a337-9b73336e5611 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:00.471425 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdefbb-4d1c-45eb-a337-9b73336e5611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:00.471843 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdefbb-4d1c-45eb-a337-9b73336e5611 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:00.472847 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffdefbb-4d1c-45eb-a337-9b73336e5611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:00.477858 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffdefbb-4d1c-45eb-a337-9b73336e5611 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:00.505881 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 731/1459] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:00.508196 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2765c5-af10-4900-b182-92b19745257d admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:00.529382 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2765c5-af10-4900-b182-92b19745257d admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:00.543808 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cc155-ae8c-4953-b4f0-5540535d4540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:00.547936 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cc155-ae8c-4953-b4f0-5540535d4540 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:00.549645 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cc155-ae8c-4953-b4f0-5540535d4540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:00.551430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cc155-ae8c-4953-b4f0-5540535d4540 admin admin] PATH_INFO: `/v3/projects/9df92c474fd64fc9a317369338335eda/users/d4d2ee393e6149afbfdd6259763a75b1/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:00.595026 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cc155-ae8c-4953-b4f0-5540535d4540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df92c474fd64fc9a317369338335eda, user_id=d4d2ee393e6149afbfdd6259763a75b1, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:00.604230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cc155-ae8c-4953-b4f0-5540535d4540 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:00.641239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 729/1460] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:00 2022] PUT /identity/v3/projects/9df92c474fd64fc9a317369338335eda/users/d4d2ee393e6149afbfdd6259763a75b1/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:36:00.658896 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c9f11-9dd2-428a-8166-7565cb811fb5 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:00.659429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c9f11-9dd2-428a-8166-7565cb811fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:00.660022 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c9f11-9dd2-428a-8166-7565cb811fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:00.758686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-061c9f11-9dd2-428a-8166-7565cb811fb5 None None] MFA Rules not processed for user `d4d2ee393e6149afbfdd6259763a75b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:00.764889 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-061c9f11-9dd2-428a-8166-7565cb811fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:01.098145 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 732/1461] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:00 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:01.102625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cc155-ae8c-4953-b4f0-5540535d4540 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:01.374607 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cc155-ae8c-4953-b4f0-5540535d4540 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:01.395769 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17502dde-dbd1-4005-b32b-4ab47daf1024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:01.396735 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17502dde-dbd1-4005-b32b-4ab47daf1024 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:01.397916 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17502dde-dbd1-4005-b32b-4ab47daf1024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:01.398395 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17502dde-dbd1-4005-b32b-4ab47daf1024 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:01.399331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17502dde-dbd1-4005-b32b-4ab47daf1024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:01.408748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17502dde-dbd1-4005-b32b-4ab47daf1024 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:01.567948 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 730/1462] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:01 2022] POST /identity/v3/projects => generated 403 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:01.569765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c9f11-9dd2-428a-8166-7565cb811fb5 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:01.604622 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c9f11-9dd2-428a-8166-7565cb811fb5 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:01.945946 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e80f7-f49a-4981-baf2-4e408bdb7d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:01.953517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e80f7-f49a-4981-baf2-4e408bdb7d84 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:01.957620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e80f7-f49a-4981-baf2-4e408bdb7d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:01.958451 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e80f7-f49a-4981-baf2-4e408bdb7d84 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:01.960861 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e80f7-f49a-4981-baf2-4e408bdb7d84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:01.973081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e80f7-f49a-4981-baf2-4e408bdb7d84 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:02.023683 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:02.067013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 733/1463] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:01 2022] POST /identity/v3/users => generated 308 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:02.067959 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17502dde-dbd1-4005-b32b-4ab47daf1024 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:02.092109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17502dde-dbd1-4005-b32b-4ab47daf1024 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:02.144135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b515b-5983-4e6e-9c56-08588e7dab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:02.152317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b515b-5983-4e6e-9c56-08588e7dab4a admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:02.153712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b515b-5983-4e6e-9c56-08588e7dab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:02.154021 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b515b-5983-4e6e-9c56-08588e7dab4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:02.154739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b515b-5983-4e6e-9c56-08588e7dab4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:02.162007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b515b-5983-4e6e-9c56-08588e7dab4a admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:02.208747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 731/1464] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:02.212399 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e80f7-f49a-4981-baf2-4e408bdb7d84 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:02.238101 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e80f7-f49a-4981-baf2-4e408bdb7d84 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:02.270200 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b99d6-0c90-42a4-bfb3-95b7e8af0221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:02.270863 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b99d6-0c90-42a4-bfb3-95b7e8af0221 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:02.271159 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b99d6-0c90-42a4-bfb3-95b7e8af0221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:02.272485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b99d6-0c90-42a4-bfb3-95b7e8af0221 admin admin] PATH_INFO: `/v3/projects/5b96c5f4f09440789b9e8dff3bca2c7f/users/5fb74892a33d4391b3ef91d8e729d8ba/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:02.338020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b99d6-0c90-42a4-bfb3-95b7e8af0221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b96c5f4f09440789b9e8dff3bca2c7f, user_id=5fb74892a33d4391b3ef91d8e729d8ba, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:02.341682 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b99d6-0c90-42a4-bfb3-95b7e8af0221 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:02.378882 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 734/1465] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:02 2022] PUT /identity/v3/projects/5b96c5f4f09440789b9e8dff3bca2c7f/users/5fb74892a33d4391b3ef91d8e729d8ba/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:02.380491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b515b-5983-4e6e-9c56-08588e7dab4a admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:02.385774 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d60e1-4438-480b-8134-026523dca9a5 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:02.386101 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d60e1-4438-480b-8134-026523dca9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:02.386376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d60e1-4438-480b-8134-026523dca9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:02.398320 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b515b-5983-4e6e-9c56-08588e7dab4a admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:02.432329 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-210d60e1-4438-480b-8134-026523dca9a5 None None] MFA Rules not processed for user `5852ff82962e4cea85b8aa8593f09d37`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:02.433738 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-210d60e1-4438-480b-8134-026523dca9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:02.568284 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 735/1466] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Oct 20 13:36:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:36:02.654429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f05a3-b60e-4544-a401-b5a5bafb8b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:02.655725 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f05a3-b60e-4544-a401-b5a5bafb8b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:02.656201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f05a3-b60e-4544-a401-b5a5bafb8b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:02.656930 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f05a3-b60e-4544-a401-b5a5bafb8b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:02.657894 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f05a3-b60e-4544-a401-b5a5bafb8b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:02.658241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d60e1-4438-480b-8134-026523dca9a5 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:02.662897 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-210d60e1-4438-480b-8134-026523dca9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:02.663897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f05a3-b60e-4544-a401-b5a5bafb8b9b admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:02.694809 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d60e1-4438-480b-8134-026523dca9a5 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:02.704319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365644ba-2a5b-4ed0-8edb-e901900331f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:02.705376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365644ba-2a5b-4ed0-8edb-e901900331f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:02.705792 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365644ba-2a5b-4ed0-8edb-e901900331f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:02.709015 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 732/1467] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:36:02.709827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365644ba-2a5b-4ed0-8edb-e901900331f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:02.710778 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f05a3-b60e-4544-a401-b5a5bafb8b9b admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:02.733044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365644ba-2a5b-4ed0-8edb-e901900331f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:02.741921 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f05a3-b60e-4544-a401-b5a5bafb8b9b admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:02.744038 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365644ba-2a5b-4ed0-8edb-e901900331f7 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:02.750037 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43724230-fe0b-4c98-a34e-7ff60733fd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:02.752418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43724230-fe0b-4c98-a34e-7ff60733fd31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:02.752883 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43724230-fe0b-4c98-a34e-7ff60733fd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:02.753319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43724230-fe0b-4c98-a34e-7ff60733fd31 admin admin] PATH_INFO: `/v3/projects/5b96c5f4f09440789b9e8dff3bca2c7f/users/5fb74892a33d4391b3ef91d8e729d8ba/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:02.756268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43724230-fe0b-4c98-a34e-7ff60733fd31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b96c5f4f09440789b9e8dff3bca2c7f, user_id=5fb74892a33d4391b3ef91d8e729d8ba, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:02.757804 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 736/1468] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:02.797840 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43724230-fe0b-4c98-a34e-7ff60733fd31 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:02.832623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 733/1469] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:02 2022] PUT /identity/v3/projects/5b96c5f4f09440789b9e8dff3bca2c7f/users/5fb74892a33d4391b3ef91d8e729d8ba/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:02.848081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9d6c6-3772-45de-90e1-e0434e42240a None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:02.848519 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9d6c6-3772-45de-90e1-e0434e42240a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:02.848954 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9d6c6-3772-45de-90e1-e0434e42240a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:02.942493 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ccb9d6c6-3772-45de-90e1-e0434e42240a None None] MFA Rules not processed for user `5fb74892a33d4391b3ef91d8e729d8ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:02.943855 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ccb9d6c6-3772-45de-90e1-e0434e42240a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:03.123007 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 737/1470] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:02 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:03.136492 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43724230-fe0b-4c98-a34e-7ff60733fd31 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:03.138785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-43724230-fe0b-4c98-a34e-7ff60733fd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:03.196911 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:03.331067 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43724230-fe0b-4c98-a34e-7ff60733fd31 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:03.343521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65cf6e-5f97-4526-ad04-0cad79eb65d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:03.346187 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65cf6e-5f97-4526-ad04-0cad79eb65d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:03.346517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65cf6e-5f97-4526-ad04-0cad79eb65d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:03.346834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e65cf6e-5f97-4526-ad04-0cad79eb65d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:03.366546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65cf6e-5f97-4526-ad04-0cad79eb65d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:03.369211 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e65cf6e-5f97-4526-ad04-0cad79eb65d8 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:03.383816 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 734/1471] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:03 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:36:03.717612 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9d6c6-3772-45de-90e1-e0434e42240a None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:03.805599 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65cf6e-5f97-4526-ad04-0cad79eb65d8 service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:03.807139 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-5e65cf6e-5f97-4526-ad04-0cad79eb65d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:03.966068 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:03.983271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e65cf6e-5f97-4526-ad04-0cad79eb65d8 service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:03.995993 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc1256-759d-4412-8b66-6c295bbd683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:03.997074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc1256-759d-4412-8b66-6c295bbd683b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:03.997371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc1256-759d-4412-8b66-6c295bbd683b admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:03.999710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc1256-759d-4412-8b66-6c295bbd683b admin admin] PATH_INFO: `/v3/projects/746d12d413464ed08daeef07e2b2940a` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:04.002116 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc1256-759d-4412-8b66-6c295bbd683b admin admin] RBAC: Authorizing `identity:delete_project(project_id=746d12d413464ed08daeef07e2b2940a)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:04.005467 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc1256-759d-4412-8b66-6c295bbd683b admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:04.012798 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9d6c6-3772-45de-90e1-e0434e42240a None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:04.038195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863b60f-73e7-4d9e-b934-b6cf8d5cb20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:04.038865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863b60f-73e7-4d9e-b934-b6cf8d5cb20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:04.039186 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863b60f-73e7-4d9e-b934-b6cf8d5cb20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:04.039626 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863b60f-73e7-4d9e-b934-b6cf8d5cb20d admin admin] PATH_INFO: `/v3/users/d4d2ee393e6149afbfdd6259763a75b1` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:04.041368 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863b60f-73e7-4d9e-b934-b6cf8d5cb20d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d2ee393e6149afbfdd6259763a75b1)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:04.043720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863b60f-73e7-4d9e-b934-b6cf8d5cb20d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:04.171196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-4863b60f-73e7-4d9e-b934-b6cf8d5cb20d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d2ee393e6149afbfdd6259763a75b1'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:04.179671 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-4863b60f-73e7-4d9e-b934-b6cf8d5cb20d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d2ee393e6149afbfdd6259763a75b1'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:04.198674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-4863b60f-73e7-4d9e-b934-b6cf8d5cb20d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d2ee393e6149afbfdd6259763a75b1'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:04.199342 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f7bc1256-759d-4412-8b66-6c295bbd683b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '746d12d413464ed08daeef07e2b2940a', 'request_id': 'req-f7bc1256-759d-4412-8b66-6c295bbd683b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:04.229424 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-4863b60f-73e7-4d9e-b934-b6cf8d5cb20d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d2ee393e6149afbfdd6259763a75b1'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:04.232429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f7bc1256-759d-4412-8b66-6c295bbd683b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '746d12d413464ed08daeef07e2b2940a', 'request_id': 'req-f7bc1256-759d-4412-8b66-6c295bbd683b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:04.232585 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-4863b60f-73e7-4d9e-b934-b6cf8d5cb20d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d2ee393e6149afbfdd6259763a75b1'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:04.276386 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 738/1472] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:03 2022] DELETE /identity/v3/users/d4d2ee393e6149afbfdd6259763a75b1 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:04.278304 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a73e9-dafa-4722-a9a0-87d78c895147 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:04.278589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a73e9-dafa-4722-a9a0-87d78c895147 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:04.278864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a73e9-dafa-4722-a9a0-87d78c895147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:04.280270 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f7bc1256-759d-4412-8b66-6c295bbd683b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '746d12d413464ed08daeef07e2b2940a', 'request_id': 'req-f7bc1256-759d-4412-8b66-6c295bbd683b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:04.320573 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f7bc1256-759d-4412-8b66-6c295bbd683b admin admin] The token cache is being invalidate because project 746d12d413464ed08daeef07e2b2940a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:04.320917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f7bc1256-759d-4412-8b66-6c295bbd683b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:04.321897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f7bc1256-759d-4412-8b66-6c295bbd683b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:04.333593 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 735/1473] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:03 2022] DELETE /identity/v3/projects/746d12d413464ed08daeef07e2b2940a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:36:04.335325 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc1256-759d-4412-8b66-6c295bbd683b admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:04.337604 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-f7bc1256-759d-4412-8b66-6c295bbd683b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:04.346145 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ed0a73e9-dafa-4722-a9a0-87d78c895147 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:04.347363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ed0a73e9-dafa-4722-a9a0-87d78c895147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:04.569737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:04.605494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 739/1474] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:04.615074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc1256-759d-4412-8b66-6c295bbd683b admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:04.624828 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5755c-8178-4491-957d-3ed9e799bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:04.627626 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5755c-8178-4491-957d-3ed9e799bbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:04.628025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5755c-8178-4491-957d-3ed9e799bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:04.628401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5755c-8178-4491-957d-3ed9e799bbfd admin admin] PATH_INFO: `/v3/users/fe53226cece345939f5149149eaca56f` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:04.631872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5755c-8178-4491-957d-3ed9e799bbfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe53226cece345939f5149149eaca56f)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:04.640412 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5755c-8178-4491-957d-3ed9e799bbfd admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:04.646460 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a73e9-dafa-4722-a9a0-87d78c895147 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:04.649989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ed0a73e9-dafa-4722-a9a0-87d78c895147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:04.766205 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b4f5755c-8178-4491-957d-3ed9e799bbfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe53226cece345939f5149149eaca56f'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:04.767399 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b4f5755c-8178-4491-957d-3ed9e799bbfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe53226cece345939f5149149eaca56f'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:04.773976 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a73e9-dafa-4722-a9a0-87d78c895147 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:04.779609 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c9e83-d2ab-4bf2-a330-2e88a16944c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:04.780257 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c9e83-d2ab-4bf2-a330-2e88a16944c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:04.780541 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c9e83-d2ab-4bf2-a330-2e88a16944c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:04.780818 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c9e83-d2ab-4bf2-a330-2e88a16944c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:04.796863 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c9e83-d2ab-4bf2-a330-2e88a16944c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:04.798441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c9e83-d2ab-4bf2-a330-2e88a16944c9 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:04.801423 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b4f5755c-8178-4491-957d-3ed9e799bbfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe53226cece345939f5149149eaca56f'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:04.816632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 740/1475] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:36:04.910899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b4f5755c-8178-4491-957d-3ed9e799bbfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe53226cece345939f5149149eaca56f'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:04.912215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b4f5755c-8178-4491-957d-3ed9e799bbfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe53226cece345939f5149149eaca56f'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:04.957835 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 736/1476] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:04 2022] DELETE /identity/v3/users/fe53226cece345939f5149149eaca56f => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:05.279356 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c9e83-d2ab-4bf2-a330-2e88a16944c9 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:05.281190 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-891c9e83-d2ab-4bf2-a330-2e88a16944c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:05.311066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c9e83-d2ab-4bf2-a330-2e88a16944c9 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:05.330740 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:05.434673 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203911ae-4f7b-4319-8233-360adc575860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:05.435813 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203911ae-4f7b-4319-8233-360adc575860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:05.436565 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203911ae-4f7b-4319-8233-360adc575860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:05.437228 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203911ae-4f7b-4319-8233-360adc575860 admin admin] PATH_INFO: `/v3/projects/627a25952a244acdad6df2fa8c03ebde` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:05.438979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203911ae-4f7b-4319-8233-360adc575860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=627a25952a244acdad6df2fa8c03ebde)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:05.442212 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203911ae-4f7b-4319-8233-360adc575860 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:05.570038 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-203911ae-4f7b-4319-8233-360adc575860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '627a25952a244acdad6df2fa8c03ebde', 'request_id': 'req-203911ae-4f7b-4319-8233-360adc575860'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:05.607024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-203911ae-4f7b-4319-8233-360adc575860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '627a25952a244acdad6df2fa8c03ebde', 'request_id': 'req-203911ae-4f7b-4319-8233-360adc575860'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:05.620538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-203911ae-4f7b-4319-8233-360adc575860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '627a25952a244acdad6df2fa8c03ebde', 'request_id': 'req-203911ae-4f7b-4319-8233-360adc575860'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:05.665550 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-203911ae-4f7b-4319-8233-360adc575860 admin admin] The token cache is being invalidate because project 627a25952a244acdad6df2fa8c03ebde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:05.665854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-203911ae-4f7b-4319-8233-360adc575860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:05.668844 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-203911ae-4f7b-4319-8233-360adc575860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:05.673548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 741/1477] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:05 2022] DELETE /identity/v3/projects/627a25952a244acdad6df2fa8c03ebde => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:05.678733 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5755c-8178-4491-957d-3ed9e799bbfd admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:05.681790 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b4f5755c-8178-4491-957d-3ed9e799bbfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:05.705017 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5755c-8178-4491-957d-3ed9e799bbfd admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:05.922433 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d1fa5-3828-453f-b44f-491605f576bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:05.923887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d1fa5-3828-453f-b44f-491605f576bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:05.923887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d1fa5-3828-453f-b44f-491605f576bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:05.923887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d1fa5-3828-453f-b44f-491605f576bc admin admin] PATH_INFO: `/v3/users/fddf2276afc042009b359b8dfeb8830c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:05.926094 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d1fa5-3828-453f-b44f-491605f576bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fddf2276afc042009b359b8dfeb8830c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:05.931198 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4d1fa5-3828-453f-b44f-491605f576bc admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:06.098077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-bc4d1fa5-3828-453f-b44f-491605f576bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fddf2276afc042009b359b8dfeb8830c'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:06.099470 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-bc4d1fa5-3828-453f-b44f-491605f576bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fddf2276afc042009b359b8dfeb8830c'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:06.130680 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-bc4d1fa5-3828-453f-b44f-491605f576bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fddf2276afc042009b359b8dfeb8830c'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:06.178346 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:06.181550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-bc4d1fa5-3828-453f-b44f-491605f576bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fddf2276afc042009b359b8dfeb8830c'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:06.183441 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-bc4d1fa5-3828-453f-b44f-491605f576bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fddf2276afc042009b359b8dfeb8830c'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:06.210489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 737/1478] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:05 2022] DELETE /identity/v3/users/fddf2276afc042009b359b8dfeb8830c => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:06.422246 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4920f-89f2-4516-96f2-68d0274b74d7 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:06.422827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4920f-89f2-4516-96f2-68d0274b74d7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:06.424793 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4920f-89f2-4516-96f2-68d0274b74d7 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:06.429264 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 742/1479] 10.222.0.36 () {54 vars in 921 bytes} [Thu Oct 20 13:36:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:36:06.664458 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6799fc-c7af-4e89-a118-67d8338c56c5 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:06.664904 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6799fc-c7af-4e89-a118-67d8338c56c5 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:06.665257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6799fc-c7af-4e89-a118-67d8338c56c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:06.708173 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-5c6799fc-c7af-4e89-a118-67d8338c56c5 None None] MFA Rules not processed for user `674c5b25932a41309428ba6c6c72ed02`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:06.710179 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-5c6799fc-c7af-4e89-a118-67d8338c56c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:06.886719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 738/1480] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Oct 20 13:36:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:06.992200 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4920f-89f2-4516-96f2-68d0274b74d7 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:06.997380 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c5a4920f-89f2-4516-96f2-68d0274b74d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:07.029530 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6799fc-c7af-4e89-a118-67d8338c56c5 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:07.031112 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-5c6799fc-c7af-4e89-a118-67d8338c56c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:07.033526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4920f-89f2-4516-96f2-68d0274b74d7 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:07.041527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d716b-dea8-4633-9019-9f0edc305b16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:07.042415 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d716b-dea8-4633-9019-9f0edc305b16 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:07.042990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d716b-dea8-4633-9019-9f0edc305b16 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:07.043949 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d716b-dea8-4633-9019-9f0edc305b16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:07.060907 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d716b-dea8-4633-9019-9f0edc305b16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:07.062872 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d716b-dea8-4633-9019-9f0edc305b16 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:07.080449 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 743/1481] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:07.262105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6799fc-c7af-4e89-a118-67d8338c56c5 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:07.279798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7acac-09e8-47f4-b23a-ad65cfc10b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:07.280477 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7acac-09e8-47f4-b23a-ad65cfc10b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:07.280808 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7acac-09e8-47f4-b23a-ad65cfc10b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:07.281132 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7acac-09e8-47f4-b23a-ad65cfc10b50 admin admin] PATH_INFO: `/v3/projects/9df92c474fd64fc9a317369338335eda` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:07.286983 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7acac-09e8-47f4-b23a-ad65cfc10b50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df92c474fd64fc9a317369338335eda)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:07.298393 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7acac-09e8-47f4-b23a-ad65cfc10b50 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:07.442461 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-eae7acac-09e8-47f4-b23a-ad65cfc10b50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df92c474fd64fc9a317369338335eda', 'request_id': 'req-eae7acac-09e8-47f4-b23a-ad65cfc10b50'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:07.472905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-eae7acac-09e8-47f4-b23a-ad65cfc10b50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df92c474fd64fc9a317369338335eda', 'request_id': 'req-eae7acac-09e8-47f4-b23a-ad65cfc10b50'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:07.493375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-eae7acac-09e8-47f4-b23a-ad65cfc10b50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df92c474fd64fc9a317369338335eda', 'request_id': 'req-eae7acac-09e8-47f4-b23a-ad65cfc10b50'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:07.537095 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-eae7acac-09e8-47f4-b23a-ad65cfc10b50 admin admin] The token cache is being invalidate because project 9df92c474fd64fc9a317369338335eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:07.537095 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-eae7acac-09e8-47f4-b23a-ad65cfc10b50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:07.538037 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-eae7acac-09e8-47f4-b23a-ad65cfc10b50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:07.540886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 739/1482] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:07 2022] DELETE /identity/v3/projects/9df92c474fd64fc9a317369338335eda => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:07.546350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d716b-dea8-4633-9019-9f0edc305b16 service nova] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:07.571167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d716b-dea8-4633-9019-9f0edc305b16 service nova] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:07.776397 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba20ec-984b-4225-9027-b0bed939dec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:07.776397 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba20ec-984b-4225-9027-b0bed939dec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:07.776634 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba20ec-984b-4225-9027-b0bed939dec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:07.776974 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba20ec-984b-4225-9027-b0bed939dec3 admin admin] PATH_INFO: `/v3/users/5fb74892a33d4391b3ef91d8e729d8ba` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:07.794617 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba20ec-984b-4225-9027-b0bed939dec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb74892a33d4391b3ef91d8e729d8ba)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:07.803299 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba20ec-984b-4225-9027-b0bed939dec3 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:07.898226 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:07.937769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-a0ba20ec-984b-4225-9027-b0bed939dec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb74892a33d4391b3ef91d8e729d8ba'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:07.937769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-a0ba20ec-984b-4225-9027-b0bed939dec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb74892a33d4391b3ef91d8e729d8ba'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:07.960175 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-a0ba20ec-984b-4225-9027-b0bed939dec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb74892a33d4391b3ef91d8e729d8ba'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:08.004446 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-a0ba20ec-984b-4225-9027-b0bed939dec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb74892a33d4391b3ef91d8e729d8ba'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:08.005103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-a0ba20ec-984b-4225-9027-b0bed939dec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb74892a33d4391b3ef91d8e729d8ba'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:08.035638 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 744/1483] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:07 2022] DELETE /identity/v3/users/5fb74892a33d4391b3ef91d8e729d8ba => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:36:08.548407 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7acac-09e8-47f4-b23a-ad65cfc10b50 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:08.550060 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-eae7acac-09e8-47f4-b23a-ad65cfc10b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:08.578099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7acac-09e8-47f4-b23a-ad65cfc10b50 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:08.600301 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:08.737445 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:08.738023 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:08.738546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:08.739030 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6 admin admin] PATH_INFO: `/v3/projects/92dcaaaa8c9143afbd5d1e6e6faa34cc` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:08.740744 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92dcaaaa8c9143afbd5d1e6e6faa34cc)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:08.743298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:08.855078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92dcaaaa8c9143afbd5d1e6e6faa34cc', 'request_id': 'req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:08.876061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92dcaaaa8c9143afbd5d1e6e6faa34cc', 'request_id': 'req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:08.892028 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92dcaaaa8c9143afbd5d1e6e6faa34cc', 'request_id': 'req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:08.925433 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6 admin admin] The token cache is being invalidate because project 92dcaaaa8c9143afbd5d1e6e6faa34cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:08.925942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:08.927437 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:08.929773 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 740/1484] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:08 2022] DELETE /identity/v3/projects/92dcaaaa8c9143afbd5d1e6e6faa34cc => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:08.934919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba20ec-984b-4225-9027-b0bed939dec3 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:08.938375 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a0ba20ec-984b-4225-9027-b0bed939dec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:08.948061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:08.950511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:08.964490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba20ec-984b-4225-9027-b0bed939dec3 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:09.102811 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae62fc-a88e-4ffe-9883-5c50a02a1369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:09.103805 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae62fc-a88e-4ffe-9883-5c50a02a1369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:09.104332 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae62fc-a88e-4ffe-9883-5c50a02a1369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:09.104760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae62fc-a88e-4ffe-9883-5c50a02a1369 admin admin] PATH_INFO: `/v3/users/ac82ce78005d4d34a5adf0fb9e09b485` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:09.106436 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae62fc-a88e-4ffe-9883-5c50a02a1369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac82ce78005d4d34a5adf0fb9e09b485)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:09.108697 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae62fc-a88e-4ffe-9883-5c50a02a1369 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:09.174137 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a2ea8-4cea-4965-be39-c5a97f67e3d6 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:09.191053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66794f6-1445-4b33-b07b-2df119c9984b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:09.192054 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66794f6-1445-4b33-b07b-2df119c9984b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:09.192345 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66794f6-1445-4b33-b07b-2df119c9984b admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:09.193800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66794f6-1445-4b33-b07b-2df119c9984b admin admin] PATH_INFO: `/v3/projects/b3d265f7be9c4de69eeae83487bb8b85` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:09.196651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66794f6-1445-4b33-b07b-2df119c9984b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3d265f7be9c4de69eeae83487bb8b85)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:09.198940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66794f6-1445-4b33-b07b-2df119c9984b admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:09.208074 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-3aae62fc-a88e-4ffe-9883-5c50a02a1369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac82ce78005d4d34a5adf0fb9e09b485'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:09.209196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-3aae62fc-a88e-4ffe-9883-5c50a02a1369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac82ce78005d4d34a5adf0fb9e09b485'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:09.247385 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-3aae62fc-a88e-4ffe-9883-5c50a02a1369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac82ce78005d4d34a5adf0fb9e09b485'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:09.293857 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-3aae62fc-a88e-4ffe-9883-5c50a02a1369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac82ce78005d4d34a5adf0fb9e09b485'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:09.296575 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-3aae62fc-a88e-4ffe-9883-5c50a02a1369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac82ce78005d4d34a5adf0fb9e09b485'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:09.365022 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 745/1485] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:08 2022] DELETE /identity/v3/users/ac82ce78005d4d34a5adf0fb9e09b485 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:36:09.388581 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:09.408077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-e66794f6-1445-4b33-b07b-2df119c9984b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3d265f7be9c4de69eeae83487bb8b85', 'request_id': 'req-e66794f6-1445-4b33-b07b-2df119c9984b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:09.423650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-e66794f6-1445-4b33-b07b-2df119c9984b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3d265f7be9c4de69eeae83487bb8b85', 'request_id': 'req-e66794f6-1445-4b33-b07b-2df119c9984b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:09.444859 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-e66794f6-1445-4b33-b07b-2df119c9984b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3d265f7be9c4de69eeae83487bb8b85', 'request_id': 'req-e66794f6-1445-4b33-b07b-2df119c9984b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:09.490754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-e66794f6-1445-4b33-b07b-2df119c9984b admin admin] The token cache is being invalidate because project b3d265f7be9c4de69eeae83487bb8b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:09.492132 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-e66794f6-1445-4b33-b07b-2df119c9984b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:09.494711 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-e66794f6-1445-4b33-b07b-2df119c9984b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:09.499553 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 741/1486] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:08 2022] DELETE /identity/v3/projects/b3d265f7be9c4de69eeae83487bb8b85 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:09.504878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865c07e-ba12-428f-8451-3a7324f3b742 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:09.505551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865c07e-ba12-428f-8451-3a7324f3b742 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:09.505986 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865c07e-ba12-428f-8451-3a7324f3b742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:09.593548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0865c07e-ba12-428f-8451-3a7324f3b742 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:09.602027 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0865c07e-ba12-428f-8451-3a7324f3b742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:09.696139 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:09.825806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 746/1487] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:09.834546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256553b9-d323-4358-980b-86602b00d09c None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:09.835300 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256553b9-d323-4358-980b-86602b00d09c None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:09.839241 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256553b9-d323-4358-980b-86602b00d09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:09.889140 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-256553b9-d323-4358-980b-86602b00d09c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:09.891242 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-256553b9-d323-4358-980b-86602b00d09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:09.910576 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 742/1488] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:09.914832 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865c07e-ba12-428f-8451-3a7324f3b742 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:09.930894 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865c07e-ba12-428f-8451-3a7324f3b742 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:09.946482 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68977ff1-b05a-41f2-82e4-e52de88a4ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:09.947280 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68977ff1-b05a-41f2-82e4-e52de88a4ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:09.949025 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68977ff1-b05a-41f2-82e4-e52de88a4ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:09.950720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68977ff1-b05a-41f2-82e4-e52de88a4ff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:09.951732 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68977ff1-b05a-41f2-82e4-e52de88a4ff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:09.953000 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68977ff1-b05a-41f2-82e4-e52de88a4ff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:09.957012 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68977ff1-b05a-41f2-82e4-e52de88a4ff4 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:09.986757 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 747/1489] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:36:09.991396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256553b9-d323-4358-980b-86602b00d09c None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:10.020623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256553b9-d323-4358-980b-86602b00d09c None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:10.034435 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b6cf0-855b-4246-873f-c6676e4f682c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:10.035237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b6cf0-855b-4246-873f-c6676e4f682c admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:10.035531 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b6cf0-855b-4246-873f-c6676e4f682c admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:10.035814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b6cf0-855b-4246-873f-c6676e4f682c admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:10.036469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b6cf0-855b-4246-873f-c6676e4f682c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:10.038401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b6cf0-855b-4246-873f-c6676e4f682c admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:10.110608 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 743/1490] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:09 2022] POST /identity/v3/projects => generated 363 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:36:10.114562 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68977ff1-b05a-41f2-82e4-e52de88a4ff4 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:10.155724 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68977ff1-b05a-41f2-82e4-e52de88a4ff4 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:10.292646 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd76a77-6880-46c8-ae5d-539e22d22204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:10.293833 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd76a77-6880-46c8-ae5d-539e22d22204 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:10.294130 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd76a77-6880-46c8-ae5d-539e22d22204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:10.294415 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd76a77-6880-46c8-ae5d-539e22d22204 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:10.299239 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd76a77-6880-46c8-ae5d-539e22d22204 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:10.301218 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd76a77-6880-46c8-ae5d-539e22d22204 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:10.353054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 748/1491] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:10 2022] POST /identity/v3/users => generated 282 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:10.357216 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b6cf0-855b-4246-873f-c6676e4f682c admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:10.385880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b6cf0-855b-4246-873f-c6676e4f682c admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:10.395517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67770cd8-c0b0-410a-b75f-3151680b9026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:10.417003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67770cd8-c0b0-410a-b75f-3151680b9026 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:10.417474 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67770cd8-c0b0-410a-b75f-3151680b9026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:10.417873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67770cd8-c0b0-410a-b75f-3151680b9026 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:10.418896 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67770cd8-c0b0-410a-b75f-3151680b9026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:10.421949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67770cd8-c0b0-410a-b75f-3151680b9026 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:10.477620 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 744/1492] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:10.483292 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd76a77-6880-46c8-ae5d-539e22d22204 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:10.498353 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd76a77-6880-46c8-ae5d-539e22d22204 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:10.505209 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673512d4-1d15-4cc4-b4df-73f0fda9c030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:10.506098 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673512d4-1d15-4cc4-b4df-73f0fda9c030 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:10.506505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673512d4-1d15-4cc4-b4df-73f0fda9c030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:10.506851 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673512d4-1d15-4cc4-b4df-73f0fda9c030 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:10.507684 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673512d4-1d15-4cc4-b4df-73f0fda9c030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:10.509640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673512d4-1d15-4cc4-b4df-73f0fda9c030 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:10.524147 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 749/1493] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:10.529006 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67770cd8-c0b0-410a-b75f-3151680b9026 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:10.547038 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67770cd8-c0b0-410a-b75f-3151680b9026 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:10.560221 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ceed9-ec6f-4e28-9584-5a5ae43af4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:10.560978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ceed9-ec6f-4e28-9584-5a5ae43af4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:10.561263 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ceed9-ec6f-4e28-9584-5a5ae43af4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:10.562577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ceed9-ec6f-4e28-9584-5a5ae43af4e3 admin admin] PATH_INFO: `/v3/projects/b7efa9526fd545059ba693db631555eb/users/54db1601bf874222922bca880befed57/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:10.594731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ceed9-ec6f-4e28-9584-5a5ae43af4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7efa9526fd545059ba693db631555eb, user_id=54db1601bf874222922bca880befed57, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:10.600752 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ceed9-ec6f-4e28-9584-5a5ae43af4e3 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:10.663305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 745/1494] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:10 2022] PUT /identity/v3/projects/b7efa9526fd545059ba693db631555eb/users/54db1601bf874222922bca880befed57/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:10.674915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bb2e2-8d60-49c9-a43a-06014ce72b77 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:10.675241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bb2e2-8d60-49c9-a43a-06014ce72b77 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:10.675527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80bb2e2-8d60-49c9-a43a-06014ce72b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:10.779348 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-f80bb2e2-8d60-49c9-a43a-06014ce72b77 None None] MFA Rules not processed for user `54db1601bf874222922bca880befed57`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:10.784250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ceed9-ec6f-4e28-9584-5a5ae43af4e3 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:10.786127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e12ceed9-ec6f-4e28-9584-5a5ae43af4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:10.789746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f80bb2e2-8d60-49c9-a43a-06014ce72b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:10.941626 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 750/1495] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:10.941837 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ceed9-ec6f-4e28-9584-5a5ae43af4e3 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:10.944583 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bb2e2-8d60-49c9-a43a-06014ce72b77 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:10.963325 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ec8b30-1040-4628-897a-b40199239852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:10.964137 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8b30-1040-4628-897a-b40199239852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:10.964422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8b30-1040-4628-897a-b40199239852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:10.964837 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ec8b30-1040-4628-897a-b40199239852 admin admin] PATH_INFO: `/v3/users/311fe8a4d0b447b7b461771c9cd2faeb` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:10.968533 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec8b30-1040-4628-897a-b40199239852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=311fe8a4d0b447b7b461771c9cd2faeb)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:10.969388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80bb2e2-8d60-49c9-a43a-06014ce72b77 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:10.970850 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ec8b30-1040-4628-897a-b40199239852 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:10.979804 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419fb78-3a5b-437b-b9de-c78513d89dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:10.982086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419fb78-3a5b-437b-b9de-c78513d89dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:10.982644 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419fb78-3a5b-437b-b9de-c78513d89dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:10.983201 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419fb78-3a5b-437b-b9de-c78513d89dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:10.984026 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419fb78-3a5b-437b-b9de-c78513d89dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:10.989092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419fb78-3a5b-437b-b9de-c78513d89dc9 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:11.034105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:11.060818 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 751/1496] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:10 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:11.064069 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419fb78-3a5b-437b-b9de-c78513d89dc9 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:11.069493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d8ec8b30-1040-4628-897a-b40199239852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '311fe8a4d0b447b7b461771c9cd2faeb'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:11.071740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d8ec8b30-1040-4628-897a-b40199239852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '311fe8a4d0b447b7b461771c9cd2faeb'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:11.107216 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d8ec8b30-1040-4628-897a-b40199239852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '311fe8a4d0b447b7b461771c9cd2faeb'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:11.137602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:11.169300 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d8ec8b30-1040-4628-897a-b40199239852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '311fe8a4d0b447b7b461771c9cd2faeb'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:11.169893 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d8ec8b30-1040-4628-897a-b40199239852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '311fe8a4d0b447b7b461771c9cd2faeb'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:11.174598 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419fb78-3a5b-437b-b9de-c78513d89dc9 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:11.181985 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b097f1a-be93-419d-a8f9-05ecdb610d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:11.183000 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b097f1a-be93-419d-a8f9-05ecdb610d95 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:11.183474 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b097f1a-be93-419d-a8f9-05ecdb610d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:11.184025 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b097f1a-be93-419d-a8f9-05ecdb610d95 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:11.185110 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b097f1a-be93-419d-a8f9-05ecdb610d95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:11.188147 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b097f1a-be93-419d-a8f9-05ecdb610d95 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:11.195461 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 746/1497] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:10 2022] DELETE /identity/v3/users/311fe8a4d0b447b7b461771c9cd2faeb => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:36:11.200263 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44afb0-f0e7-4819-a4e4-7ef835f62b13 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:11.200602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44afb0-f0e7-4819-a4e4-7ef835f62b13 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:11.206227 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44afb0-f0e7-4819-a4e4-7ef835f62b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:11.233030 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 752/1498] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:11 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:36:11.237654 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b097f1a-be93-419d-a8f9-05ecdb610d95 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:11.241854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8b097f1a-be93-419d-a8f9-05ecdb610d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:11.258651 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b097f1a-be93-419d-a8f9-05ecdb610d95 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:11.269223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-0c44afb0-f0e7-4819-a4e4-7ef835f62b13 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:11.280693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0c44afb0-f0e7-4819-a4e4-7ef835f62b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:11.410483 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48233b94-4d9e-47b2-a902-79b12665d17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:11.412149 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48233b94-4d9e-47b2-a902-79b12665d17a admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:11.412506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48233b94-4d9e-47b2-a902-79b12665d17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:11.413117 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48233b94-4d9e-47b2-a902-79b12665d17a admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:11.413786 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48233b94-4d9e-47b2-a902-79b12665d17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:11.417549 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48233b94-4d9e-47b2-a902-79b12665d17a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:11.449834 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 753/1499] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:11.456290 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd761d-8d05-4487-b598-96abc043ab52 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:11.456635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd761d-8d05-4487-b598-96abc043ab52 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:11.457064 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd761d-8d05-4487-b598-96abc043ab52 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:11.459882 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 754/1500] 10.222.0.36 () {54 vars in 921 bytes} [Thu Oct 20 13:36:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:36:11.461209 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd761d-8d05-4487-b598-96abc043ab52 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:11.508419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 747/1501] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:11.515861 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd761d-8d05-4487-b598-96abc043ab52 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:11.522541 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba5265-0642-488e-b1cc-845a1d90212f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:11.523332 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba5265-0642-488e-b1cc-845a1d90212f admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:11.523751 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba5265-0642-488e-b1cc-845a1d90212f admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:11.524036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba5265-0642-488e-b1cc-845a1d90212f admin admin] PATH_INFO: `/v3/projects/1df6a53e15534dba8f9d4e8630201fc7/users/6f347bda5c284324accbf6bd0c131338/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:11.542991 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba5265-0642-488e-b1cc-845a1d90212f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df6a53e15534dba8f9d4e8630201fc7, user_id=6f347bda5c284324accbf6bd0c131338, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:11.548437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba5265-0642-488e-b1cc-845a1d90212f admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:11.560804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44afb0-f0e7-4819-a4e4-7ef835f62b13 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:11.568208 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0c44afb0-f0e7-4819-a4e4-7ef835f62b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:11.582034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 755/1502] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:11 2022] PUT /identity/v3/projects/1df6a53e15534dba8f9d4e8630201fc7/users/6f347bda5c284324accbf6bd0c131338/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:11.589458 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba5265-0642-488e-b1cc-845a1d90212f admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:11.769935 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba5265-0642-488e-b1cc-845a1d90212f admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:11.773871 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44afb0-f0e7-4819-a4e4-7ef835f62b13 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:11.791581 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75785b86-c749-48fd-8187-526a3ec38983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:11.795943 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75785b86-c749-48fd-8187-526a3ec38983 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:11.795943 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75785b86-c749-48fd-8187-526a3ec38983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:11.795943 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75785b86-c749-48fd-8187-526a3ec38983 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:11.814145 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75785b86-c749-48fd-8187-526a3ec38983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:11.819938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75785b86-c749-48fd-8187-526a3ec38983 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:11.824804 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:11.848318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 756/1503] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:11.853131 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a606-f936-4e72-8d7b-b39cc2304245 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:11.853564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a606-f936-4e72-8d7b-b39cc2304245 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:11.853918 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7a606-f936-4e72-8d7b-b39cc2304245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:11.901518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d4c7a606-f936-4e72-8d7b-b39cc2304245 None None] MFA Rules not processed for user `674c5b25932a41309428ba6c6c72ed02`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:11.904551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d4c7a606-f936-4e72-8d7b-b39cc2304245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:11.919207 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1a1a2-2ec6-41a3-839f-e392237ce2d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:11.920397 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1a1a2-2ec6-41a3-839f-e392237ce2d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:11.920720 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1a1a2-2ec6-41a3-839f-e392237ce2d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:11.921177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1a1a2-2ec6-41a3-839f-e392237ce2d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:11.936060 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1a1a2-2ec6-41a3-839f-e392237ce2d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:11.938746 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1a1a2-2ec6-41a3-839f-e392237ce2d1 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:11.955998 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 748/1504] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:11.957629 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1a1a2-2ec6-41a3-839f-e392237ce2d1 service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:11.959584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0fa1a1a2-2ec6-41a3-839f-e392237ce2d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:11.974643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1a1a2-2ec6-41a3-839f-e392237ce2d1 service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:11.986081 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57daaa-4485-4796-924e-b41560b11073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:11.987104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57daaa-4485-4796-924e-b41560b11073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:11.988498 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57daaa-4485-4796-924e-b41560b11073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:11.988498 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57daaa-4485-4796-924e-b41560b11073 admin admin] PATH_INFO: `/v3/projects/5b96c5f4f09440789b9e8dff3bca2c7f` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:11.990562 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57daaa-4485-4796-924e-b41560b11073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b96c5f4f09440789b9e8dff3bca2c7f)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:11.995556 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57daaa-4485-4796-924e-b41560b11073 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:12.040833 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 757/1505] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Oct 20 13:36:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:12.042335 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7a606-f936-4e72-8d7b-b39cc2304245 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:12.059069 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7a606-f936-4e72-8d7b-b39cc2304245 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:12.080907 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:12.089495 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30877be-f039-4155-b5cd-2fb0b13ca88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:12.097836 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30877be-f039-4155-b5cd-2fb0b13ca88f admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:12.098586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30877be-f039-4155-b5cd-2fb0b13ca88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:12.101351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30877be-f039-4155-b5cd-2fb0b13ca88f admin admin] PATH_INFO: `/v3/projects/1df6a53e15534dba8f9d4e8630201fc7/users/6f347bda5c284324accbf6bd0c131338/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:12.107107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30877be-f039-4155-b5cd-2fb0b13ca88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1df6a53e15534dba8f9d4e8630201fc7, user_id=6f347bda5c284324accbf6bd0c131338, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:12.109742 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-ed57daaa-4485-4796-924e-b41560b11073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b96c5f4f09440789b9e8dff3bca2c7f', 'request_id': 'req-ed57daaa-4485-4796-924e-b41560b11073'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.113784 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30877be-f039-4155-b5cd-2fb0b13ca88f admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:12.118340 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-ed57daaa-4485-4796-924e-b41560b11073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b96c5f4f09440789b9e8dff3bca2c7f', 'request_id': 'req-ed57daaa-4485-4796-924e-b41560b11073'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.126919 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-ed57daaa-4485-4796-924e-b41560b11073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b96c5f4f09440789b9e8dff3bca2c7f', 'request_id': 'req-ed57daaa-4485-4796-924e-b41560b11073'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.136253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 758/1506] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:12 2022] PUT /identity/v3/projects/1df6a53e15534dba8f9d4e8630201fc7/users/6f347bda5c284324accbf6bd0c131338/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:12.137800 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30877be-f039-4155-b5cd-2fb0b13ca88f admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:12.139584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f30877be-f039-4155-b5cd-2fb0b13ca88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:12.147367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-ed57daaa-4485-4796-924e-b41560b11073 admin admin] The token cache is being invalidate because project 5b96c5f4f09440789b9e8dff3bca2c7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:12.147798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-ed57daaa-4485-4796-924e-b41560b11073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.148785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-ed57daaa-4485-4796-924e-b41560b11073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.155303 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 749/1507] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:11 2022] DELETE /identity/v3/projects/5b96c5f4f09440789b9e8dff3bca2c7f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:12.159960 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94b6e2-4ce9-412f-8d81-721631ae2f6c None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:12.160507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94b6e2-4ce9-412f-8d81-721631ae2f6c None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:12.162045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94b6e2-4ce9-412f-8d81-721631ae2f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:12.197015 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-cb94b6e2-4ce9-412f-8d81-721631ae2f6c None None] MFA Rules not processed for user `6f347bda5c284324accbf6bd0c131338`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:12.198869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-cb94b6e2-4ce9-412f-8d81-721631ae2f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:12.228115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30877be-f039-4155-b5cd-2fb0b13ca88f admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:12.236047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67487fa4-e815-4b6b-b24c-60069619f2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:12.236691 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67487fa4-e815-4b6b-b24c-60069619f2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:12.236977 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67487fa4-e815-4b6b-b24c-60069619f2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:12.237250 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67487fa4-e815-4b6b-b24c-60069619f2d4 admin admin] PATH_INFO: `/v3/users/80f35c5b020a4347bda01e4ea26c6270` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:12.238417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67487fa4-e815-4b6b-b24c-60069619f2d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80f35c5b020a4347bda01e4ea26c6270)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:12.240398 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67487fa4-e815-4b6b-b24c-60069619f2d4 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:12.345706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-67487fa4-e815-4b6b-b24c-60069619f2d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80f35c5b020a4347bda01e4ea26c6270'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.346486 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-67487fa4-e815-4b6b-b24c-60069619f2d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80f35c5b020a4347bda01e4ea26c6270'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.347915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 750/1508] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:12.349613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50ba70-06b7-46a3-981d-c211401ee914 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:12.350008 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50ba70-06b7-46a3-981d-c211401ee914 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:12.350474 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50ba70-06b7-46a3-981d-c211401ee914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:12.368265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-67487fa4-e815-4b6b-b24c-60069619f2d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80f35c5b020a4347bda01e4ea26c6270'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.378076 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-fb50ba70-06b7-46a3-981d-c211401ee914 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:12.379485 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-fb50ba70-06b7-46a3-981d-c211401ee914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:12.381791 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-67487fa4-e815-4b6b-b24c-60069619f2d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80f35c5b020a4347bda01e4ea26c6270'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.382867 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-67487fa4-e815-4b6b-b24c-60069619f2d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80f35c5b020a4347bda01e4ea26c6270'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.396135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 751/1509] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:12.396135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50ba70-06b7-46a3-981d-c211401ee914 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:12.396135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-fb50ba70-06b7-46a3-981d-c211401ee914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:12.397302 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:12.411513 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50ba70-06b7-46a3-981d-c211401ee914 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:12.417331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 759/1510] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:12 2022] DELETE /identity/v3/users/80f35c5b020a4347bda01e4ea26c6270 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:12.417331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67487fa4-e815-4b6b-b24c-60069619f2d4 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:12.417578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f94806-0756-4dd0-955c-ebb3c52a104d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:12.417705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-67487fa4-e815-4b6b-b24c-60069619f2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:12.417824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f94806-0756-4dd0-955c-ebb3c52a104d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:12.418292 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f94806-0756-4dd0-955c-ebb3c52a104d admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:12.419175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f94806-0756-4dd0-955c-ebb3c52a104d admin admin] PATH_INFO: `/v3/projects/e989bc61b1584ddf877839528004616a` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:12.420295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f94806-0756-4dd0-955c-ebb3c52a104d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e989bc61b1584ddf877839528004616a)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:12.422689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f94806-0756-4dd0-955c-ebb3c52a104d admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:12.493170 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a9f94806-0756-4dd0-955c-ebb3c52a104d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e989bc61b1584ddf877839528004616a', 'request_id': 'req-a9f94806-0756-4dd0-955c-ebb3c52a104d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.501929 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a9f94806-0756-4dd0-955c-ebb3c52a104d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e989bc61b1584ddf877839528004616a', 'request_id': 'req-a9f94806-0756-4dd0-955c-ebb3c52a104d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.510021 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a9f94806-0756-4dd0-955c-ebb3c52a104d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e989bc61b1584ddf877839528004616a', 'request_id': 'req-a9f94806-0756-4dd0-955c-ebb3c52a104d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.510292 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67487fa4-e815-4b6b-b24c-60069619f2d4 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:12.525741 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a9f94806-0756-4dd0-955c-ebb3c52a104d admin admin] The token cache is being invalidate because project e989bc61b1584ddf877839528004616a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:12.526119 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a9f94806-0756-4dd0-955c-ebb3c52a104d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.526832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a9f94806-0756-4dd0-955c-ebb3c52a104d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.528598 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 752/1511] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:12 2022] DELETE /identity/v3/projects/e989bc61b1584ddf877839528004616a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:12.529486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f94806-0756-4dd0-955c-ebb3c52a104d admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:12.530836 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a9f94806-0756-4dd0-955c-ebb3c52a104d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:12.580069 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:12.591729 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ff866-2652-4f6c-8cb8-75d9a0418b22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:12.592244 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ff866-2652-4f6c-8cb8-75d9a0418b22 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:12.592531 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ff866-2652-4f6c-8cb8-75d9a0418b22 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:12.592807 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ff866-2652-4f6c-8cb8-75d9a0418b22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:12.595014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ac4ff866-2652-4f6c-8cb8-75d9a0418b22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:12.609106 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f94806-0756-4dd0-955c-ebb3c52a104d admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:12.609302 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ff866-2652-4f6c-8cb8-75d9a0418b22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:12.610921 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ff866-2652-4f6c-8cb8-75d9a0418b22 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:12.612866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14017958-0d53-42c3-a4ae-c43a71759599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:12.613536 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14017958-0d53-42c3-a4ae-c43a71759599 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:12.613812 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14017958-0d53-42c3-a4ae-c43a71759599 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:12.614082 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14017958-0d53-42c3-a4ae-c43a71759599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:12.615871 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-14017958-0d53-42c3-a4ae-c43a71759599 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:12.622861 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 760/1512] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:12.624329 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ae56a-d543-4477-952e-2ba42bb6c088 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:12.624645 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ae56a-d543-4477-952e-2ba42bb6c088 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:12.624887 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ae56a-d543-4477-952e-2ba42bb6c088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:12.647730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-528ae56a-d543-4477-952e-2ba42bb6c088 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:12.648954 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-528ae56a-d543-4477-952e-2ba42bb6c088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:12.689326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14017958-0d53-42c3-a4ae-c43a71759599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:12.690771 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14017958-0d53-42c3-a4ae-c43a71759599 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:12.702443 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 753/1513] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:12.704155 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b9115-2697-4286-9d46-71f4fdd60dc3 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:12.704511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b9115-2697-4286-9d46-71f4fdd60dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:12.705083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b9115-2697-4286-9d46-71f4fdd60dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:12.718265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 761/1514] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:12.719622 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c504407-a960-4bc2-9b4f-3da7d2ccafa1 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:12.719913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c504407-a960-4bc2-9b4f-3da7d2ccafa1 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:12.720186 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c504407-a960-4bc2-9b4f-3da7d2ccafa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:12.729328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-866b9115-2697-4286-9d46-71f4fdd60dc3 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:12.731291 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-866b9115-2697-4286-9d46-71f4fdd60dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:12.740678 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 754/1515] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:12.741440 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b9115-2697-4286-9d46-71f4fdd60dc3 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:12.741755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-9c504407-a960-4bc2-9b4f-3da7d2ccafa1 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:12.742932 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-866b9115-2697-4286-9d46-71f4fdd60dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:12.743059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9c504407-a960-4bc2-9b4f-3da7d2ccafa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:12.755594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b9115-2697-4286-9d46-71f4fdd60dc3 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:12.760435 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc291d9-7685-4684-a953-a9742d9b6b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:12.760981 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc291d9-7685-4684-a953-a9742d9b6b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:12.761259 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc291d9-7685-4684-a953-a9742d9b6b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:12.761634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc291d9-7685-4684-a953-a9742d9b6b44 admin admin] PATH_INFO: `/v3/projects/3ce43e9fcd344f5caabc83e2ebb0e71a` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:12.763355 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc291d9-7685-4684-a953-a9742d9b6b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce43e9fcd344f5caabc83e2ebb0e71a)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:12.765262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc291d9-7685-4684-a953-a9742d9b6b44 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:12.765797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 762/1516] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:12.766582 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c504407-a960-4bc2-9b4f-3da7d2ccafa1 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:12.776074 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c504407-a960-4bc2-9b4f-3da7d2ccafa1 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:12.780700 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717aca6a-8300-4661-96dd-2bfa1e4d3aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:12.781303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aca6a-8300-4661-96dd-2bfa1e4d3aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:12.781576 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aca6a-8300-4661-96dd-2bfa1e4d3aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:12.781843 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717aca6a-8300-4661-96dd-2bfa1e4d3aa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:12.782568 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717aca6a-8300-4661-96dd-2bfa1e4d3aa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:12.782797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717aca6a-8300-4661-96dd-2bfa1e4d3aa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:12.784765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717aca6a-8300-4661-96dd-2bfa1e4d3aa5 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:12.794785 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:12.799340 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 763/1517] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:36:12.800217 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717aca6a-8300-4661-96dd-2bfa1e4d3aa5 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:12.801910 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-717aca6a-8300-4661-96dd-2bfa1e4d3aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:12.832183 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-cfc291d9-7685-4684-a953-a9742d9b6b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce43e9fcd344f5caabc83e2ebb0e71a', 'request_id': 'req-cfc291d9-7685-4684-a953-a9742d9b6b44'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.841378 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-cfc291d9-7685-4684-a953-a9742d9b6b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce43e9fcd344f5caabc83e2ebb0e71a', 'request_id': 'req-cfc291d9-7685-4684-a953-a9742d9b6b44'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.847702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-cfc291d9-7685-4684-a953-a9742d9b6b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce43e9fcd344f5caabc83e2ebb0e71a', 'request_id': 'req-cfc291d9-7685-4684-a953-a9742d9b6b44'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.862997 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-cfc291d9-7685-4684-a953-a9742d9b6b44 admin admin] The token cache is being invalidate because project 3ce43e9fcd344f5caabc83e2ebb0e71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:12.863410 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-cfc291d9-7685-4684-a953-a9742d9b6b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.864166 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-cfc291d9-7685-4684-a953-a9742d9b6b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:12.865905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 755/1518] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:12 2022] DELETE /identity/v3/projects/3ce43e9fcd344f5caabc83e2ebb0e71a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:12.867227 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801e6f-3ae2-4865-9ff6-109a5ede94b3 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:12.867583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801e6f-3ae2-4865-9ff6-109a5ede94b3 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:12.868031 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09801e6f-3ae2-4865-9ff6-109a5ede94b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:12.875017 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717aca6a-8300-4661-96dd-2bfa1e4d3aa5 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:12.895004 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-09801e6f-3ae2-4865-9ff6-109a5ede94b3 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:12.896516 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-09801e6f-3ae2-4865-9ff6-109a5ede94b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:12.950500 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed344949-ede5-4850-8696-53f5e11b5a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:12.951189 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed344949-ede5-4850-8696-53f5e11b5a76 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:12.951477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed344949-ede5-4850-8696-53f5e11b5a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:12.951754 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed344949-ede5-4850-8696-53f5e11b5a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:12.953258 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:12.954565 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ed344949-ede5-4850-8696-53f5e11b5a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:12.967707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 756/1519] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:12.969113 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09801e6f-3ae2-4865-9ff6-109a5ede94b3 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:12.970466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-09801e6f-3ae2-4865-9ff6-109a5ede94b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:12.995235 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09801e6f-3ae2-4865-9ff6-109a5ede94b3 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:12.995235 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61640091-572e-4b63-8632-d4cbdfbe42d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:12.995235 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61640091-572e-4b63-8632-d4cbdfbe42d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:12.995235 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61640091-572e-4b63-8632-d4cbdfbe42d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:12.995599 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61640091-572e-4b63-8632-d4cbdfbe42d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:12.995599 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61640091-572e-4b63-8632-d4cbdfbe42d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:12.995599 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61640091-572e-4b63-8632-d4cbdfbe42d1 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:13.020217 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 757/1520] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:12 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:13.021183 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61640091-572e-4b63-8632-d4cbdfbe42d1 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:13.024719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-61640091-572e-4b63-8632-d4cbdfbe42d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:13.033132 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed344949-ede5-4850-8696-53f5e11b5a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:13.034562 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed344949-ede5-4850-8696-53f5e11b5a76 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:13.045290 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 764/1521] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:13.046103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed344949-ede5-4850-8696-53f5e11b5a76 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:13.047422 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ed344949-ede5-4850-8696-53f5e11b5a76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:13.060329 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed344949-ede5-4850-8696-53f5e11b5a76 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:13.088623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61640091-572e-4b63-8632-d4cbdfbe42d1 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:13.094925 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20929e89-0a7b-43cb-b962-68d7dd0ba3be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:13.096194 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20929e89-0a7b-43cb-b962-68d7dd0ba3be service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:13.096765 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20929e89-0a7b-43cb-b962-68d7dd0ba3be service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:13.098136 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20929e89-0a7b-43cb-b962-68d7dd0ba3be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:13.100384 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-20929e89-0a7b-43cb-b962-68d7dd0ba3be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:13.124384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e78816-e5a3-459c-a120-3ec8b3d03d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:13.125025 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e78816-e5a3-459c-a120-3ec8b3d03d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:13.125303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e78816-e5a3-459c-a120-3ec8b3d03d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:13.125575 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e78816-e5a3-459c-a120-3ec8b3d03d4f admin admin] PATH_INFO: `/v3/users/e5f1117f1ea749d3b1240555562622c2` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:13.126760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e78816-e5a3-459c-a120-3ec8b3d03d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f1117f1ea749d3b1240555562622c2)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:13.128734 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e78816-e5a3-459c-a120-3ec8b3d03d4f admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:13.134831 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:13.179685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20929e89-0a7b-43cb-b962-68d7dd0ba3be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:13.181601 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20929e89-0a7b-43cb-b962-68d7dd0ba3be service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:13.184581 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-90e78816-e5a3-459c-a120-3ec8b3d03d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f1117f1ea749d3b1240555562622c2'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:13.185394 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-90e78816-e5a3-459c-a120-3ec8b3d03d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f1117f1ea749d3b1240555562622c2'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:13.197388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-90e78816-e5a3-459c-a120-3ec8b3d03d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f1117f1ea749d3b1240555562622c2'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:13.201136 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 758/1522] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:13.202083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20929e89-0a7b-43cb-b962-68d7dd0ba3be service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:13.213529 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20929e89-0a7b-43cb-b962-68d7dd0ba3be service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:13.214285 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-90e78816-e5a3-459c-a120-3ec8b3d03d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f1117f1ea749d3b1240555562622c2'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:13.215703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-90e78816-e5a3-459c-a120-3ec8b3d03d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f1117f1ea749d3b1240555562622c2'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:13.221559 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f7f24-455c-42f2-a171-cb7b95efdbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:13.222307 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f7f24-455c-42f2-a171-cb7b95efdbbb admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:13.222609 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f7f24-455c-42f2-a171-cb7b95efdbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:13.222986 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f7f24-455c-42f2-a171-cb7b95efdbbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:13.223680 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f7f24-455c-42f2-a171-cb7b95efdbbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:13.224060 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f7f24-455c-42f2-a171-cb7b95efdbbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:13.225783 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f7f24-455c-42f2-a171-cb7b95efdbbb admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:13.236444 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 765/1523] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:13 2022] DELETE /identity/v3/users/e5f1117f1ea749d3b1240555562622c2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:13.237276 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e78816-e5a3-459c-a120-3ec8b3d03d4f admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:13.238649 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-90e78816-e5a3-459c-a120-3ec8b3d03d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:13.246010 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 759/1524] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:36:13.251142 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f7f24-455c-42f2-a171-cb7b95efdbbb admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:13.255110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d66f7f24-455c-42f2-a171-cb7b95efdbbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:13.284644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f7f24-455c-42f2-a171-cb7b95efdbbb admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:13.436885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e78816-e5a3-459c-a120-3ec8b3d03d4f admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:13.450670 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefbab1-340e-4ca5-8a33-ab3084a5427e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:13.451468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefbab1-340e-4ca5-8a33-ab3084a5427e admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:13.451754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefbab1-340e-4ca5-8a33-ab3084a5427e admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:13.452070 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefbab1-340e-4ca5-8a33-ab3084a5427e admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:13.452865 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefbab1-340e-4ca5-8a33-ab3084a5427e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:13.453579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f0afc-696d-4589-a9e6-0c157222d5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:13.454387 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f0afc-696d-4589-a9e6-0c157222d5de admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:13.454593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f0afc-696d-4589-a9e6-0c157222d5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:13.455092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f0afc-696d-4589-a9e6-0c157222d5de admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:13.455742 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f0afc-696d-4589-a9e6-0c157222d5de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:13.459114 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f0afc-696d-4589-a9e6-0c157222d5de admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:13.460839 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefbab1-340e-4ca5-8a33-ab3084a5427e admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:13.500903 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 766/1525] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:13 2022] POST /identity/v3/users => generated 294 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:13.506869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f0afc-696d-4589-a9e6-0c157222d5de admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:13.508913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 760/1526] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:13 2022] POST /identity/v3/projects => generated 375 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:13.510110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefbab1-340e-4ca5-8a33-ab3084a5427e admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:13.515859 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:13.540835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f0afc-696d-4589-a9e6-0c157222d5de admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:13.615853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefbab1-340e-4ca5-8a33-ab3084a5427e admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:13.622540 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e6fbd-cda3-4cf6-8826-da092be431a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:13.624032 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e6fbd-cda3-4cf6-8826-da092be431a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:13.624312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e6fbd-cda3-4cf6-8826-da092be431a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:13.624587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e6fbd-cda3-4cf6-8826-da092be431a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:13.625283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e6fbd-cda3-4cf6-8826-da092be431a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:13.628039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e6fbd-cda3-4cf6-8826-da092be431a0 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:13.643169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2423ff9-93ff-49e8-961e-4799a3a7a730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:13.644747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2423ff9-93ff-49e8-961e-4799a3a7a730 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:13.645217 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2423ff9-93ff-49e8-961e-4799a3a7a730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:13.645628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2423ff9-93ff-49e8-961e-4799a3a7a730 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:13.647063 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2423ff9-93ff-49e8-961e-4799a3a7a730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:13.650802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2423ff9-93ff-49e8-961e-4799a3a7a730 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:13.672287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 761/1527] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:13 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:13.673250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e6fbd-cda3-4cf6-8826-da092be431a0 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:13.674787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 767/1528] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:13.679710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2423ff9-93ff-49e8-961e-4799a3a7a730 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:13.685720 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e6fbd-cda3-4cf6-8826-da092be431a0 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:13.697474 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d569f-c2ca-4552-88ba-485bf5ff8b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:13.698423 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d569f-c2ca-4552-88ba-485bf5ff8b25 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:13.699010 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d569f-c2ca-4552-88ba-485bf5ff8b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:13.700081 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d569f-c2ca-4552-88ba-485bf5ff8b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:13.700999 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d569f-c2ca-4552-88ba-485bf5ff8b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:13.702168 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2423ff9-93ff-49e8-961e-4799a3a7a730 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:13.705755 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d569f-c2ca-4552-88ba-485bf5ff8b25 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:13.708444 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5a406-ecf2-4e1e-87c5-8918ab1fb768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:13.709314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5a406-ecf2-4e1e-87c5-8918ab1fb768 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:13.709616 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5a406-ecf2-4e1e-87c5-8918ab1fb768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:13.710065 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5a406-ecf2-4e1e-87c5-8918ab1fb768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:13.710859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5a406-ecf2-4e1e-87c5-8918ab1fb768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:13.712848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d5a406-ecf2-4e1e-87c5-8918ab1fb768 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:13.723865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:13.726520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 762/1529] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:13.727272 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d569f-c2ca-4552-88ba-485bf5ff8b25 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:13.732255 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 768/1530] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:13.733452 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5a406-ecf2-4e1e-87c5-8918ab1fb768 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:13.736247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d96d569f-c2ca-4552-88ba-485bf5ff8b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:13.737296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a7d5a406-ecf2-4e1e-87c5-8918ab1fb768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:13.766978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5a406-ecf2-4e1e-87c5-8918ab1fb768 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:13.767163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d569f-c2ca-4552-88ba-485bf5ff8b25 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:13.767278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18012cba-ca8d-42c1-82b7-24d5200ef05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:13.767278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18012cba-ca8d-42c1-82b7-24d5200ef05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:13.767278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18012cba-ca8d-42c1-82b7-24d5200ef05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:13.767278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18012cba-ca8d-42c1-82b7-24d5200ef05f admin admin] PATH_INFO: `/v3/projects/49a8e084137948109957c171e6b58ee7` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:13.767604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18012cba-ca8d-42c1-82b7-24d5200ef05f admin admin] RBAC: Authorizing `identity:delete_project(project_id=49a8e084137948109957c171e6b58ee7)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:13.767688 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab17f9-66f7-461c-ac79-1f6de0c9e926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:13.767688 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab17f9-66f7-461c-ac79-1f6de0c9e926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:13.767688 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab17f9-66f7-461c-ac79-1f6de0c9e926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:13.767688 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab17f9-66f7-461c-ac79-1f6de0c9e926 admin admin] PATH_INFO: `/v3/projects/226c257b21904e8a920f96c983779465` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:13.767994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18012cba-ca8d-42c1-82b7-24d5200ef05f admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:13.768128 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab17f9-66f7-461c-ac79-1f6de0c9e926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=226c257b21904e8a920f96c983779465)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:13.772415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab17f9-66f7-461c-ac79-1f6de0c9e926 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:13.820994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-18012cba-ca8d-42c1-82b7-24d5200ef05f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49a8e084137948109957c171e6b58ee7', 'request_id': 'req-18012cba-ca8d-42c1-82b7-24d5200ef05f'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:13.829945 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-18012cba-ca8d-42c1-82b7-24d5200ef05f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49a8e084137948109957c171e6b58ee7', 'request_id': 'req-18012cba-ca8d-42c1-82b7-24d5200ef05f'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:13.838354 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-18012cba-ca8d-42c1-82b7-24d5200ef05f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49a8e084137948109957c171e6b58ee7', 'request_id': 'req-18012cba-ca8d-42c1-82b7-24d5200ef05f'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:13.850570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-18012cba-ca8d-42c1-82b7-24d5200ef05f admin admin] The token cache is being invalidate because project 49a8e084137948109957c171e6b58ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:13.850993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-18012cba-ca8d-42c1-82b7-24d5200ef05f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:13.851703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-18012cba-ca8d-42c1-82b7-24d5200ef05f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:13.853279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 769/1531] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:13 2022] DELETE /identity/v3/projects/49a8e084137948109957c171e6b58ee7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:13.854074 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18012cba-ca8d-42c1-82b7-24d5200ef05f admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:13.855517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-18012cba-ca8d-42c1-82b7-24d5200ef05f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:13.926891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18012cba-ca8d-42c1-82b7-24d5200ef05f admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:13.932087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b1ee7-73f1-4770-b4c8-89268237f988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:13.932705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1ee7-73f1-4770-b4c8-89268237f988 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:13.932986 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1ee7-73f1-4770-b4c8-89268237f988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:13.933263 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b1ee7-73f1-4770-b4c8-89268237f988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:13.934439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b1ee7-73f1-4770-b4c8-89268237f988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:13.936081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4b1ee7-73f1-4770-b4c8-89268237f988 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:13.946028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 770/1532] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:13.946811 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b1ee7-73f1-4770-b4c8-89268237f988 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:13.947840 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-adab17f9-66f7-461c-ac79-1f6de0c9e926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226c257b21904e8a920f96c983779465', 'request_id': 'req-adab17f9-66f7-461c-ac79-1f6de0c9e926'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:13.948469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7f4b1ee7-73f1-4770-b4c8-89268237f988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:13.954382 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-adab17f9-66f7-461c-ac79-1f6de0c9e926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226c257b21904e8a920f96c983779465', 'request_id': 'req-adab17f9-66f7-461c-ac79-1f6de0c9e926'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:13.960125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-adab17f9-66f7-461c-ac79-1f6de0c9e926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226c257b21904e8a920f96c983779465', 'request_id': 'req-adab17f9-66f7-461c-ac79-1f6de0c9e926'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:13.960922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b1ee7-73f1-4770-b4c8-89268237f988 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:13.974604 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-adab17f9-66f7-461c-ac79-1f6de0c9e926 admin admin] The token cache is being invalidate because project 226c257b21904e8a920f96c983779465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:13.975190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-adab17f9-66f7-461c-ac79-1f6de0c9e926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:13.975912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-adab17f9-66f7-461c-ac79-1f6de0c9e926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:13.977549 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 763/1533] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:13 2022] DELETE /identity/v3/projects/226c257b21904e8a920f96c983779465 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:13.978880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada0b0d-124c-4c91-a285-2c800f704f5a None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:13.979253 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada0b0d-124c-4c91-a285-2c800f704f5a None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:13.979604 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada0b0d-124c-4c91-a285-2c800f704f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:14.000461 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-aada0b0d-124c-4c91-a285-2c800f704f5a None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:14.001657 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-aada0b0d-124c-4c91-a285-2c800f704f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:14.027203 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388f802-2705-4427-9b95-b2262ee265d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:14.028800 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388f802-2705-4427-9b95-b2262ee265d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:14.029242 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388f802-2705-4427-9b95-b2262ee265d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:14.029518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388f802-2705-4427-9b95-b2262ee265d7 admin admin] PATH_INFO: `/v3/projects/a057c241489245b18cf424d25c6f55cd/users/e782742860674481a167ff8c8b16c2b3/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:14.047095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388f802-2705-4427-9b95-b2262ee265d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a057c241489245b18cf424d25c6f55cd, user_id=e782742860674481a167ff8c8b16c2b3, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:14.049742 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388f802-2705-4427-9b95-b2262ee265d7 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:14.065127 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 771/1534] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:13 2022] PUT /identity/v3/projects/a057c241489245b18cf424d25c6f55cd/users/e782742860674481a167ff8c8b16c2b3/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:14.066010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388f802-2705-4427-9b95-b2262ee265d7 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:14.068806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0388f802-2705-4427-9b95-b2262ee265d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:14.078768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:14.081929 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 764/1535] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:14.083682 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada0b0d-124c-4c91-a285-2c800f704f5a None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:14.085231 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-aada0b0d-124c-4c91-a285-2c800f704f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:14.096453 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:14.100841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada0b0d-124c-4c91-a285-2c800f704f5a None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:14.167044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388f802-2705-4427-9b95-b2262ee265d7 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:14.172863 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c3707-3bc3-4f15-8452-7669b51b62fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:14.173826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c3707-3bc3-4f15-8452-7669b51b62fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:14.174180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c3707-3bc3-4f15-8452-7669b51b62fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:14.174526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c3707-3bc3-4f15-8452-7669b51b62fd admin admin] PATH_INFO: `/v3/projects/7ed5df87eb764ca58175685f591b96fd/users/f45546306f264264b6be9102c21b018c/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:14.177366 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3521d1f-d463-49d9-a24b-bfcb5502292e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:14.178296 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3521d1f-d463-49d9-a24b-bfcb5502292e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:14.178870 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3521d1f-d463-49d9-a24b-bfcb5502292e admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:14.179354 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3521d1f-d463-49d9-a24b-bfcb5502292e admin admin] PATH_INFO: `/v3/users/1e4835798da648eea00cf349c339f1cc` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:14.180764 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3521d1f-d463-49d9-a24b-bfcb5502292e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4835798da648eea00cf349c339f1cc)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:14.184139 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3521d1f-d463-49d9-a24b-bfcb5502292e admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:14.195577 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c3707-3bc3-4f15-8452-7669b51b62fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed5df87eb764ca58175685f591b96fd, user_id=f45546306f264264b6be9102c21b018c, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:14.198561 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c3707-3bc3-4f15-8452-7669b51b62fd admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:14.219084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 772/1536] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:14 2022] PUT /identity/v3/projects/7ed5df87eb764ca58175685f591b96fd/users/f45546306f264264b6be9102c21b018c/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:14.220569 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8cc42-3169-4524-a68a-3a6c3b2ce09d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:14.220903 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8cc42-3169-4524-a68a-3a6c3b2ce09d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:14.221344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8cc42-3169-4524-a68a-3a6c3b2ce09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:14.267933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b3521d1f-d463-49d9-a24b-bfcb5502292e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4835798da648eea00cf349c339f1cc'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:14.269216 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b3521d1f-d463-49d9-a24b-bfcb5502292e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4835798da648eea00cf349c339f1cc'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:14.277317 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-74f8cc42-3169-4524-a68a-3a6c3b2ce09d None None] MFA Rules not processed for user `e782742860674481a167ff8c8b16c2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:14.278515 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b3521d1f-d463-49d9-a24b-bfcb5502292e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4835798da648eea00cf349c339f1cc'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:14.278738 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-74f8cc42-3169-4524-a68a-3a6c3b2ce09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:14.306595 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b3521d1f-d463-49d9-a24b-bfcb5502292e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4835798da648eea00cf349c339f1cc'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:14.307468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b3521d1f-d463-49d9-a24b-bfcb5502292e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4835798da648eea00cf349c339f1cc'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:14.329357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 765/1537] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:14 2022] DELETE /identity/v3/users/1e4835798da648eea00cf349c339f1cc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:14.331065 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cdfa8-5871-4c1b-ac45-8d866de0a698 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:14.331460 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cdfa8-5871-4c1b-ac45-8d866de0a698 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:14.332514 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2cdfa8-5871-4c1b-ac45-8d866de0a698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:14.362524 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-8c2cdfa8-5871-4c1b-ac45-8d866de0a698 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:14.364318 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8c2cdfa8-5871-4c1b-ac45-8d866de0a698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:14.370696 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 773/1538] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:14.372683 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c168fb-90bd-4a29-9353-4856ae86958a None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:14.373136 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c168fb-90bd-4a29-9353-4856ae86958a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:14.373331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c168fb-90bd-4a29-9353-4856ae86958a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:14.413423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-43c168fb-90bd-4a29-9353-4856ae86958a None None] MFA Rules not processed for user `f45546306f264264b6be9102c21b018c`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:14.415347 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-43c168fb-90bd-4a29-9353-4856ae86958a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:14.463349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 766/1539] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:14.468792 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cdfa8-5871-4c1b-ac45-8d866de0a698 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:14.470741 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8c2cdfa8-5871-4c1b-ac45-8d866de0a698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:14.487678 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2cdfa8-5871-4c1b-ac45-8d866de0a698 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:14.496681 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939bc59-76f7-46fc-bb73-86a1484fc3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:14.498781 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939bc59-76f7-46fc-bb73-86a1484fc3c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:14.499422 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939bc59-76f7-46fc-bb73-86a1484fc3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:14.499800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939bc59-76f7-46fc-bb73-86a1484fc3c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:14.501977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939bc59-76f7-46fc-bb73-86a1484fc3c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:14.504773 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939bc59-76f7-46fc-bb73-86a1484fc3c3 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:14.541626 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 774/1540] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:14.542677 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c168fb-90bd-4a29-9353-4856ae86958a None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:14.554221 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:14.561737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 767/1541] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:14 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:14.561737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939bc59-76f7-46fc-bb73-86a1484fc3c3 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:14.562862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0939bc59-76f7-46fc-bb73-86a1484fc3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:14.566378 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c168fb-90bd-4a29-9353-4856ae86958a None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:14.569151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:14.695577 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e14e0-fec9-4956-b763-30b1178d7274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:14.696669 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e14e0-fec9-4956-b763-30b1178d7274 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:14.697469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e14e0-fec9-4956-b763-30b1178d7274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:14.698044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e14e0-fec9-4956-b763-30b1178d7274 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:14.701832 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e14e0-fec9-4956-b763-30b1178d7274 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:14.702498 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e14e0-fec9-4956-b763-30b1178d7274 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:14.707449 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e14e0-fec9-4956-b763-30b1178d7274 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:14.711917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939bc59-76f7-46fc-bb73-86a1484fc3c3 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:14.718487 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddeaee-edcc-466a-8a40-b86d93f519fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:14.720350 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddeaee-edcc-466a-8a40-b86d93f519fa admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:14.720904 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddeaee-edcc-466a-8a40-b86d93f519fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:14.721131 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ddeaee-edcc-466a-8a40-b86d93f519fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:14.722066 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ddeaee-edcc-466a-8a40-b86d93f519fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:14.725251 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ddeaee-edcc-466a-8a40-b86d93f519fa admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:14.729785 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 775/1542] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:36:14.731091 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e14e0-fec9-4956-b763-30b1178d7274 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:14.743002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e14e0-fec9-4956-b763-30b1178d7274 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:14.749164 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d08816-f8fe-4d74-bcca-d2ecff3dcf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:14.750368 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d08816-f8fe-4d74-bcca-d2ecff3dcf85 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:14.750798 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d08816-f8fe-4d74-bcca-d2ecff3dcf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:14.751277 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d08816-f8fe-4d74-bcca-d2ecff3dcf85 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:14.752219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d08816-f8fe-4d74-bcca-d2ecff3dcf85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:14.754634 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d08816-f8fe-4d74-bcca-d2ecff3dcf85 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:14.827731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 768/1544] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:14 2022] POST /identity/v3/projects => generated 371 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:14.828775 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 776/1544] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:14 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:14.828985 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddeaee-edcc-466a-8a40-b86d93f519fa admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:14.829579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d08816-f8fe-4d74-bcca-d2ecff3dcf85 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:14.865338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d08816-f8fe-4d74-bcca-d2ecff3dcf85 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:14.974361 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861f9c8-e27d-4797-ad31-1682a51ba62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:14.979186 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861f9c8-e27d-4797-ad31-1682a51ba62b admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:14.979841 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861f9c8-e27d-4797-ad31-1682a51ba62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:14.980438 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861f9c8-e27d-4797-ad31-1682a51ba62b admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:14.981472 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861f9c8-e27d-4797-ad31-1682a51ba62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:14.985169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6861f9c8-e27d-4797-ad31-1682a51ba62b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:15.017952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 777/1545] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:14 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:15.018723 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861f9c8-e27d-4797-ad31-1682a51ba62b admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:15.022981 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ddeaee-edcc-466a-8a40-b86d93f519fa admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:15.028809 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc21fb-9cbf-4bc6-988f-5cf170f836fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:15.029691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc21fb-9cbf-4bc6-988f-5cf170f836fd admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.030175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc21fb-9cbf-4bc6-988f-5cf170f836fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.030616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc21fb-9cbf-4bc6-988f-5cf170f836fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.031598 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc21fb-9cbf-4bc6-988f-5cf170f836fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:15.033679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc21fb-9cbf-4bc6-988f-5cf170f836fd admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:15.042571 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861f9c8-e27d-4797-ad31-1682a51ba62b admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:15.049065 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c33b2c-af79-4129-879b-cc09b169ae1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:15.050573 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c33b2c-af79-4129-879b-cc09b169ae1b admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.051034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c33b2c-af79-4129-879b-cc09b169ae1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.051468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c33b2c-af79-4129-879b-cc09b169ae1b admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.052245 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c33b2c-af79-4129-879b-cc09b169ae1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:15.054999 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c33b2c-af79-4129-879b-cc09b169ae1b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:15.084873 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 778/1546] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:15 2022] POST /identity/v3/users => generated 292 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:15.086058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 769/1547] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:14 2022] POST /identity/v3/projects => generated 373 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:15.086429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c33b2c-af79-4129-879b-cc09b169ae1b admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:15.087238 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc21fb-9cbf-4bc6-988f-5cf170f836fd admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:15.088380 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-07c33b2c-af79-4129-879b-cc09b169ae1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:15.111756 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c33b2c-af79-4129-879b-cc09b169ae1b admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:15.203098 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc21fb-9cbf-4bc6-988f-5cf170f836fd admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:15.217226 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:15.217876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.218154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.218429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d admin admin] PATH_INFO: `/v3/projects/2f6174fe981b40908382f53bc247d95a` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.219600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6174fe981b40908382f53bc247d95a)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:15.221518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:15.225911 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:15.228583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae06faf-d74b-45c7-ad14-5c6936f3f5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:15.229514 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae06faf-d74b-45c7-ad14-5c6936f3f5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.231192 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae06faf-d74b-45c7-ad14-5c6936f3f5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.232004 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae06faf-d74b-45c7-ad14-5c6936f3f5bf admin admin] PATH_INFO: `/v3/projects/b7e51e94aa004bd6822abc48917c83b7/users/c387f9ff0ff14577b53cd285a8df489b/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.266102 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae06faf-d74b-45c7-ad14-5c6936f3f5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e51e94aa004bd6822abc48917c83b7, user_id=c387f9ff0ff14577b53cd285a8df489b, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:15.272677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae06faf-d74b-45c7-ad14-5c6936f3f5bf admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:15.281272 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:15.309017 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6174fe981b40908382f53bc247d95a', 'request_id': 'req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:15.310004 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 770/1548] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:15 2022] PUT /identity/v3/projects/b7e51e94aa004bd6822abc48917c83b7/users/c387f9ff0ff14577b53cd285a8df489b/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:15.311445 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae06faf-d74b-45c7-ad14-5c6936f3f5bf admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:15.320122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6174fe981b40908382f53bc247d95a', 'request_id': 'req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:15.343349 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6174fe981b40908382f53bc247d95a', 'request_id': 'req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:15.376373 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d admin admin] The token cache is being invalidate because project 2f6174fe981b40908382f53bc247d95a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:15.376759 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:15.377755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:15.385123 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 779/1549] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:15 2022] DELETE /identity/v3/projects/2f6174fe981b40908382f53bc247d95a => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:15.387499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:15.389250 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:15.423629 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae06faf-d74b-45c7-ad14-5c6936f3f5bf admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:15.430006 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92a766-89d6-43ed-8fb9-78b2a169508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:15.430821 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92a766-89d6-43ed-8fb9-78b2a169508f admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.431438 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92a766-89d6-43ed-8fb9-78b2a169508f admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.432173 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92a766-89d6-43ed-8fb9-78b2a169508f admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.432524 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92a766-89d6-43ed-8fb9-78b2a169508f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:15.435580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92a766-89d6-43ed-8fb9-78b2a169508f admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:15.485454 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 771/1550] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:15 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:15.486611 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92a766-89d6-43ed-8fb9-78b2a169508f admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:15.488776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-ef92a766-89d6-43ed-8fb9-78b2a169508f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:15.493545 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a8313-05f6-40b3-9ae0-2eeab1ef5d0d admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:15.503415 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529be85-bbe2-4c9f-9f7e-7ea8f5ad186f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:15.503613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92a766-89d6-43ed-8fb9-78b2a169508f admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:15.504440 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529be85-bbe2-4c9f-9f7e-7ea8f5ad186f admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.504841 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529be85-bbe2-4c9f-9f7e-7ea8f5ad186f admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.505195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529be85-bbe2-4c9f-9f7e-7ea8f5ad186f admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.505974 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529be85-bbe2-4c9f-9f7e-7ea8f5ad186f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:15.508146 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529be85-bbe2-4c9f-9f7e-7ea8f5ad186f admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:15.508723 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e7e45-9f3c-4c69-94e7-70d87cf5b1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:15.509511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e7e45-9f3c-4c69-94e7-70d87cf5b1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.509795 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e7e45-9f3c-4c69-94e7-70d87cf5b1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.510057 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e7e45-9f3c-4c69-94e7-70d87cf5b1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.511073 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e7e45-9f3c-4c69-94e7-70d87cf5b1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:15.513259 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e7e45-9f3c-4c69-94e7-70d87cf5b1b7 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:15.519897 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 780/1551] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:15.521841 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7c0bb-19a7-41ca-92a6-93d8ad7851b3 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.522204 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7c0bb-19a7-41ca-92a6-93d8ad7851b3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.522556 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7c0bb-19a7-41ca-92a6-93d8ad7851b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.525016 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 772/1552] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:15.525971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e7e45-9f3c-4c69-94e7-70d87cf5b1b7 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:15.530209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-df4e7e45-9f3c-4c69-94e7-70d87cf5b1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:15.543593 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e7e45-9f3c-4c69-94e7-70d87cf5b1b7 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:15.547488 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-50e7c0bb-19a7-41ca-92a6-93d8ad7851b3 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:15.548251 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae728c-f722-4993-8432-3702b783a77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:15.548718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-50e7c0bb-19a7-41ca-92a6-93d8ad7851b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:15.548981 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae728c-f722-4993-8432-3702b783a77d admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.549325 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae728c-f722-4993-8432-3702b783a77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.549682 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae728c-f722-4993-8432-3702b783a77d admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.550450 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae728c-f722-4993-8432-3702b783a77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:15.552073 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae728c-f722-4993-8432-3702b783a77d admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:15.557674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 781/1553] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:15.558458 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7c0bb-19a7-41ca-92a6-93d8ad7851b3 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:15.566371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 773/1554] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:15.567987 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae728c-f722-4993-8432-3702b783a77d admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:15.569575 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7c0bb-19a7-41ca-92a6-93d8ad7851b3 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:15.576444 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c9639-6d0f-4cce-b2f5-dde1aeaa73b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:15.577141 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c9639-6d0f-4cce-b2f5-dde1aeaa73b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.577423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c9639-6d0f-4cce-b2f5-dde1aeaa73b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.577850 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c9639-6d0f-4cce-b2f5-dde1aeaa73b3 admin admin] PATH_INFO: `/v3/projects/3993d1f454364245b47cb6d7d44d08b3/users/6214f82b52e74d239c306134b9dbf68c/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.580512 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae728c-f722-4993-8432-3702b783a77d admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:15.599660 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82edaf-f2b2-434c-ae85-ce3734b6d138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:15.600609 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82edaf-f2b2-434c-ae85-ce3734b6d138 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.600944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82edaf-f2b2-434c-ae85-ce3734b6d138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.601298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82edaf-f2b2-434c-ae85-ce3734b6d138 admin admin] PATH_INFO: `/v3/projects/b7e51e94aa004bd6822abc48917c83b7/users/c387f9ff0ff14577b53cd285a8df489b/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.606209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82edaf-f2b2-434c-ae85-ce3734b6d138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e51e94aa004bd6822abc48917c83b7, user_id=c387f9ff0ff14577b53cd285a8df489b, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:15.612336 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82edaf-f2b2-434c-ae85-ce3734b6d138 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:15.615857 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c9639-6d0f-4cce-b2f5-dde1aeaa73b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3993d1f454364245b47cb6d7d44d08b3, user_id=6214f82b52e74d239c306134b9dbf68c, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:15.619724 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c9639-6d0f-4cce-b2f5-dde1aeaa73b3 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:15.626295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 774/1555] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:15 2022] PUT /identity/v3/projects/b7e51e94aa004bd6822abc48917c83b7/users/c387f9ff0ff14577b53cd285a8df489b/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:15.627718 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdacef7-a7d0-41d6-928d-5bc27233628a None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.627997 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdacef7-a7d0-41d6-928d-5bc27233628a None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.628266 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdacef7-a7d0-41d6-928d-5bc27233628a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.644442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 782/1556] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:15 2022] PUT /identity/v3/projects/3993d1f454364245b47cb6d7d44d08b3/users/6214f82b52e74d239c306134b9dbf68c/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:15.645341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c9639-6d0f-4cce-b2f5-dde1aeaa73b3 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:15.650518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-fbdacef7-a7d0-41d6-928d-5bc27233628a None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:15.651947 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-fbdacef7-a7d0-41d6-928d-5bc27233628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:15.707202 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:15.711994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c9639-6d0f-4cce-b2f5-dde1aeaa73b3 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:15.716491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 775/1557] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:15.717924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410257c-ecac-4180-8a06-68363cda47d8 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.718204 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410257c-ecac-4180-8a06-68363cda47d8 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.718478 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410257c-ecac-4180-8a06-68363cda47d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.723766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7788c39-3834-42df-9eb7-cae83ccaec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:15.724456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7788c39-3834-42df-9eb7-cae83ccaec93 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.724987 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7788c39-3834-42df-9eb7-cae83ccaec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.725489 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7788c39-3834-42df-9eb7-cae83ccaec93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.726497 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7788c39-3834-42df-9eb7-cae83ccaec93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:15.728193 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7788c39-3834-42df-9eb7-cae83ccaec93 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:15.739258 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 783/1558] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:15.740399 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7788c39-3834-42df-9eb7-cae83ccaec93 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:15.748050 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-b410257c-ecac-4180-8a06-68363cda47d8 None None] MFA Rules not processed for user `c387f9ff0ff14577b53cd285a8df489b`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:15.749272 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b410257c-ecac-4180-8a06-68363cda47d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:15.752317 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7788c39-3834-42df-9eb7-cae83ccaec93 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:15.757828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78202b18-51d3-45d1-a38b-105213e6a7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:15.758402 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78202b18-51d3-45d1-a38b-105213e6a7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.758679 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78202b18-51d3-45d1-a38b-105213e6a7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.758971 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78202b18-51d3-45d1-a38b-105213e6a7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.759609 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78202b18-51d3-45d1-a38b-105213e6a7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:15.761183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78202b18-51d3-45d1-a38b-105213e6a7b4 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:15.771071 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 784/1559] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:15.771859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78202b18-51d3-45d1-a38b-105213e6a7b4 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:15.784471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78202b18-51d3-45d1-a38b-105213e6a7b4 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:15.788328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:15.789044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99332f0-0663-475c-8e63-36dc1d649d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:15.789739 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99332f0-0663-475c-8e63-36dc1d649d91 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.790007 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99332f0-0663-475c-8e63-36dc1d649d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.790362 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99332f0-0663-475c-8e63-36dc1d649d91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.791068 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99332f0-0663-475c-8e63-36dc1d649d91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:15.791377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99332f0-0663-475c-8e63-36dc1d649d91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:15.793480 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99332f0-0663-475c-8e63-36dc1d649d91 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:15.807580 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 785/1560] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:36:15.807580 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99332f0-0663-475c-8e63-36dc1d649d91 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:15.819639 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99332f0-0663-475c-8e63-36dc1d649d91 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:15.824040 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 776/1561] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:15.825332 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390fd43-112e-4f98-b326-8bd37650567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:15.825995 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390fd43-112e-4f98-b326-8bd37650567c admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.826280 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390fd43-112e-4f98-b326-8bd37650567c admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.826830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390fd43-112e-4f98-b326-8bd37650567c admin admin] PATH_INFO: `/v3/projects/44eca7f754164f42b4114057eb091727/users/956fb85fa00641efb810664a8a4c23e3/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.829210 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410257c-ecac-4180-8a06-68363cda47d8 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:15.840849 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410257c-ecac-4180-8a06-68363cda47d8 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:15.844052 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390fd43-112e-4f98-b326-8bd37650567c admin admin] RBAC: Authorizing `identity:create_grant(project_id=44eca7f754164f42b4114057eb091727, user_id=956fb85fa00641efb810664a8a4c23e3, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:15.846275 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e489e-ddcc-404b-9675-3e2baf90285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:15.847025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e489e-ddcc-404b-9675-3e2baf90285e admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.847358 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390fd43-112e-4f98-b326-8bd37650567c admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:15.847474 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e489e-ddcc-404b-9675-3e2baf90285e admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.847737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e489e-ddcc-404b-9675-3e2baf90285e admin admin] PATH_INFO: `/v3/projects/3993d1f454364245b47cb6d7d44d08b3/users/6214f82b52e74d239c306134b9dbf68c/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:15.849860 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e489e-ddcc-404b-9675-3e2baf90285e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3993d1f454364245b47cb6d7d44d08b3, user_id=6214f82b52e74d239c306134b9dbf68c, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:15.853580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e489e-ddcc-404b-9675-3e2baf90285e admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:15.863033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 786/1562] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:15 2022] PUT /identity/v3/projects/44eca7f754164f42b4114057eb091727/users/956fb85fa00641efb810664a8a4c23e3/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:15.863682 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390fd43-112e-4f98-b326-8bd37650567c admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:15.870335 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 777/1563] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:15 2022] PUT /identity/v3/projects/3993d1f454364245b47cb6d7d44d08b3/users/6214f82b52e74d239c306134b9dbf68c/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:15.870335 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e489e-ddcc-404b-9675-3e2baf90285e admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:15.876095 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-096e489e-ddcc-404b-9675-3e2baf90285e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:15.947903 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390fd43-112e-4f98-b326-8bd37650567c admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:15.957029 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e489e-ddcc-404b-9675-3e2baf90285e admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:15.962784 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee745b7-7217-4d59-a072-c224999f8fb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:15.964197 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee745b7-7217-4d59-a072-c224999f8fb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:15.964559 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee745b7-7217-4d59-a072-c224999f8fb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:15.965075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee745b7-7217-4d59-a072-c224999f8fb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:16.007759 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6e047-3d3b-46e9-9252-8c6e249b4e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:16.008550 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6e047-3d3b-46e9-9252-8c6e249b4e9c admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:16.008903 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6e047-3d3b-46e9-9252-8c6e249b4e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:16.009245 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6e047-3d3b-46e9-9252-8c6e249b4e9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:16.009957 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6e047-3d3b-46e9-9252-8c6e249b4e9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:16.012488 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6e047-3d3b-46e9-9252-8c6e249b4e9c admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:16.036232 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee745b7-7217-4d59-a072-c224999f8fb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:16.037687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee745b7-7217-4d59-a072-c224999f8fb3 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:16.039398 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 787/1564] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:15 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:16.040648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6703729-4695-4837-b285-cf06531a306c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:16.040934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6703729-4695-4837-b285-cf06531a306c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:16.041206 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6703729-4695-4837-b285-cf06531a306c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:16.048226 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 778/1565] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:16.049520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411fa3-ec20-4106-b09f-376188e20215 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:16.049818 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411fa3-ec20-4106-b09f-376188e20215 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:16.050097 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f411fa3-ec20-4106-b09f-376188e20215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:16.060924 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-e6703729-4695-4837-b285-cf06531a306c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:16.062234 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e6703729-4695-4837-b285-cf06531a306c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:16.081218 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-4f411fa3-ec20-4106-b09f-376188e20215 None None] MFA Rules not processed for user `6214f82b52e74d239c306134b9dbf68c`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:16.082442 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-4f411fa3-ec20-4106-b09f-376188e20215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:16.098382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:16.133346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 788/1566] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:16.133346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6703729-4695-4837-b285-cf06531a306c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:16.141289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6703729-4695-4837-b285-cf06531a306c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:16.145829 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab001f95-8755-4c53-8b2e-34d0013a7bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:16.146427 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab001f95-8755-4c53-8b2e-34d0013a7bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:16.146705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab001f95-8755-4c53-8b2e-34d0013a7bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:16.147004 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab001f95-8755-4c53-8b2e-34d0013a7bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:16.147665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab001f95-8755-4c53-8b2e-34d0013a7bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:16.149604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab001f95-8755-4c53-8b2e-34d0013a7bd2 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:16.152907 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:16.159433 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 779/1567] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:16.160525 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411fa3-ec20-4106-b09f-376188e20215 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:16.171481 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f411fa3-ec20-4106-b09f-376188e20215 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:16.176157 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 789/1568] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:16 2022] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:16.176368 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25322bf6-cbdb-44e6-a770-ec2db76a9687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:16.176980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab001f95-8755-4c53-8b2e-34d0013a7bd2 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:16.177086 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25322bf6-cbdb-44e6-a770-ec2db76a9687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:16.177322 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25322bf6-cbdb-44e6-a770-ec2db76a9687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:16.177546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25322bf6-cbdb-44e6-a770-ec2db76a9687 admin admin] PATH_INFO: `/v3/users/e782742860674481a167ff8c8b16c2b3` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:16.179021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ab001f95-8755-4c53-8b2e-34d0013a7bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:16.180115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25322bf6-cbdb-44e6-a770-ec2db76a9687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e782742860674481a167ff8c8b16c2b3)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:16.182041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25322bf6-cbdb-44e6-a770-ec2db76a9687 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:16.242364 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab001f95-8755-4c53-8b2e-34d0013a7bd2 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:16.247517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-25322bf6-cbdb-44e6-a770-ec2db76a9687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e782742860674481a167ff8c8b16c2b3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:16.248065 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27068fa1-5505-48e2-8073-faab86feac44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:16.248638 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-25322bf6-cbdb-44e6-a770-ec2db76a9687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e782742860674481a167ff8c8b16c2b3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:16.248896 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27068fa1-5505-48e2-8073-faab86feac44 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:16.249281 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27068fa1-5505-48e2-8073-faab86feac44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:16.249658 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27068fa1-5505-48e2-8073-faab86feac44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:16.263400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-25322bf6-cbdb-44e6-a770-ec2db76a9687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e782742860674481a167ff8c8b16c2b3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:16.265224 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27068fa1-5505-48e2-8073-faab86feac44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:16.266779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27068fa1-5505-48e2-8073-faab86feac44 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:16.287302 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 790/1569] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:16.288388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27068fa1-5505-48e2-8073-faab86feac44 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:16.289075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-25322bf6-cbdb-44e6-a770-ec2db76a9687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e782742860674481a167ff8c8b16c2b3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:16.289822 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-25322bf6-cbdb-44e6-a770-ec2db76a9687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e782742860674481a167ff8c8b16c2b3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:16.293773 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-27068fa1-5505-48e2-8073-faab86feac44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:16.305364 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 780/1570] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:16 2022] DELETE /identity/v3/users/e782742860674481a167ff8c8b16c2b3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:16.306341 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25322bf6-cbdb-44e6-a770-ec2db76a9687 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:16.309072 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-25322bf6-cbdb-44e6-a770-ec2db76a9687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:16.407470 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25322bf6-cbdb-44e6-a770-ec2db76a9687 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:16.413989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b29e0-92c5-458d-874a-107f30de261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:16.414783 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b29e0-92c5-458d-874a-107f30de261a admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:16.414918 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b29e0-92c5-458d-874a-107f30de261a admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:16.415219 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b29e0-92c5-458d-874a-107f30de261a admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:16.415912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b29e0-92c5-458d-874a-107f30de261a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:16.419011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b29e0-92c5-458d-874a-107f30de261a admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:16.435536 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27068fa1-5505-48e2-8073-faab86feac44 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:16.436942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 781/1571] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:16.438301 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0439e5-76b9-4a0d-bea0-6422b54f6461 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:16.438686 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0439e5-76b9-4a0d-bea0-6422b54f6461 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:16.438856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0439e5-76b9-4a0d-bea0-6422b54f6461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:16.464323 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-0c0439e5-76b9-4a0d-bea0-6422b54f6461 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:16.466106 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0c0439e5-76b9-4a0d-bea0-6422b54f6461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:16.475871 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 782/1572] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:16.476676 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0439e5-76b9-4a0d-bea0-6422b54f6461 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:16.487404 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0439e5-76b9-4a0d-bea0-6422b54f6461 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:16.497964 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24044588-159e-4a5e-8f9f-3069bb5d0de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:16.498707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24044588-159e-4a5e-8f9f-3069bb5d0de4 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:16.499101 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24044588-159e-4a5e-8f9f-3069bb5d0de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:16.499402 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24044588-159e-4a5e-8f9f-3069bb5d0de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:16.500085 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24044588-159e-4a5e-8f9f-3069bb5d0de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:16.501721 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24044588-159e-4a5e-8f9f-3069bb5d0de4 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:16.520763 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 783/1573] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:16.522332 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24044588-159e-4a5e-8f9f-3069bb5d0de4 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:16.525399 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-24044588-159e-4a5e-8f9f-3069bb5d0de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:16.557385 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5be8f-801a-4db8-96b1-0aaa94e7d210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:16.558234 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5be8f-801a-4db8-96b1-0aaa94e7d210 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:16.558736 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5be8f-801a-4db8-96b1-0aaa94e7d210 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:16.559194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5be8f-801a-4db8-96b1-0aaa94e7d210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:16.561373 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-cac5be8f-801a-4db8-96b1-0aaa94e7d210 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:16.611423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:16.632973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:16.641594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24044588-159e-4a5e-8f9f-3069bb5d0de4 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:16.648709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbae1c7-d1bb-4176-aeed-28ca09a4fab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:16.651001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbae1c7-d1bb-4176-aeed-28ca09a4fab7 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:16.651926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbae1c7-d1bb-4176-aeed-28ca09a4fab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:16.653619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbae1c7-d1bb-4176-aeed-28ca09a4fab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:16.657333 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5be8f-801a-4db8-96b1-0aaa94e7d210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:16.658819 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5be8f-801a-4db8-96b1-0aaa94e7d210 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:16.672846 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbae1c7-d1bb-4176-aeed-28ca09a4fab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:16.674367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbae1c7-d1bb-4176-aeed-28ca09a4fab7 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:16.679663 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 791/1574] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:16.681084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5be8f-801a-4db8-96b1-0aaa94e7d210 service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:16.700698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5be8f-801a-4db8-96b1-0aaa94e7d210 service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:16.702541 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 784/1575] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:16.704323 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbae1c7-d1bb-4176-aeed-28ca09a4fab7 service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:16.707703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f2390-08d2-498f-8449-baa1d203b6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:16.708835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f2390-08d2-498f-8449-baa1d203b6e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:16.709269 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f2390-08d2-498f-8449-baa1d203b6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:16.710063 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f2390-08d2-498f-8449-baa1d203b6e6 admin admin] PATH_INFO: `/v3/projects/23db7f69423641b29656dd860515604d/users/3cf164cd2ec349458aefffe139e426a2/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:16.711317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-bdbae1c7-d1bb-4176-aeed-28ca09a4fab7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:16.732077 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f2390-08d2-498f-8449-baa1d203b6e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23db7f69423641b29656dd860515604d, user_id=3cf164cd2ec349458aefffe139e426a2, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:16.735441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020f2390-08d2-498f-8449-baa1d203b6e6 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:16.740103 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbae1c7-d1bb-4176-aeed-28ca09a4fab7 service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:16.757036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b91281a-2802-46de-a863-10c6322f92c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:16.758933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91281a-2802-46de-a863-10c6322f92c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:16.761194 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91281a-2802-46de-a863-10c6322f92c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:16.762984 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b91281a-2802-46de-a863-10c6322f92c0 admin admin] PATH_INFO: `/v3/users/54db1601bf874222922bca880befed57` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:16.767068 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 792/1576] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:16 2022] PUT /identity/v3/projects/23db7f69423641b29656dd860515604d/users/3cf164cd2ec349458aefffe139e426a2/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:16.767438 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91281a-2802-46de-a863-10c6322f92c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54db1601bf874222922bca880befed57)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:16.770578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b91281a-2802-46de-a863-10c6322f92c0 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:16.779269 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2da75-e34f-4c90-8b83-4193ec29af64 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:16.779676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2da75-e34f-4c90-8b83-4193ec29af64 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:16.780060 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2da75-e34f-4c90-8b83-4193ec29af64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:16.818555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-10c2da75-e34f-4c90-8b83-4193ec29af64 None None] MFA Rules not processed for user `3cf164cd2ec349458aefffe139e426a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:16.820848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-10c2da75-e34f-4c90-8b83-4193ec29af64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:16.914613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7b91281a-2802-46de-a863-10c6322f92c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54db1601bf874222922bca880befed57'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:16.915618 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7b91281a-2802-46de-a863-10c6322f92c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54db1601bf874222922bca880befed57'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:16.927395 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7b91281a-2802-46de-a863-10c6322f92c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54db1601bf874222922bca880befed57'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:16.944359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7b91281a-2802-46de-a863-10c6322f92c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54db1601bf874222922bca880befed57'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:16.945378 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7b91281a-2802-46de-a863-10c6322f92c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54db1601bf874222922bca880befed57'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:16.971391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 785/1577] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:16 2022] DELETE /identity/v3/users/54db1601bf874222922bca880befed57 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:16.976916 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e15f8-6c84-4d4f-9739-969e1bea9976 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:16.977469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e15f8-6c84-4d4f-9739-969e1bea9976 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:16.977885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e15f8-6c84-4d4f-9739-969e1bea9976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:16.979649 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 793/1578] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:16.983906 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2da75-e34f-4c90-8b83-4193ec29af64 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:16.985262 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-10c2da75-e34f-4c90-8b83-4193ec29af64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:17.026735 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-9a8e15f8-6c84-4d4f-9739-969e1bea9976 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:17.030759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9a8e15f8-6c84-4d4f-9739-969e1bea9976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:17.090888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2da75-e34f-4c90-8b83-4193ec29af64 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:17.157144 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:17.184477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6218339-a8fc-4d72-af47-46f65df72231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:17.184477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6218339-a8fc-4d72-af47-46f65df72231 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:17.184898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6218339-a8fc-4d72-af47-46f65df72231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:17.185842 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6218339-a8fc-4d72-af47-46f65df72231 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:17.187107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6218339-a8fc-4d72-af47-46f65df72231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:17.191533 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6218339-a8fc-4d72-af47-46f65df72231 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:17.241182 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 786/1579] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:36:17.261404 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e15f8-6c84-4d4f-9739-969e1bea9976 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:17.264001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9a8e15f8-6c84-4d4f-9739-969e1bea9976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:17.275564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 794/1580] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:16 2022] POST /identity/v3/projects => generated 379 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:36:17.278906 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6218339-a8fc-4d72-af47-46f65df72231 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:17.403692 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e15f8-6c84-4d4f-9739-969e1bea9976 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:17.447388 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:17.510632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6218339-a8fc-4d72-af47-46f65df72231 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:17.525853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3774e58-3a11-4b36-95f4-56441dd5a1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:17.526682 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3774e58-3a11-4b36-95f4-56441dd5a1b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:17.527102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3774e58-3a11-4b36-95f4-56441dd5a1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:17.528042 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3774e58-3a11-4b36-95f4-56441dd5a1b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:17.529014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3774e58-3a11-4b36-95f4-56441dd5a1b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:17.531636 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3774e58-3a11-4b36-95f4-56441dd5a1b2 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:17.540273 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794a1e6-628c-4123-9899-b09eeb366a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:17.541013 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794a1e6-628c-4123-9899-b09eeb366a4f service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:17.541504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794a1e6-628c-4123-9899-b09eeb366a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:17.541783 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794a1e6-628c-4123-9899-b09eeb366a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:17.561948 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794a1e6-628c-4123-9899-b09eeb366a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:17.564399 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d794a1e6-628c-4123-9899-b09eeb366a4f service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:17.582728 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 795/1581] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:17 2022] POST /identity/v3/users => generated 296 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:17.586344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3774e58-3a11-4b36-95f4-56441dd5a1b2 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:17.592548 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 787/1582] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:36:17.601801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3774e58-3a11-4b36-95f4-56441dd5a1b2 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:17.608494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796123a0-116a-4161-bcd1-1e0330169d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:17.609658 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796123a0-116a-4161-bcd1-1e0330169d68 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:17.611687 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796123a0-116a-4161-bcd1-1e0330169d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:17.612109 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796123a0-116a-4161-bcd1-1e0330169d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:17.613769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796123a0-116a-4161-bcd1-1e0330169d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:17.616339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796123a0-116a-4161-bcd1-1e0330169d68 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:17.632582 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 796/1583] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:36:17.637775 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794a1e6-628c-4123-9899-b09eeb366a4f service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:17.654987 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794a1e6-628c-4123-9899-b09eeb366a4f service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:17.669507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89064f-0a1b-462e-980e-4bde6ea39bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:17.670192 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89064f-0a1b-462e-980e-4bde6ea39bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:17.670645 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89064f-0a1b-462e-980e-4bde6ea39bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:17.670930 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89064f-0a1b-462e-980e-4bde6ea39bd7 admin admin] PATH_INFO: `/v3/projects/bb1eff1b69c34e3a9be466f6359fa8ec/users/83db80b02bf64c9aaffd659c54628b66/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:17.710208 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89064f-0a1b-462e-980e-4bde6ea39bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1eff1b69c34e3a9be466f6359fa8ec, user_id=83db80b02bf64c9aaffd659c54628b66, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:17.718092 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89064f-0a1b-462e-980e-4bde6ea39bd7 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:17.745371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 788/1584] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:17 2022] PUT /identity/v3/projects/bb1eff1b69c34e3a9be466f6359fa8ec/users/83db80b02bf64c9aaffd659c54628b66/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:17.748952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796123a0-116a-4161-bcd1-1e0330169d68 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:17.760809 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796123a0-116a-4161-bcd1-1e0330169d68 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:17.817448 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a17f4-0232-4560-978b-f070e3d60845 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:17.817832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a17f4-0232-4560-978b-f070e3d60845 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:17.818195 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a17f4-0232-4560-978b-f070e3d60845 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:17.820002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 789/1585] 10.222.0.36 () {54 vars in 921 bytes} [Thu Oct 20 13:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 20 13:36:17.854622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30a809-5b05-4eb3-a9df-ea2cf2cd2231 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:17.855014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30a809-5b05-4eb3-a9df-ea2cf2cd2231 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:17.855353 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30a809-5b05-4eb3-a9df-ea2cf2cd2231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:17.875564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518d6f6-522d-43db-bb00-ede61e3d01f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:17.876760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518d6f6-522d-43db-bb00-ede61e3d01f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:17.877184 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518d6f6-522d-43db-bb00-ede61e3d01f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:17.877595 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518d6f6-522d-43db-bb00-ede61e3d01f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:17.878864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518d6f6-522d-43db-bb00-ede61e3d01f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:17.881136 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1518d6f6-522d-43db-bb00-ede61e3d01f3 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:17.903119 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-7e30a809-5b05-4eb3-a9df-ea2cf2cd2231 None None] MFA Rules not processed for user `674c5b25932a41309428ba6c6c72ed02`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:17.904872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7e30a809-5b05-4eb3-a9df-ea2cf2cd2231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:17.918927 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 797/1586] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:17.919585 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518d6f6-522d-43db-bb00-ede61e3d01f3 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:17.924195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1518d6f6-522d-43db-bb00-ede61e3d01f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:17.957264 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518d6f6-522d-43db-bb00-ede61e3d01f3 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:17.972763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:17.973455 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:17.975704 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:17.976041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb admin admin] PATH_INFO: `/v3/projects/a057c241489245b18cf424d25c6f55cd` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:17.980974 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a057c241489245b18cf424d25c6f55cd)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:17.988689 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:17.989243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 790/1587] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Oct 20 13:36:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:36:17.990159 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30a809-5b05-4eb3-a9df-ea2cf2cd2231 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:18.003048 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30a809-5b05-4eb3-a9df-ea2cf2cd2231 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:18.009582 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b758c-8f7d-4371-9b4d-5457a91f6cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:18.010266 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b758c-8f7d-4371-9b4d-5457a91f6cae admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:18.010600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b758c-8f7d-4371-9b4d-5457a91f6cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:18.010943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b758c-8f7d-4371-9b4d-5457a91f6cae admin admin] PATH_INFO: `/v3/projects/bb1eff1b69c34e3a9be466f6359fa8ec/users/83db80b02bf64c9aaffd659c54628b66/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:18.013123 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b758c-8f7d-4371-9b4d-5457a91f6cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb1eff1b69c34e3a9be466f6359fa8ec, user_id=83db80b02bf64c9aaffd659c54628b66, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:18.016486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b758c-8f7d-4371-9b4d-5457a91f6cae admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:18.031686 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 791/1588] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:17 2022] PUT /identity/v3/projects/bb1eff1b69c34e3a9be466f6359fa8ec/users/83db80b02bf64c9aaffd659c54628b66/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:18.042713 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648deae-7545-4546-b581-6ee457ea738c None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:18.043598 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648deae-7545-4546-b581-6ee457ea738c None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:18.043960 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4648deae-7545-4546-b581-6ee457ea738c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:18.095045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-4648deae-7545-4546-b581-6ee457ea738c None None] MFA Rules not processed for user `83db80b02bf64c9aaffd659c54628b66`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:18.102404 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:18.103300 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-4648deae-7545-4546-b581-6ee457ea738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:18.132399 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a057c241489245b18cf424d25c6f55cd', 'request_id': 'req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:18.148003 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a057c241489245b18cf424d25c6f55cd', 'request_id': 'req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:18.161282 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a057c241489245b18cf424d25c6f55cd', 'request_id': 'req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:18.186844 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb admin admin] The token cache is being invalidate because project a057c241489245b18cf424d25c6f55cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:18.188115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:18.189540 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:18.194474 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 798/1589] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:17 2022] DELETE /identity/v3/projects/a057c241489245b18cf424d25c6f55cd => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:18.195524 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:18.197142 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:18.231675 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 792/1590] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:18.237469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648deae-7545-4546-b581-6ee457ea738c None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:18.239323 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-4648deae-7545-4546-b581-6ee457ea738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:18.244908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:18.318175 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3974f4-d4c9-4e8e-83ad-f0f248f76dbb admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:18.327628 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4648deae-7545-4546-b581-6ee457ea738c None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:18.328557 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebdfa3-8d21-42d2-b81a-0e0e18a2a0a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:18.329397 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebdfa3-8d21-42d2-b81a-0e0e18a2a0a6 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:18.329692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebdfa3-8d21-42d2-b81a-0e0e18a2a0a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:18.330350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebdfa3-8d21-42d2-b81a-0e0e18a2a0a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:18.333505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9cebdfa3-8d21-42d2-b81a-0e0e18a2a0a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:18.335858 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac98f1b8-5ca4-425a-8b32-900c90217c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:18.336875 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98f1b8-5ca4-425a-8b32-900c90217c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:18.337377 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98f1b8-5ca4-425a-8b32-900c90217c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:18.337854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac98f1b8-5ca4-425a-8b32-900c90217c24 admin admin] PATH_INFO: `/v3/users/c387f9ff0ff14577b53cd285a8df489b` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:18.339603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98f1b8-5ca4-425a-8b32-900c90217c24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c387f9ff0ff14577b53cd285a8df489b)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:18.342282 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac98f1b8-5ca4-425a-8b32-900c90217c24 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:18.350872 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebdfa3-8d21-42d2-b81a-0e0e18a2a0a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:18.354524 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebdfa3-8d21-42d2-b81a-0e0e18a2a0a6 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:18.374624 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 799/1591] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:18.375525 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebdfa3-8d21-42d2-b81a-0e0e18a2a0a6 service nova] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:18.376993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9cebdfa3-8d21-42d2-b81a-0e0e18a2a0a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:18.422588 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-ac98f1b8-5ca4-425a-8b32-900c90217c24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c387f9ff0ff14577b53cd285a8df489b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:18.423332 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-ac98f1b8-5ca4-425a-8b32-900c90217c24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c387f9ff0ff14577b53cd285a8df489b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:18.435320 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-ac98f1b8-5ca4-425a-8b32-900c90217c24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c387f9ff0ff14577b53cd285a8df489b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:18.453845 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-ac98f1b8-5ca4-425a-8b32-900c90217c24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c387f9ff0ff14577b53cd285a8df489b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:18.454935 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-ac98f1b8-5ca4-425a-8b32-900c90217c24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c387f9ff0ff14577b53cd285a8df489b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:18.507584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebdfa3-8d21-42d2-b81a-0e0e18a2a0a6 service nova] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:18.511247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 793/1592] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:18 2022] DELETE /identity/v3/users/c387f9ff0ff14577b53cd285a8df489b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:18.539892 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4bce-ac29-4b09-adea-8a6ed041f0b5 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:18.540186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4bce-ac29-4b09-adea-8a6ed041f0b5 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:18.540473 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f4bce-ac29-4b09-adea-8a6ed041f0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:18.615538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71788b-3617-44e6-a415-bca92ff97e09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:18.616283 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71788b-3617-44e6-a415-bca92ff97e09 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:18.616637 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71788b-3617-44e6-a415-bca92ff97e09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:18.616922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71788b-3617-44e6-a415-bca92ff97e09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:18.621520 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-cc71788b-3617-44e6-a415-bca92ff97e09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:18.642792 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-919f4bce-ac29-4b09-adea-8a6ed041f0b5 None None] MFA Rules not processed for user `956fb85fa00641efb810664a8a4c23e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:18.646031 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-919f4bce-ac29-4b09-adea-8a6ed041f0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:18.702294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:18.762644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 794/1593] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:36:18.763603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f4bce-ac29-4b09-adea-8a6ed041f0b5 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:18.765125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-919f4bce-ac29-4b09-adea-8a6ed041f0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:18.784856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:18.815771 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71788b-3617-44e6-a415-bca92ff97e09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:18.817346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71788b-3617-44e6-a415-bca92ff97e09 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:18.836329 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 800/1594] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:18.837474 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71788b-3617-44e6-a415-bca92ff97e09 service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:18.839508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-cc71788b-3617-44e6-a415-bca92ff97e09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:18.889007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f4bce-ac29-4b09-adea-8a6ed041f0b5 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:18.894301 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:18.895162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:18.895446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:18.895724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8 admin admin] PATH_INFO: `/v3/projects/b7efa9526fd545059ba693db631555eb` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:18.904239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7efa9526fd545059ba693db631555eb)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:18.908320 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:19.008899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7efa9526fd545059ba693db631555eb', 'request_id': 'req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:19.009249 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71788b-3617-44e6-a415-bca92ff97e09 service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:19.029085 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7efa9526fd545059ba693db631555eb', 'request_id': 'req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:19.037304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7efa9526fd545059ba693db631555eb', 'request_id': 'req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:19.057919 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8 admin admin] The token cache is being invalidate because project b7efa9526fd545059ba693db631555eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:19.058586 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:19.059378 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:19.062459 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 795/1595] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:18 2022] DELETE /identity/v3/projects/b7efa9526fd545059ba693db631555eb => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:19.063415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:19.064890 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:19.139395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b16175-a264-4b07-8290-cc36402f5728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:19.140324 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b16175-a264-4b07-8290-cc36402f5728 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:19.141110 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b16175-a264-4b07-8290-cc36402f5728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:19.141228 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b16175-a264-4b07-8290-cc36402f5728 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:19.141802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b16175-a264-4b07-8290-cc36402f5728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:19.146001 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b16175-a264-4b07-8290-cc36402f5728 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:19.221011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 801/1596] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:18 2022] POST /identity/v3/projects => generated 371 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:19.222240 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b16175-a264-4b07-8290-cc36402f5728 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:19.224388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-32b16175-a264-4b07-8290-cc36402f5728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:19.238241 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5825f4-f6d4-4c38-9c9f-8a9af354fbd8 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:19.295980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:19.323905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b16175-a264-4b07-8290-cc36402f5728 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:19.335589 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02513d79-704f-4718-aa70-7a748cfc7b60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:19.337525 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02513d79-704f-4718-aa70-7a748cfc7b60 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:19.338053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02513d79-704f-4718-aa70-7a748cfc7b60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:19.338584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02513d79-704f-4718-aa70-7a748cfc7b60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:19.343329 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-02513d79-704f-4718-aa70-7a748cfc7b60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:19.349020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e47c63-5dd7-4dc4-8279-75f55733dac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:19.350374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e47c63-5dd7-4dc4-8279-75f55733dac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:19.350374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e47c63-5dd7-4dc4-8279-75f55733dac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:19.350645 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e47c63-5dd7-4dc4-8279-75f55733dac3 admin admin] PATH_INFO: `/v3/users/6f347bda5c284324accbf6bd0c131338` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:19.352883 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e47c63-5dd7-4dc4-8279-75f55733dac3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f347bda5c284324accbf6bd0c131338)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:19.356866 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e47c63-5dd7-4dc4-8279-75f55733dac3 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:19.361659 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:19.430069 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02513d79-704f-4718-aa70-7a748cfc7b60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:19.431879 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02513d79-704f-4718-aa70-7a748cfc7b60 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:19.454303 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 796/1597] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:19.455213 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-61e47c63-5dd7-4dc4-8279-75f55733dac3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f347bda5c284324accbf6bd0c131338'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:19.455670 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02513d79-704f-4718-aa70-7a748cfc7b60 service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:19.456046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-61e47c63-5dd7-4dc4-8279-75f55733dac3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f347bda5c284324accbf6bd0c131338'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:19.460748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-02513d79-704f-4718-aa70-7a748cfc7b60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:19.467571 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-61e47c63-5dd7-4dc4-8279-75f55733dac3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f347bda5c284324accbf6bd0c131338'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:19.492096 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02513d79-704f-4718-aa70-7a748cfc7b60 service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:19.499119 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-61e47c63-5dd7-4dc4-8279-75f55733dac3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f347bda5c284324accbf6bd0c131338'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:19.500301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-61e47c63-5dd7-4dc4-8279-75f55733dac3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f347bda5c284324accbf6bd0c131338'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:19.503246 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dd083-8a24-4d5a-8fcd-dd759e9d36f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:19.506248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dd083-8a24-4d5a-8fcd-dd759e9d36f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:19.506766 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dd083-8a24-4d5a-8fcd-dd759e9d36f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:19.507377 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dd083-8a24-4d5a-8fcd-dd759e9d36f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:19.509642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dd083-8a24-4d5a-8fcd-dd759e9d36f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:19.514658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dd083-8a24-4d5a-8fcd-dd759e9d36f8 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:19.522248 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 802/1598] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:19 2022] DELETE /identity/v3/users/6f347bda5c284324accbf6bd0c131338 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:19.523231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e47c63-5dd7-4dc4-8279-75f55733dac3 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:19.537889 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-61e47c63-5dd7-4dc4-8279-75f55733dac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:19.561565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 797/1599] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:19 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:19.567561 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dd083-8a24-4d5a-8fcd-dd759e9d36f8 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:19.571509 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9c6dd083-8a24-4d5a-8fcd-dd759e9d36f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:19.597860 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dd083-8a24-4d5a-8fcd-dd759e9d36f8 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:19.755043 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e47c63-5dd7-4dc4-8279-75f55733dac3 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:19.765908 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9142a-926d-4bad-a21b-f6b049b9fe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:19.767771 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46ac3b-de0b-4b78-8697-79dc909802ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:19.768156 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9142a-926d-4bad-a21b-f6b049b9fe56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:19.768495 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9142a-926d-4bad-a21b-f6b049b9fe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:19.768608 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46ac3b-de0b-4b78-8697-79dc909802ef admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:19.768774 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9142a-926d-4bad-a21b-f6b049b9fe56 admin admin] PATH_INFO: `/v3/projects/b7e51e94aa004bd6822abc48917c83b7` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:19.768883 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46ac3b-de0b-4b78-8697-79dc909802ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:19.769151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46ac3b-de0b-4b78-8697-79dc909802ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:19.770405 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46ac3b-de0b-4b78-8697-79dc909802ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:19.771354 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9142a-926d-4bad-a21b-f6b049b9fe56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7e51e94aa004bd6822abc48917c83b7)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:19.773437 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46ac3b-de0b-4b78-8697-79dc909802ef admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:19.778013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9142a-926d-4bad-a21b-f6b049b9fe56 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:19.788739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 798/1600] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:19.794153 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46ac3b-de0b-4b78-8697-79dc909802ef admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:19.816767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46ac3b-de0b-4b78-8697-79dc909802ef admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:19.827104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359f4a4-e8b5-41fa-a308-539f518200da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:19.827919 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359f4a4-e8b5-41fa-a308-539f518200da admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:19.828207 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359f4a4-e8b5-41fa-a308-539f518200da admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:19.828522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359f4a4-e8b5-41fa-a308-539f518200da admin admin] PATH_INFO: `/v3/projects/59b59c1e837746d6be1081be98e64740/users/3914c091fe7d44d2bc4ec16195ffb099/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:19.864540 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359f4a4-e8b5-41fa-a308-539f518200da admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b59c1e837746d6be1081be98e64740, user_id=3914c091fe7d44d2bc4ec16195ffb099, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:19.868049 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359f4a4-e8b5-41fa-a308-539f518200da admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:19.872812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b6c9142a-926d-4bad-a21b-f6b049b9fe56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7e51e94aa004bd6822abc48917c83b7', 'request_id': 'req-b6c9142a-926d-4bad-a21b-f6b049b9fe56'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:19.894850 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 799/1601] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:19 2022] PUT /identity/v3/projects/59b59c1e837746d6be1081be98e64740/users/3914c091fe7d44d2bc4ec16195ffb099/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:19.895817 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b6c9142a-926d-4bad-a21b-f6b049b9fe56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7e51e94aa004bd6822abc48917c83b7', 'request_id': 'req-b6c9142a-926d-4bad-a21b-f6b049b9fe56'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:19.899184 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359f4a4-e8b5-41fa-a308-539f518200da admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:19.904874 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b6c9142a-926d-4bad-a21b-f6b049b9fe56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7e51e94aa004bd6822abc48917c83b7', 'request_id': 'req-b6c9142a-926d-4bad-a21b-f6b049b9fe56'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:19.919032 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:19.925384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b6c9142a-926d-4bad-a21b-f6b049b9fe56 admin admin] The token cache is being invalidate because project b7e51e94aa004bd6822abc48917c83b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:19.928984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b6c9142a-926d-4bad-a21b-f6b049b9fe56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:19.930003 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b6c9142a-926d-4bad-a21b-f6b049b9fe56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:19.931779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 803/1602] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:19 2022] DELETE /identity/v3/projects/b7e51e94aa004bd6822abc48917c83b7 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:19.936748 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4183c3-a3df-482e-87f4-d1acb6567750 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:19.937062 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4183c3-a3df-482e-87f4-d1acb6567750 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:19.937315 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4183c3-a3df-482e-87f4-d1acb6567750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:19.958718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-4a4183c3-a3df-482e-87f4-d1acb6567750 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:19.960052 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-4a4183c3-a3df-482e-87f4-d1acb6567750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:19.977675 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359f4a4-e8b5-41fa-a308-539f518200da admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:19.982674 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1ea07-ef1e-428b-9e5d-f7d2c144ecc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:19.983321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1ea07-ef1e-428b-9e5d-f7d2c144ecc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:19.983602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1ea07-ef1e-428b-9e5d-f7d2c144ecc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:19.983874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1ea07-ef1e-428b-9e5d-f7d2c144ecc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:19.984512 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1ea07-ef1e-428b-9e5d-f7d2c144ecc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:19.986164 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1ea07-ef1e-428b-9e5d-f7d2c144ecc8 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:20.002642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 800/1603] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:36:20.003713 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1ea07-ef1e-428b-9e5d-f7d2c144ecc8 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:20.006150 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-18e1ea07-ef1e-428b-9e5d-f7d2c144ecc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:20.016828 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:20.023856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1ea07-ef1e-428b-9e5d-f7d2c144ecc8 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:20.030871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 804/1604] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:20.031748 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4183c3-a3df-482e-87f4-d1acb6567750 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:20.033301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-4a4183c3-a3df-482e-87f4-d1acb6567750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:20.037602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816dc7e-a05c-434c-a997-cb2dc86a66b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:20.038352 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816dc7e-a05c-434c-a997-cb2dc86a66b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:20.038703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816dc7e-a05c-434c-a997-cb2dc86a66b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:20.039087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816dc7e-a05c-434c-a997-cb2dc86a66b7 admin admin] PATH_INFO: `/v3/users/f45546306f264264b6be9102c21b018c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:20.040367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816dc7e-a05c-434c-a997-cb2dc86a66b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f45546306f264264b6be9102c21b018c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:20.042406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d816dc7e-a05c-434c-a997-cb2dc86a66b7 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:20.045247 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4183c3-a3df-482e-87f4-d1acb6567750 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:20.052299 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597b3ef-7c3b-47e2-98ff-9f61cf49a547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:20.052981 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597b3ef-7c3b-47e2-98ff-9f61cf49a547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:20.053496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597b3ef-7c3b-47e2-98ff-9f61cf49a547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:20.053611 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597b3ef-7c3b-47e2-98ff-9f61cf49a547 admin admin] PATH_INFO: `/v3/projects/59b59c1e837746d6be1081be98e64740/users/3914c091fe7d44d2bc4ec16195ffb099/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:20.055841 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597b3ef-7c3b-47e2-98ff-9f61cf49a547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59b59c1e837746d6be1081be98e64740, user_id=3914c091fe7d44d2bc4ec16195ffb099, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:20.059539 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597b3ef-7c3b-47e2-98ff-9f61cf49a547 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:20.073934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 805/1605] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:20 2022] PUT /identity/v3/projects/59b59c1e837746d6be1081be98e64740/users/3914c091fe7d44d2bc4ec16195ffb099/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:20.079499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf466d-2f99-4a9f-8b72-c360917bc920 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:20.079778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf466d-2f99-4a9f-8b72-c360917bc920 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:20.080092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf466d-2f99-4a9f-8b72-c360917bc920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:20.106606 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-99bf466d-2f99-4a9f-8b72-c360917bc920 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:20.108093 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-99bf466d-2f99-4a9f-8b72-c360917bc920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:20.115929 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d816dc7e-a05c-434c-a997-cb2dc86a66b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f45546306f264264b6be9102c21b018c'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:20.116785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d816dc7e-a05c-434c-a997-cb2dc86a66b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f45546306f264264b6be9102c21b018c'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:20.130007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d816dc7e-a05c-434c-a997-cb2dc86a66b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f45546306f264264b6be9102c21b018c'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:20.146865 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d816dc7e-a05c-434c-a997-cb2dc86a66b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f45546306f264264b6be9102c21b018c'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:20.147785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d816dc7e-a05c-434c-a997-cb2dc86a66b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f45546306f264264b6be9102c21b018c'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:20.167208 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 801/1606] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:20 2022] DELETE /identity/v3/users/f45546306f264264b6be9102c21b018c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:20.168542 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816dc7e-a05c-434c-a997-cb2dc86a66b7 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:20.170506 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d816dc7e-a05c-434c-a997-cb2dc86a66b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:20.181938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 806/1607] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:20.183395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505686c8-5cd0-446b-99b3-9214c6b6c07e None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:20.184312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505686c8-5cd0-446b-99b3-9214c6b6c07e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:20.184706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505686c8-5cd0-446b-99b3-9214c6b6c07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:20.211850 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-505686c8-5cd0-446b-99b3-9214c6b6c07e None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:20.213837 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-505686c8-5cd0-446b-99b3-9214c6b6c07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:20.271863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816dc7e-a05c-434c-a997-cb2dc86a66b7 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:20.278027 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c946d-ab53-4b1c-b152-65c707acd604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:20.278674 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c946d-ab53-4b1c-b152-65c707acd604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:20.279179 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c946d-ab53-4b1c-b152-65c707acd604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:20.279290 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c946d-ab53-4b1c-b152-65c707acd604 admin admin] PATH_INFO: `/v3/projects/1df6a53e15534dba8f9d4e8630201fc7` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:20.280387 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c946d-ab53-4b1c-b152-65c707acd604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1df6a53e15534dba8f9d4e8630201fc7)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:20.282294 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c946d-ab53-4b1c-b152-65c707acd604 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:20.289688 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 807/1608] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:20.290718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505686c8-5cd0-446b-99b3-9214c6b6c07e None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:20.305217 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505686c8-5cd0-446b-99b3-9214c6b6c07e None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:20.320255 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdb544-62dc-4f13-8028-fbf9d3ae31ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:20.321124 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdb544-62dc-4f13-8028-fbf9d3ae31ec admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:20.321560 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdb544-62dc-4f13-8028-fbf9d3ae31ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:20.321982 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdb544-62dc-4f13-8028-fbf9d3ae31ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:20.323037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdb544-62dc-4f13-8028-fbf9d3ae31ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:20.323494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdb544-62dc-4f13-8028-fbf9d3ae31ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:20.326061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdb544-62dc-4f13-8028-fbf9d3ae31ec admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:20.342257 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 808/1609] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:36:20.342257 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdb544-62dc-4f13-8028-fbf9d3ae31ec admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:20.342257 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-79bdb544-62dc-4f13-8028-fbf9d3ae31ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:20.353622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7c3c946d-ab53-4b1c-b152-65c707acd604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1df6a53e15534dba8f9d4e8630201fc7', 'request_id': 'req-7c3c946d-ab53-4b1c-b152-65c707acd604'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:20.362182 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7c3c946d-ab53-4b1c-b152-65c707acd604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1df6a53e15534dba8f9d4e8630201fc7', 'request_id': 'req-7c3c946d-ab53-4b1c-b152-65c707acd604'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:20.366553 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:20.372988 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7c3c946d-ab53-4b1c-b152-65c707acd604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1df6a53e15534dba8f9d4e8630201fc7', 'request_id': 'req-7c3c946d-ab53-4b1c-b152-65c707acd604'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:20.387824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7c3c946d-ab53-4b1c-b152-65c707acd604 admin admin] The token cache is being invalidate because project 1df6a53e15534dba8f9d4e8630201fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:20.388361 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7c3c946d-ab53-4b1c-b152-65c707acd604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:20.389179 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7c3c946d-ab53-4b1c-b152-65c707acd604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:20.390848 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 802/1610] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:20 2022] DELETE /identity/v3/projects/1df6a53e15534dba8f9d4e8630201fc7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:20.391776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c946d-ab53-4b1c-b152-65c707acd604 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:20.393311 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7c3c946d-ab53-4b1c-b152-65c707acd604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:20.400788 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:20.448919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdb544-62dc-4f13-8028-fbf9d3ae31ec admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:20.514617 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c946d-ab53-4b1c-b152-65c707acd604 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:20.521813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580858f-5500-4244-a777-ab6cfd492167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:20.522465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580858f-5500-4244-a777-ab6cfd492167 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:20.523062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580858f-5500-4244-a777-ab6cfd492167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:20.523750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580858f-5500-4244-a777-ab6cfd492167 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:20.523982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580858f-5500-4244-a777-ab6cfd492167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:20.526793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580858f-5500-4244-a777-ab6cfd492167 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:20.528956 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797245f5-0fa1-4636-b09a-185989c71770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:20.529853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797245f5-0fa1-4636-b09a-185989c71770 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:20.530694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797245f5-0fa1-4636-b09a-185989c71770 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:20.531612 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797245f5-0fa1-4636-b09a-185989c71770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:20.541224 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-797245f5-0fa1-4636-b09a-185989c71770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:20.558232 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797245f5-0fa1-4636-b09a-185989c71770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:20.560602 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797245f5-0fa1-4636-b09a-185989c71770 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:20.573316 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 809/1611] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:20.574876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f390d0-e917-4d85-af97-eca83796b48b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:20.575279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f390d0-e917-4d85-af97-eca83796b48b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:20.575610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f390d0-e917-4d85-af97-eca83796b48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:20.582524 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 803/1612] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:20 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:20.586783 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580858f-5500-4244-a777-ab6cfd492167 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:20.603576 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-b4f390d0-e917-4d85-af97-eca83796b48b None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:20.607904 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b4f390d0-e917-4d85-af97-eca83796b48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:20.705319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580858f-5500-4244-a777-ab6cfd492167 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:20.710887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd8439-6830-42be-806d-43e4e096cd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:20.711654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd8439-6830-42be-806d-43e4e096cd26 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:20.712010 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd8439-6830-42be-806d-43e4e096cd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:20.712380 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd8439-6830-42be-806d-43e4e096cd26 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:20.713157 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd8439-6830-42be-806d-43e4e096cd26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:20.715756 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd8439-6830-42be-806d-43e4e096cd26 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:20.720578 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 810/1613] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:20.728672 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e48b9-459e-42a8-9062-6b1510bfe442 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:20.729109 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e48b9-459e-42a8-9062-6b1510bfe442 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:20.729546 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e48b9-459e-42a8-9062-6b1510bfe442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:20.749781 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 804/1614] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:20 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:20.754287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd8439-6830-42be-806d-43e4e096cd26 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:20.775016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-887e48b9-459e-42a8-9062-6b1510bfe442 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:20.775016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-887e48b9-459e-42a8-9062-6b1510bfe442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:20.779237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd8439-6830-42be-806d-43e4e096cd26 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:20.788505 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82f5b3-bf8e-4dd3-8fd1-00d4d01ceff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:20.789135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82f5b3-bf8e-4dd3-8fd1-00d4d01ceff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:20.789418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82f5b3-bf8e-4dd3-8fd1-00d4d01ceff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:20.789695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82f5b3-bf8e-4dd3-8fd1-00d4d01ceff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:20.790348 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82f5b3-bf8e-4dd3-8fd1-00d4d01ceff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:20.792077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82f5b3-bf8e-4dd3-8fd1-00d4d01ceff4 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:20.800787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 811/1615] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:20.803997 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e48b9-459e-42a8-9062-6b1510bfe442 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:20.822175 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e48b9-459e-42a8-9062-6b1510bfe442 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:20.826886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 805/1616] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:20.829499 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82f5b3-bf8e-4dd3-8fd1-00d4d01ceff4 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:20.838742 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed486087-482b-42c4-9fe2-69a2b44693d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:20.840817 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed486087-482b-42c4-9fe2-69a2b44693d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:20.841221 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed486087-482b-42c4-9fe2-69a2b44693d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:20.841575 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed486087-482b-42c4-9fe2-69a2b44693d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:20.843378 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed486087-482b-42c4-9fe2-69a2b44693d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:20.844936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed486087-482b-42c4-9fe2-69a2b44693d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:20.866255 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed486087-482b-42c4-9fe2-69a2b44693d7 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:20.873415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82f5b3-bf8e-4dd3-8fd1-00d4d01ceff4 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:20.894179 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f61b72-10ac-43fe-be9a-dd8074a62b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:20.895460 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f61b72-10ac-43fe-be9a-dd8074a62b26 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:20.895970 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f61b72-10ac-43fe-be9a-dd8074a62b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:20.896489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f61b72-10ac-43fe-be9a-dd8074a62b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:20.897511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f61b72-10ac-43fe-be9a-dd8074a62b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:20.900149 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f61b72-10ac-43fe-be9a-dd8074a62b26 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:20.917163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 806/1617] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:20.921619 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 812/1618] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:36:20.924368 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f61b72-10ac-43fe-be9a-dd8074a62b26 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:20.924515 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed486087-482b-42c4-9fe2-69a2b44693d7 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:20.946575 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed486087-482b-42c4-9fe2-69a2b44693d7 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:20.947198 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f61b72-10ac-43fe-be9a-dd8074a62b26 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:20.959539 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add428d-abb5-4178-b5ad-ad91f6493f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:20.959803 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b5bfa-8c4d-415d-a322-46a858f83036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:20.960757 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add428d-abb5-4178-b5ad-ad91f6493f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:20.962090 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add428d-abb5-4178-b5ad-ad91f6493f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:20.962396 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b5bfa-8c4d-415d-a322-46a858f83036 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:20.962873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add428d-abb5-4178-b5ad-ad91f6493f04 admin admin] PATH_INFO: `/v3/projects/ecf2013a61934c6ab08a6d1c8412e753/users/e9ab72104c9f4a22898428842151d117/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:20.965514 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b5bfa-8c4d-415d-a322-46a858f83036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:20.965842 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b5bfa-8c4d-415d-a322-46a858f83036 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:20.966890 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b5bfa-8c4d-415d-a322-46a858f83036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:20.972223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b5bfa-8c4d-415d-a322-46a858f83036 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:20.996872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add428d-abb5-4178-b5ad-ad91f6493f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf2013a61934c6ab08a6d1c8412e753, user_id=e9ab72104c9f4a22898428842151d117, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:21.002855 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add428d-abb5-4178-b5ad-ad91f6493f04 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:21.021662 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 813/1619] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:20 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:21.023240 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 807/1620] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:20 2022] PUT /identity/v3/projects/ecf2013a61934c6ab08a6d1c8412e753/users/e9ab72104c9f4a22898428842151d117/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:21.026040 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b5bfa-8c4d-415d-a322-46a858f83036 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:21.036903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1163e-332e-4d54-b857-77884ae080a7 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:21.037166 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1163e-332e-4d54-b857-77884ae080a7 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:21.037550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1163e-332e-4d54-b857-77884ae080a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:21.089022 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:21.095182 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-4dc1163e-332e-4d54-b857-77884ae080a7 None None] MFA Rules not processed for user `e9ab72104c9f4a22898428842151d117`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:21.096835 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-4dc1163e-332e-4d54-b857-77884ae080a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:21.127755 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:21.133485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b5bfa-8c4d-415d-a322-46a858f83036 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:21.153959 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5225c75-1e99-468a-99df-d14707db70b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:21.154608 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5225c75-1e99-468a-99df-d14707db70b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:21.154893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5225c75-1e99-468a-99df-d14707db70b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:21.158168 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5225c75-1e99-468a-99df-d14707db70b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:21.158608 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5225c75-1e99-468a-99df-d14707db70b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:21.162504 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5225c75-1e99-468a-99df-d14707db70b2 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:21.200523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 808/1621] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:21.201973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1163e-332e-4d54-b857-77884ae080a7 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:21.217173 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1163e-332e-4d54-b857-77884ae080a7 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:21.221076 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 814/1622] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:21 2022] POST /identity/v3/users => generated 301 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:21.223811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a9475-66fa-4184-805f-bf3ed16de89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:21.224545 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a9475-66fa-4184-805f-bf3ed16de89d admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:21.225102 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a9475-66fa-4184-805f-bf3ed16de89d admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:21.225488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a9475-66fa-4184-805f-bf3ed16de89d admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:21.226290 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5225c75-1e99-468a-99df-d14707db70b2 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:21.226408 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a9475-66fa-4184-805f-bf3ed16de89d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:21.229629 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a9475-66fa-4184-805f-bf3ed16de89d admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:21.259294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5225c75-1e99-468a-99df-d14707db70b2 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:21.267732 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 809/1623] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:21 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:21.271931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d855335-3c9d-45cd-a5ab-42ac9b8af6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:21.272905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d855335-3c9d-45cd-a5ab-42ac9b8af6aa admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:21.273517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d855335-3c9d-45cd-a5ab-42ac9b8af6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:21.273933 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d855335-3c9d-45cd-a5ab-42ac9b8af6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:21.274990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d855335-3c9d-45cd-a5ab-42ac9b8af6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:21.276569 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d855335-3c9d-45cd-a5ab-42ac9b8af6aa admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:21.279151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a9475-66fa-4184-805f-bf3ed16de89d admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:21.290566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 815/1624] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:21.294787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d855335-3c9d-45cd-a5ab-42ac9b8af6aa admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:21.307839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d855335-3c9d-45cd-a5ab-42ac9b8af6aa admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:21.431919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441f738-b99e-4239-8c69-4a6735eb063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:21.433367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441f738-b99e-4239-8c69-4a6735eb063f admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:21.434778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441f738-b99e-4239-8c69-4a6735eb063f admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:21.435235 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441f738-b99e-4239-8c69-4a6735eb063f admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:21.436322 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441f738-b99e-4239-8c69-4a6735eb063f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:21.439718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441f738-b99e-4239-8c69-4a6735eb063f admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:21.448195 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a9475-66fa-4184-805f-bf3ed16de89d admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:21.457821 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 816/1625] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:21.461086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef04d92-6e96-4aa1-8429-e7afbf02be01 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:21.461379 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef04d92-6e96-4aa1-8429-e7afbf02be01 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:21.461695 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef04d92-6e96-4aa1-8429-e7afbf02be01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:21.476586 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f51696-1a09-43e8-835c-557017318a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:21.477611 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51696-1a09-43e8-835c-557017318a25 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:21.477895 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51696-1a09-43e8-835c-557017318a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:21.478180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51696-1a09-43e8-835c-557017318a25 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:21.478814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f51696-1a09-43e8-835c-557017318a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:21.480870 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f51696-1a09-43e8-835c-557017318a25 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:21.522417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-1ef04d92-6e96-4aa1-8429-e7afbf02be01 None None] MFA Rules not processed for user `3914c091fe7d44d2bc4ec16195ffb099`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:21.523911 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1ef04d92-6e96-4aa1-8429-e7afbf02be01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:21.550795 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 810/1626] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:21 2022] POST /identity/v3/users => generated 300 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:21.551756 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f51696-1a09-43e8-835c-557017318a25 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:21.555507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-31f51696-1a09-43e8-835c-557017318a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:21.579214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f51696-1a09-43e8-835c-557017318a25 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:21.584257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:21.585047 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:21.586153 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:21.586567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd admin admin] PATH_INFO: `/v3/projects/7ed5df87eb764ca58175685f591b96fd` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:21.588979 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed5df87eb764ca58175685f591b96fd)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:21.591268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:21.688154 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed5df87eb764ca58175685f591b96fd', 'request_id': 'req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:21.696426 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 817/1627] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:21.697369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef04d92-6e96-4aa1-8429-e7afbf02be01 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:21.708703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed5df87eb764ca58175685f591b96fd', 'request_id': 'req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:21.720361 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef04d92-6e96-4aa1-8429-e7afbf02be01 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:21.727924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed5df87eb764ca58175685f591b96fd', 'request_id': 'req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:21.764376 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd admin admin] The token cache is being invalidate because project 7ed5df87eb764ca58175685f591b96fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:21.764725 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:21.768115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:21.768275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:21.773799 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 811/1628] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:21 2022] DELETE /identity/v3/projects/7ed5df87eb764ca58175685f591b96fd => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:21.778237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:21.781573 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:21.809422 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4daaebf-b045-4de9-bdb3-39927e41ff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:21.810796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daaebf-b045-4de9-bdb3-39927e41ff7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:21.811180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daaebf-b045-4de9-bdb3-39927e41ff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:21.811897 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daaebf-b045-4de9-bdb3-39927e41ff7f admin admin] PATH_INFO: `/v3/projects/bbcae1114a67439f959fcd34e9ea7550/users/adf109b854c24b348cf5ae1f2bb75526/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:21.816905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:21.830551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4daaebf-b045-4de9-bdb3-39927e41ff7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbcae1114a67439f959fcd34e9ea7550, user_id=adf109b854c24b348cf5ae1f2bb75526, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:21.833278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4daaebf-b045-4de9-bdb3-39927e41ff7f admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:21.861017 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 818/1629] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:21 2022] PUT /identity/v3/projects/bbcae1114a67439f959fcd34e9ea7550/users/adf109b854c24b348cf5ae1f2bb75526/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:21.862318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37d6d2-7ee5-4609-8b97-9e4b0cd6300c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:21.862582 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37d6d2-7ee5-4609-8b97-9e4b0cd6300c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:21.862853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37d6d2-7ee5-4609-8b97-9e4b0cd6300c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:21.911593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-df37d6d2-7ee5-4609-8b97-9e4b0cd6300c None None] MFA Rules not processed for user `956fb85fa00641efb810664a8a4c23e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:21.912994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-df37d6d2-7ee5-4609-8b97-9e4b0cd6300c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:21.919945 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c37b1-5cb9-42fa-85fe-9e8be38e96fd admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:21.982921 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 819/1630] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:21.983824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37d6d2-7ee5-4609-8b97-9e4b0cd6300c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:21.985140 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-df37d6d2-7ee5-4609-8b97-9e4b0cd6300c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:22.052793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26484a5c-1ca6-45ae-97ec-5c4fcf6b8bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:22.054125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26484a5c-1ca6-45ae-97ec-5c4fcf6b8bea admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:22.054765 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26484a5c-1ca6-45ae-97ec-5c4fcf6b8bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:22.055790 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26484a5c-1ca6-45ae-97ec-5c4fcf6b8bea admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:22.056840 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26484a5c-1ca6-45ae-97ec-5c4fcf6b8bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:22.063634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26484a5c-1ca6-45ae-97ec-5c4fcf6b8bea admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:22.077304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 812/1631] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:21 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:22.079122 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467468f-f1c9-4ca1-a2ab-de482f9edaa9 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:22.079409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467468f-f1c9-4ca1-a2ab-de482f9edaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:22.080372 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467468f-f1c9-4ca1-a2ab-de482f9edaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:22.081632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37d6d2-7ee5-4609-8b97-9e4b0cd6300c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:22.088124 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92c454-b4ab-4ea9-82ff-b90a1e2627a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:22.088866 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c454-b4ab-4ea9-82ff-b90a1e2627a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:22.089435 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c454-b4ab-4ea9-82ff-b90a1e2627a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:22.089772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92c454-b4ab-4ea9-82ff-b90a1e2627a2 admin admin] PATH_INFO: `/v3/users/6214f82b52e74d239c306134b9dbf68c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:22.091351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92c454-b4ab-4ea9-82ff-b90a1e2627a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6214f82b52e74d239c306134b9dbf68c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:22.094712 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92c454-b4ab-4ea9-82ff-b90a1e2627a2 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:22.113812 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-8467468f-f1c9-4ca1-a2ab-de482f9edaa9 None None] MFA Rules not processed for user `adf109b854c24b348cf5ae1f2bb75526`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:22.115189 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8467468f-f1c9-4ca1-a2ab-de482f9edaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:22.152020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-5e92c454-b4ab-4ea9-82ff-b90a1e2627a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6214f82b52e74d239c306134b9dbf68c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:22.154033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-5e92c454-b4ab-4ea9-82ff-b90a1e2627a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6214f82b52e74d239c306134b9dbf68c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:22.162936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-5e92c454-b4ab-4ea9-82ff-b90a1e2627a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6214f82b52e74d239c306134b9dbf68c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:22.170750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:22.183671 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-5e92c454-b4ab-4ea9-82ff-b90a1e2627a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6214f82b52e74d239c306134b9dbf68c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:22.183671 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-5e92c454-b4ab-4ea9-82ff-b90a1e2627a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6214f82b52e74d239c306134b9dbf68c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:22.200485 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 813/1632] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:22 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:22.201543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467468f-f1c9-4ca1-a2ab-de482f9edaa9 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:22.202111 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 820/1633] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:21 2022] DELETE /identity/v3/users/6214f82b52e74d239c306134b9dbf68c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:22.203162 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92c454-b4ab-4ea9-82ff-b90a1e2627a2 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:22.205284 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5e92c454-b4ab-4ea9-82ff-b90a1e2627a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:22.206581 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8467468f-f1c9-4ca1-a2ab-de482f9edaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:22.278774 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:22.307781 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92c454-b4ab-4ea9-82ff-b90a1e2627a2 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:22.316904 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5ec79-e9a0-4387-82eb-335fc6919261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:22.317367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467468f-f1c9-4ca1-a2ab-de482f9edaa9 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:22.317846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5ec79-e9a0-4387-82eb-335fc6919261 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:22.318211 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5ec79-e9a0-4387-82eb-335fc6919261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:22.318512 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5ec79-e9a0-4387-82eb-335fc6919261 admin admin] PATH_INFO: `/v3/projects/d17469d12c734a43b89c982cd4068039/users/164efc5ce9ee40be99434059d18c591e/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:22.343002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5ec79-e9a0-4387-82eb-335fc6919261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17469d12c734a43b89c982cd4068039, user_id=164efc5ce9ee40be99434059d18c591e, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:22.345819 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5ec79-e9a0-4387-82eb-335fc6919261 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:22.368296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 821/1634] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:22 2022] PUT /identity/v3/projects/d17469d12c734a43b89c982cd4068039/users/164efc5ce9ee40be99434059d18c591e/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:22.368296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5ec79-e9a0-4387-82eb-335fc6919261 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:22.369080 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-50a5ec79-e9a0-4387-82eb-335fc6919261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:22.406268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807fa57-921a-4fd6-ac49-a6de9437b46d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:22.406904 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807fa57-921a-4fd6-ac49-a6de9437b46d service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:22.407217 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807fa57-921a-4fd6-ac49-a6de9437b46d service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:22.407492 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807fa57-921a-4fd6-ac49-a6de9437b46d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:22.410427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-4807fa57-921a-4fd6-ac49-a6de9437b46d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:22.461750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5ec79-e9a0-4387-82eb-335fc6919261 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:22.468196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ee5b6-5d56-4f0c-b6e1-ff13170655ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:22.469011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ee5b6-5d56-4f0c-b6e1-ff13170655ce admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:22.470149 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ee5b6-5d56-4f0c-b6e1-ff13170655ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:22.470575 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ee5b6-5d56-4f0c-b6e1-ff13170655ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:22.471444 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ee5b6-5d56-4f0c-b6e1-ff13170655ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:22.474479 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ee5b6-5d56-4f0c-b6e1-ff13170655ce admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:22.525938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 822/1635] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:22 2022] POST /identity/v3/projects => generated 399 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:22.526785 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ee5b6-5d56-4f0c-b6e1-ff13170655ce admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:22.547880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807fa57-921a-4fd6-ac49-a6de9437b46d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:22.563158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807fa57-921a-4fd6-ac49-a6de9437b46d service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:22.585859 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 814/1636] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:22.587337 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807fa57-921a-4fd6-ac49-a6de9437b46d service nova] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:22.613115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807fa57-921a-4fd6-ac49-a6de9437b46d service nova] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:22.709014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:22.731123 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ee5b6-5d56-4f0c-b6e1-ff13170655ce admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:22.739962 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d5055-8042-4d56-917b-fbe4b7e69fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:22.740675 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ac7f7-827e-4fff-9651-6bfe30325f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:22.741604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d5055-8042-4d56-917b-fbe4b7e69fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:22.741727 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ac7f7-827e-4fff-9651-6bfe30325f09 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:22.742132 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ac7f7-827e-4fff-9651-6bfe30325f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:22.742472 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d5055-8042-4d56-917b-fbe4b7e69fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:22.742750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d5055-8042-4d56-917b-fbe4b7e69fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:22.742969 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ac7f7-827e-4fff-9651-6bfe30325f09 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:22.744712 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d5055-8042-4d56-917b-fbe4b7e69fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:22.745110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ac7f7-827e-4fff-9651-6bfe30325f09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:22.747701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ac7f7-827e-4fff-9651-6bfe30325f09 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:22.751517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d5055-8042-4d56-917b-fbe4b7e69fe5 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:22.774287 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 823/1637] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:22.775794 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d5055-8042-4d56-917b-fbe4b7e69fe5 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:22.777866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 815/1638] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:22 2022] POST /identity/v3/users => generated 306 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:22.778659 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ac7f7-827e-4fff-9651-6bfe30325f09 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:22.779487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2b9d5055-8042-4d56-917b-fbe4b7e69fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:22.798415 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d5055-8042-4d56-917b-fbe4b7e69fe5 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:22.800106 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ac7f7-827e-4fff-9651-6bfe30325f09 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:22.805753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d4141-c63a-4d6b-82b7-8b2fa23e8b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:22.806455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4141-c63a-4d6b-82b7-8b2fa23e8b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:22.806764 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4141-c63a-4d6b-82b7-8b2fa23e8b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:22.807126 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4141-c63a-4d6b-82b7-8b2fa23e8b18 admin admin] PATH_INFO: `/v3/projects/d17469d12c734a43b89c982cd4068039/users/164efc5ce9ee40be99434059d18c591e/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:22.809400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d4141-c63a-4d6b-82b7-8b2fa23e8b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17469d12c734a43b89c982cd4068039, user_id=164efc5ce9ee40be99434059d18c591e, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:22.810280 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb8847-42d0-41d7-8a46-08c5298c3710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:22.811522 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb8847-42d0-41d7-8a46-08c5298c3710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:22.812072 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb8847-42d0-41d7-8a46-08c5298c3710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:22.812174 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d4141-c63a-4d6b-82b7-8b2fa23e8b18 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:22.812632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb8847-42d0-41d7-8a46-08c5298c3710 admin admin] PATH_INFO: `/v3/projects/3993d1f454364245b47cb6d7d44d08b3` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:22.815635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb8847-42d0-41d7-8a46-08c5298c3710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3993d1f454364245b47cb6d7d44d08b3)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:22.818536 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:22.818807 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb8847-42d0-41d7-8a46-08c5298c3710 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:22.827808 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 816/1639] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:22 2022] PUT /identity/v3/projects/d17469d12c734a43b89c982cd4068039/users/164efc5ce9ee40be99434059d18c591e/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:22.829069 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d4141-c63a-4d6b-82b7-8b2fa23e8b18 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:22.900010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-beeb8847-42d0-41d7-8a46-08c5298c3710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3993d1f454364245b47cb6d7d44d08b3', 'request_id': 'req-beeb8847-42d0-41d7-8a46-08c5298c3710'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:22.910255 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-beeb8847-42d0-41d7-8a46-08c5298c3710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3993d1f454364245b47cb6d7d44d08b3', 'request_id': 'req-beeb8847-42d0-41d7-8a46-08c5298c3710'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:22.925515 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-beeb8847-42d0-41d7-8a46-08c5298c3710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3993d1f454364245b47cb6d7d44d08b3', 'request_id': 'req-beeb8847-42d0-41d7-8a46-08c5298c3710'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:22.933766 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d4141-c63a-4d6b-82b7-8b2fa23e8b18 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:22.952037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-beeb8847-42d0-41d7-8a46-08c5298c3710 admin admin] The token cache is being invalidate because project 3993d1f454364245b47cb6d7d44d08b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:22.952347 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-beeb8847-42d0-41d7-8a46-08c5298c3710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:22.954720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-beeb8847-42d0-41d7-8a46-08c5298c3710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:22.956526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 824/1640] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:22 2022] DELETE /identity/v3/projects/3993d1f454364245b47cb6d7d44d08b3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:22.960878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573204a-f3d6-4d7a-966a-73e8123d7dc4 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:22.961195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573204a-f3d6-4d7a-966a-73e8123d7dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:22.961494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e573204a-f3d6-4d7a-966a-73e8123d7dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:22.995653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-e573204a-f3d6-4d7a-966a-73e8123d7dc4 None None] MFA Rules not processed for user `164efc5ce9ee40be99434059d18c591e`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:22.996932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e573204a-f3d6-4d7a-966a-73e8123d7dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:23.016386 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1dc41-ad9e-43c1-9b7f-593fff45d08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:23.017004 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1dc41-ad9e-43c1-9b7f-593fff45d08f admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:23.017303 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1dc41-ad9e-43c1-9b7f-593fff45d08f admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:23.017604 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1dc41-ad9e-43c1-9b7f-593fff45d08f admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:23.018198 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1dc41-ad9e-43c1-9b7f-593fff45d08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:23.019900 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1dc41-ad9e-43c1-9b7f-593fff45d08f admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:23.033480 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 817/1641] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:22 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:23.034820 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27439095-ae80-41b9-9ac2-805a17bd7a52 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:23.035167 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27439095-ae80-41b9-9ac2-805a17bd7a52 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:23.035509 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27439095-ae80-41b9-9ac2-805a17bd7a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:23.058531 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-27439095-ae80-41b9-9ac2-805a17bd7a52 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:23.059837 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-27439095-ae80-41b9-9ac2-805a17bd7a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:23.071156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 818/1642] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:23.073788 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27439095-ae80-41b9-9ac2-805a17bd7a52 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:23.076361 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-27439095-ae80-41b9-9ac2-805a17bd7a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:23.099243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27439095-ae80-41b9-9ac2-805a17bd7a52 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:23.104663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6b2ee-aa45-41f9-9099-50a93b4e9374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:23.106915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6b2ee-aa45-41f9-9099-50a93b4e9374 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:23.107635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6b2ee-aa45-41f9-9099-50a93b4e9374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:23.108002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f6b2ee-aa45-41f9-9099-50a93b4e9374 admin admin] PATH_INFO: `/v3/projects/0be7cbc7d910416bbb5634462aef3a88/users/56202d01210742358b24b020f7bc1eef/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:23.121712 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 825/1643] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:22 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:23.124031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19402891-92a2-4f4c-87d0-b04e8878f963 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:23.124532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19402891-92a2-4f4c-87d0-b04e8878f963 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:23.125045 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19402891-92a2-4f4c-87d0-b04e8878f963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:23.132817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6b2ee-aa45-41f9-9099-50a93b4e9374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be7cbc7d910416bbb5634462aef3a88, user_id=56202d01210742358b24b020f7bc1eef, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:23.135734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f6b2ee-aa45-41f9-9099-50a93b4e9374 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:23.150406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 819/1644] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:23 2022] PUT /identity/v3/projects/0be7cbc7d910416bbb5634462aef3a88/users/56202d01210742358b24b020f7bc1eef/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:23.151053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6b2ee-aa45-41f9-9099-50a93b4e9374 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:23.153307 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e8f6b2ee-aa45-41f9-9099-50a93b4e9374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:23.160831 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-19402891-92a2-4f4c-87d0-b04e8878f963 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:23.162313 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-19402891-92a2-4f4c-87d0-b04e8878f963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:23.222393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:23.238858 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 826/1645] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:23.239144 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f6b2ee-aa45-41f9-9099-50a93b4e9374 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:23.243160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19402891-92a2-4f4c-87d0-b04e8878f963 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:23.244195 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a941bf-95a8-4772-8030-9bf7b290ce02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:23.244820 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a941bf-95a8-4772-8030-9bf7b290ce02 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:23.245126 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a941bf-95a8-4772-8030-9bf7b290ce02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:23.245406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a941bf-95a8-4772-8030-9bf7b290ce02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:23.254979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19402891-92a2-4f4c-87d0-b04e8878f963 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:23.260365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd929b1-0af2-4460-9a6a-3dc19fc4556c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:23.260877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd929b1-0af2-4460-9a6a-3dc19fc4556c admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:23.261154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd929b1-0af2-4460-9a6a-3dc19fc4556c admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:23.261426 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd929b1-0af2-4460-9a6a-3dc19fc4556c admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:23.262414 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd929b1-0af2-4460-9a6a-3dc19fc4556c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:23.264231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd929b1-0af2-4460-9a6a-3dc19fc4556c admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:23.275757 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 827/1646] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:23.276608 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd929b1-0af2-4460-9a6a-3dc19fc4556c admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:23.280888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:23.288656 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd929b1-0af2-4460-9a6a-3dc19fc4556c admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:23.295753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a295f-6753-4a26-bfd8-3a0b0a1b93c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:23.296725 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a295f-6753-4a26-bfd8-3a0b0a1b93c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:23.297013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a295f-6753-4a26-bfd8-3a0b0a1b93c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:23.297291 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a295f-6753-4a26-bfd8-3a0b0a1b93c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:23.297952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a295f-6753-4a26-bfd8-3a0b0a1b93c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:23.298434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a295f-6753-4a26-bfd8-3a0b0a1b93c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:23.300186 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a295f-6753-4a26-bfd8-3a0b0a1b93c9 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:23.332640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a941bf-95a8-4772-8030-9bf7b290ce02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:23.334383 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a941bf-95a8-4772-8030-9bf7b290ce02 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:23.334994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 828/1647] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:36:23.335893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a295f-6753-4a26-bfd8-3a0b0a1b93c9 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:23.348363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a295f-6753-4a26-bfd8-3a0b0a1b93c9 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:23.353917 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be97b88-580c-4ec1-b311-065e670e26a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:23.354578 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be97b88-580c-4ec1-b311-065e670e26a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:23.354872 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be97b88-580c-4ec1-b311-065e670e26a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:23.355301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be97b88-580c-4ec1-b311-065e670e26a3 admin admin] PATH_INFO: `/v3/projects/0be7cbc7d910416bbb5634462aef3a88/users/56202d01210742358b24b020f7bc1eef/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:23.356199 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 820/1648] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:23 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:23.357510 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a941bf-95a8-4772-8030-9bf7b290ce02 service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:23.357810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be97b88-580c-4ec1-b311-065e670e26a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be7cbc7d910416bbb5634462aef3a88, user_id=56202d01210742358b24b020f7bc1eef, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:23.360476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be97b88-580c-4ec1-b311-065e670e26a3 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:23.369784 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a941bf-95a8-4772-8030-9bf7b290ce02 service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:23.383118 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 829/1649] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:23 2022] PUT /identity/v3/projects/0be7cbc7d910416bbb5634462aef3a88/users/56202d01210742358b24b020f7bc1eef/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:23.404297 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e408d-0e4d-40a1-8b3b-07ad3842da6a None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:23.404297 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e408d-0e4d-40a1-8b3b-07ad3842da6a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:23.404297 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e408d-0e4d-40a1-8b3b-07ad3842da6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:23.463798 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f90c7-16dd-4e75-8cd9-d01a724dd2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:23.465083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f90c7-16dd-4e75-8cd9-d01a724dd2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:23.465569 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f90c7-16dd-4e75-8cd9-d01a724dd2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:23.466119 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f90c7-16dd-4e75-8cd9-d01a724dd2d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:23.467881 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-184e408d-0e4d-40a1-8b3b-07ad3842da6a None None] MFA Rules not processed for user `56202d01210742358b24b020f7bc1eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:23.468011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f90c7-16dd-4e75-8cd9-d01a724dd2d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:23.469750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-184e408d-0e4d-40a1-8b3b-07ad3842da6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:23.471004 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f90c7-16dd-4e75-8cd9-d01a724dd2d4 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:23.519332 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 821/1650] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:23 2022] POST /identity/v3/projects => generated 385 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:23.520314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f90c7-16dd-4e75-8cd9-d01a724dd2d4 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:23.522334 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-4a7f90c7-16dd-4e75-8cd9-d01a724dd2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:23.606106 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f90c7-16dd-4e75-8cd9-d01a724dd2d4 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:23.628515 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee276f-13db-4d15-bdc5-17fb8aa03279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:23.629180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee276f-13db-4d15-bdc5-17fb8aa03279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:23.629461 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee276f-13db-4d15-bdc5-17fb8aa03279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:23.629736 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee276f-13db-4d15-bdc5-17fb8aa03279 admin admin] PATH_INFO: `/v3/users/e9ab72104c9f4a22898428842151d117` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:23.631031 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee276f-13db-4d15-bdc5-17fb8aa03279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ab72104c9f4a22898428842151d117)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:23.635006 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee276f-13db-4d15-bdc5-17fb8aa03279 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:23.668162 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 830/1651] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:23 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:23.669763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e408d-0e4d-40a1-8b3b-07ad3842da6a None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:23.694553 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e408d-0e4d-40a1-8b3b-07ad3842da6a None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:23.702711 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aab9f-ab0c-486e-b7c0-feb7c4cf6756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:23.703582 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aab9f-ab0c-486e-b7c0-feb7c4cf6756 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:23.704057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aab9f-ab0c-486e-b7c0-feb7c4cf6756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:23.704514 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aab9f-ab0c-486e-b7c0-feb7c4cf6756 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:23.705518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937aab9f-ab0c-486e-b7c0-feb7c4cf6756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:23.708557 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937aab9f-ab0c-486e-b7c0-feb7c4cf6756 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:23.735304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f4ee276f-13db-4d15-bdc5-17fb8aa03279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ab72104c9f4a22898428842151d117'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:23.736206 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f4ee276f-13db-4d15-bdc5-17fb8aa03279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ab72104c9f4a22898428842151d117'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:23.738027 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:23.754453 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 831/1652] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:23 2022] POST /identity/v3/users => generated 293 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:23.756420 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aab9f-ab0c-486e-b7c0-feb7c4cf6756 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:23.760442 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f4ee276f-13db-4d15-bdc5-17fb8aa03279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ab72104c9f4a22898428842151d117'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:23.786476 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f4ee276f-13db-4d15-bdc5-17fb8aa03279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ab72104c9f4a22898428842151d117'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:23.787329 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f4ee276f-13db-4d15-bdc5-17fb8aa03279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ab72104c9f4a22898428842151d117'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:23.827556 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 822/1653] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:23 2022] DELETE /identity/v3/users/e9ab72104c9f4a22898428842151d117 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:23.828506 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee276f-13db-4d15-bdc5-17fb8aa03279 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:23.841476 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-f4ee276f-13db-4d15-bdc5-17fb8aa03279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:23.881837 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aab9f-ab0c-486e-b7c0-feb7c4cf6756 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:23.950435 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee276f-13db-4d15-bdc5-17fb8aa03279 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:23.956818 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469d388-55c3-49c3-beb7-62825fb0fa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:23.957571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469d388-55c3-49c3-beb7-62825fb0fa29 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:23.957983 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469d388-55c3-49c3-beb7-62825fb0fa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:23.958473 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469d388-55c3-49c3-beb7-62825fb0fa29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:23.960206 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469d388-55c3-49c3-beb7-62825fb0fa29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:23.962077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469d388-55c3-49c3-beb7-62825fb0fa29 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:23.975054 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 823/1654] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:23.976771 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85649a-7882-47da-b0ce-b84bd7d6a217 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:23.977169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85649a-7882-47da-b0ce-b84bd7d6a217 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:23.977803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff85649a-7882-47da-b0ce-b84bd7d6a217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:23.988255 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:24.013340 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028990f-7a9e-405a-afbb-ee11d33f30cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:24.014106 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028990f-7a9e-405a-afbb-ee11d33f30cc service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:24.014385 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028990f-7a9e-405a-afbb-ee11d33f30cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:24.014658 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028990f-7a9e-405a-afbb-ee11d33f30cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:24.016719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9028990f-7a9e-405a-afbb-ee11d33f30cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:24.018822 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-ff85649a-7882-47da-b0ce-b84bd7d6a217 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:24.020176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-ff85649a-7882-47da-b0ce-b84bd7d6a217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:24.045621 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 824/1655] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:24.046619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85649a-7882-47da-b0ce-b84bd7d6a217 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:24.080563 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff85649a-7882-47da-b0ce-b84bd7d6a217 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:24.089368 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647de1a-7a0d-474e-b65c-efeeb9017d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:24.091138 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647de1a-7a0d-474e-b65c-efeeb9017d67 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:24.091138 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647de1a-7a0d-474e-b65c-efeeb9017d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:24.098360 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647de1a-7a0d-474e-b65c-efeeb9017d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:24.099093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647de1a-7a0d-474e-b65c-efeeb9017d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:24.102913 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647de1a-7a0d-474e-b65c-efeeb9017d67 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:24.134775 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 825/1656] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:24.136354 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647de1a-7a0d-474e-b65c-efeeb9017d67 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:24.147655 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9647de1a-7a0d-474e-b65c-efeeb9017d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:24.150719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028990f-7a9e-405a-afbb-ee11d33f30cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:24.152109 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028990f-7a9e-405a-afbb-ee11d33f30cc service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:24.179734 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 832/1657] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:23 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:24.183051 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028990f-7a9e-405a-afbb-ee11d33f30cc service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:24.215642 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028990f-7a9e-405a-afbb-ee11d33f30cc service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:24.231157 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e974a7-93fb-480d-a5bf-93b49d713517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:24.234419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e974a7-93fb-480d-a5bf-93b49d713517 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:24.234854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e974a7-93fb-480d-a5bf-93b49d713517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:24.235311 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e974a7-93fb-480d-a5bf-93b49d713517 admin admin] PATH_INFO: `/v3/projects/44f1d090238a4361b4e1e4c75a3e6a0d/users/8391d61829244f6b9b3074d82fef95b9/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:24.273213 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e974a7-93fb-480d-a5bf-93b49d713517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44f1d090238a4361b4e1e4c75a3e6a0d, user_id=8391d61829244f6b9b3074d82fef95b9, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:24.278013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e974a7-93fb-480d-a5bf-93b49d713517 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:24.309423 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647de1a-7a0d-474e-b65c-efeeb9017d67 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:24.322096 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce453f1-c985-473b-89f1-db24e34576fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:24.323280 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce453f1-c985-473b-89f1-db24e34576fe service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:24.323734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce453f1-c985-473b-89f1-db24e34576fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:24.324652 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce453f1-c985-473b-89f1-db24e34576fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:24.348904 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 833/1658] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:24 2022] PUT /identity/v3/projects/44f1d090238a4361b4e1e4c75a3e6a0d/users/8391d61829244f6b9b3074d82fef95b9/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:24.349444 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce453f1-c985-473b-89f1-db24e34576fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:24.351626 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce453f1-c985-473b-89f1-db24e34576fe service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:24.373316 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e974a7-93fb-480d-a5bf-93b49d713517 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:24.378360 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-84e974a7-93fb-480d-a5bf-93b49d713517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:24.382476 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 826/1659] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:24.386712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c338-f214-4b03-8efd-0a871a4d141e None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:24.389192 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c338-f214-4b03-8efd-0a871a4d141e None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:24.389602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c338-f214-4b03-8efd-0a871a4d141e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:24.426625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-bf93c338-f214-4b03-8efd-0a871a4d141e None None] MFA Rules not processed for user `8391d61829244f6b9b3074d82fef95b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:24.428080 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-bf93c338-f214-4b03-8efd-0a871a4d141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:24.475149 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:24.529180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e974a7-93fb-480d-a5bf-93b49d713517 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:24.529898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 827/1660] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:24.548393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869a8b7-0922-4988-9118-045955057140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:24.559876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869a8b7-0922-4988-9118-045955057140 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:24.559876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869a8b7-0922-4988-9118-045955057140 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:24.559876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869a8b7-0922-4988-9118-045955057140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:24.559876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7869a8b7-0922-4988-9118-045955057140 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:24.561497 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93c338-f214-4b03-8efd-0a871a4d141e None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:24.567863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-bf93c338-f214-4b03-8efd-0a871a4d141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:24.583161 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93c338-f214-4b03-8efd-0a871a4d141e None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:24.589310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ce103-1d4f-4a69-bd47-23b18221dcd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:24.590315 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ce103-1d4f-4a69-bd47-23b18221dcd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:24.591267 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ce103-1d4f-4a69-bd47-23b18221dcd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:24.591711 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ce103-1d4f-4a69-bd47-23b18221dcd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:24.606252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ce103-1d4f-4a69-bd47-23b18221dcd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:24.609389 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ce103-1d4f-4a69-bd47-23b18221dcd1 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:24.623977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 828/1661] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:24.649625 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869a8b7-0922-4988-9118-045955057140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:24.651475 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869a8b7-0922-4988-9118-045955057140 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:24.662216 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 834/1662] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:24 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:24.926518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ce103-1d4f-4a69-bd47-23b18221dcd1 service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:24.928186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-2b5ce103-1d4f-4a69-bd47-23b18221dcd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:25.085459 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ce103-1d4f-4a69-bd47-23b18221dcd1 service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:25.091477 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b685588-23cd-4baa-b906-ea1eae95356f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:25.092151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b685588-23cd-4baa-b906-ea1eae95356f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:25.092423 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b685588-23cd-4baa-b906-ea1eae95356f admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:25.092702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b685588-23cd-4baa-b906-ea1eae95356f admin admin] PATH_INFO: `/v3/projects/ecf2013a61934c6ab08a6d1c8412e753` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:25.095974 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b685588-23cd-4baa-b906-ea1eae95356f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf2013a61934c6ab08a6d1c8412e753)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:25.098101 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b685588-23cd-4baa-b906-ea1eae95356f admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:25.215986 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-3b685588-23cd-4baa-b906-ea1eae95356f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf2013a61934c6ab08a6d1c8412e753', 'request_id': 'req-3b685588-23cd-4baa-b906-ea1eae95356f'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:25.233675 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-3b685588-23cd-4baa-b906-ea1eae95356f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf2013a61934c6ab08a6d1c8412e753', 'request_id': 'req-3b685588-23cd-4baa-b906-ea1eae95356f'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:25.258993 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-3b685588-23cd-4baa-b906-ea1eae95356f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf2013a61934c6ab08a6d1c8412e753', 'request_id': 'req-3b685588-23cd-4baa-b906-ea1eae95356f'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:25.294993 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-3b685588-23cd-4baa-b906-ea1eae95356f admin admin] The token cache is being invalidate because project ecf2013a61934c6ab08a6d1c8412e753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:25.295369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-3b685588-23cd-4baa-b906-ea1eae95356f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:25.299242 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-3b685588-23cd-4baa-b906-ea1eae95356f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:25.301215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 829/1663] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:24 2022] DELETE /identity/v3/projects/ecf2013a61934c6ab08a6d1c8412e753 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:25.309467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869a8b7-0922-4988-9118-045955057140 service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:25.329041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869a8b7-0922-4988-9118-045955057140 service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:25.351644 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:25.392925 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53118b5e-dd37-4c79-8f99-225e2a069d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:25.393565 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53118b5e-dd37-4c79-8f99-225e2a069d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:25.393842 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53118b5e-dd37-4c79-8f99-225e2a069d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:25.394115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53118b5e-dd37-4c79-8f99-225e2a069d2d admin admin] PATH_INFO: `/v3/users/164efc5ce9ee40be99434059d18c591e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:25.395262 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53118b5e-dd37-4c79-8f99-225e2a069d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=164efc5ce9ee40be99434059d18c591e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:25.397308 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53118b5e-dd37-4c79-8f99-225e2a069d2d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:25.448406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-53118b5e-dd37-4c79-8f99-225e2a069d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '164efc5ce9ee40be99434059d18c591e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:25.449137 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-53118b5e-dd37-4c79-8f99-225e2a069d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '164efc5ce9ee40be99434059d18c591e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:25.456383 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-53118b5e-dd37-4c79-8f99-225e2a069d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '164efc5ce9ee40be99434059d18c591e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:25.469905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-53118b5e-dd37-4c79-8f99-225e2a069d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '164efc5ce9ee40be99434059d18c591e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:25.470600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-53118b5e-dd37-4c79-8f99-225e2a069d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '164efc5ce9ee40be99434059d18c591e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:25.484296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 835/1664] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:25 2022] DELETE /identity/v3/users/164efc5ce9ee40be99434059d18c591e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:25.895785 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b685588-23cd-4baa-b906-ea1eae95356f admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:25.897342 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-3b685588-23cd-4baa-b906-ea1eae95356f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:25.914406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b685588-23cd-4baa-b906-ea1eae95356f admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:25.970742 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:25.981523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497dbec-72f9-43cd-ac7f-d2f29efe6ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:25.982351 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497dbec-72f9-43cd-ac7f-d2f29efe6ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:25.982691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497dbec-72f9-43cd-ac7f-d2f29efe6ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:25.983219 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497dbec-72f9-43cd-ac7f-d2f29efe6ce3 admin admin] PATH_INFO: `/v3/projects/d17469d12c734a43b89c982cd4068039` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:25.984352 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497dbec-72f9-43cd-ac7f-d2f29efe6ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d17469d12c734a43b89c982cd4068039)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:25.986227 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497dbec-72f9-43cd-ac7f-d2f29efe6ce3 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:26.034994 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6497dbec-72f9-43cd-ac7f-d2f29efe6ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd17469d12c734a43b89c982cd4068039', 'request_id': 'req-6497dbec-72f9-43cd-ac7f-d2f29efe6ce3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:26.041088 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6497dbec-72f9-43cd-ac7f-d2f29efe6ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd17469d12c734a43b89c982cd4068039', 'request_id': 'req-6497dbec-72f9-43cd-ac7f-d2f29efe6ce3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:26.046973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6497dbec-72f9-43cd-ac7f-d2f29efe6ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd17469d12c734a43b89c982cd4068039', 'request_id': 'req-6497dbec-72f9-43cd-ac7f-d2f29efe6ce3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:26.059914 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6497dbec-72f9-43cd-ac7f-d2f29efe6ce3 admin admin] The token cache is being invalidate because project d17469d12c734a43b89c982cd4068039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:26.060200 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6497dbec-72f9-43cd-ac7f-d2f29efe6ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:26.060811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6497dbec-72f9-43cd-ac7f-d2f29efe6ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:26.062301 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 830/1665] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:25 2022] DELETE /identity/v3/projects/d17469d12c734a43b89c982cd4068039 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:26.067306 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1695012-22e4-4376-b6dd-05baaed75796 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:26.067590 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1695012-22e4-4376-b6dd-05baaed75796 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:26.067863 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1695012-22e4-4376-b6dd-05baaed75796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:26.087948 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-b1695012-22e4-4376-b6dd-05baaed75796 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:26.089191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b1695012-22e4-4376-b6dd-05baaed75796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:26.155046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 836/1666] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:26.164916 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98e46-6285-4943-af5e-806b8edc19aa None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:26.165204 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98e46-6285-4943-af5e-806b8edc19aa None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:26.165480 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d98e46-6285-4943-af5e-806b8edc19aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:26.189925 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-55d98e46-6285-4943-af5e-806b8edc19aa None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:26.190067 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-55d98e46-6285-4943-af5e-806b8edc19aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:26.199124 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 831/1667] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:26.203494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1695012-22e4-4376-b6dd-05baaed75796 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:26.222278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1695012-22e4-4376-b6dd-05baaed75796 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:26.228039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6acfe-568b-4e05-afe0-059180fe337e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:26.228754 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6acfe-568b-4e05-afe0-059180fe337e admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:26.228931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6acfe-568b-4e05-afe0-059180fe337e admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:26.229195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6acfe-568b-4e05-afe0-059180fe337e admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:26.229842 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6acfe-568b-4e05-afe0-059180fe337e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:26.230145 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6acfe-568b-4e05-afe0-059180fe337e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:26.232649 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6acfe-568b-4e05-afe0-059180fe337e admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:26.247533 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 837/1668] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:36:26.253186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d98e46-6285-4943-af5e-806b8edc19aa None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:26.267973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d98e46-6285-4943-af5e-806b8edc19aa None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:26.278760 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c6864-6cf5-4938-a698-1d045af043b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:26.280695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c6864-6cf5-4938-a698-1d045af043b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:26.281055 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c6864-6cf5-4938-a698-1d045af043b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:26.281446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c6864-6cf5-4938-a698-1d045af043b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:26.282865 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c6864-6cf5-4938-a698-1d045af043b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:26.286237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c6864-6cf5-4938-a698-1d045af043b4 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:26.354371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 832/1669] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:26 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:36:26.361758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6acfe-568b-4e05-afe0-059180fe337e admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:26.377550 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6acfe-568b-4e05-afe0-059180fe337e admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:26.417753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:26.511379 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49253e-4667-47de-b9be-1d95be8ba8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:26.512760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49253e-4667-47de-b9be-1d95be8ba8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:26.512957 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49253e-4667-47de-b9be-1d95be8ba8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:26.513220 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49253e-4667-47de-b9be-1d95be8ba8f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:26.513927 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49253e-4667-47de-b9be-1d95be8ba8f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:26.516090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd49253e-4667-47de-b9be-1d95be8ba8f6 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:26.542693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 838/1670] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:26 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:26.547815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c6864-6cf5-4938-a698-1d045af043b4 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:26.565077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c6864-6cf5-4938-a698-1d045af043b4 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:26.571079 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb4fe8-486d-431c-b025-8960f443916d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:26.571991 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb4fe8-486d-431c-b025-8960f443916d admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:26.572315 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb4fe8-486d-431c-b025-8960f443916d admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:26.572636 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb4fe8-486d-431c-b025-8960f443916d admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:26.573514 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb4fe8-486d-431c-b025-8960f443916d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:26.575853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb4fe8-486d-431c-b025-8960f443916d admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:26.595097 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 833/1671] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:26.596012 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49253e-4667-47de-b9be-1d95be8ba8f6 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:26.609289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49253e-4667-47de-b9be-1d95be8ba8f6 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:26.621620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cba83d-53d3-41a9-8d10-e9cfe6a2fe53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:26.621620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cba83d-53d3-41a9-8d10-e9cfe6a2fe53 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:26.621620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cba83d-53d3-41a9-8d10-e9cfe6a2fe53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:26.621620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cba83d-53d3-41a9-8d10-e9cfe6a2fe53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:26.622138 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cba83d-53d3-41a9-8d10-e9cfe6a2fe53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:26.622138 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cba83d-53d3-41a9-8d10-e9cfe6a2fe53 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:26.636179 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 839/1672] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:26.641463 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb4fe8-486d-431c-b025-8960f443916d admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:26.653663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb4fe8-486d-431c-b025-8960f443916d admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:26.658915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6e585-9390-4e43-bc20-948a0ccadff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:26.659654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6e585-9390-4e43-bc20-948a0ccadff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:26.659894 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6e585-9390-4e43-bc20-948a0ccadff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:26.660177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6e585-9390-4e43-bc20-948a0ccadff3 admin admin] PATH_INFO: `/v3/projects/43b608b6df3649ba92b725c62310b0a7/users/4167bf397969459792feae68f6cc33e6/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:26.680522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6e585-9390-4e43-bc20-948a0ccadff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b608b6df3649ba92b725c62310b0a7, user_id=4167bf397969459792feae68f6cc33e6, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:26.683216 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6e585-9390-4e43-bc20-948a0ccadff3 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:26.703359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 834/1673] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:26 2022] PUT /identity/v3/projects/43b608b6df3649ba92b725c62310b0a7/users/4167bf397969459792feae68f6cc33e6/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:26.717132 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ea2b5-1e7d-4d0c-a48a-109aa8a62ea7 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:26.717447 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ea2b5-1e7d-4d0c-a48a-109aa8a62ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:26.717897 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ea2b5-1e7d-4d0c-a48a-109aa8a62ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:26.764707 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-7b3ea2b5-1e7d-4d0c-a48a-109aa8a62ea7 None None] MFA Rules not processed for user `4167bf397969459792feae68f6cc33e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:26.765846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7b3ea2b5-1e7d-4d0c-a48a-109aa8a62ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:26.933478 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 840/1674] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:26.938392 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6e585-9390-4e43-bc20-948a0ccadff3 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:27.068449 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6e585-9390-4e43-bc20-948a0ccadff3 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:27.073414 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536ad64-4b44-4f65-b887-d4018f435c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:27.074710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536ad64-4b44-4f65-b887-d4018f435c6c admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:27.078559 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536ad64-4b44-4f65-b887-d4018f435c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:27.078559 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536ad64-4b44-4f65-b887-d4018f435c6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:27.078559 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536ad64-4b44-4f65-b887-d4018f435c6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:27.078559 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5536ad64-4b44-4f65-b887-d4018f435c6c admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:27.114121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 835/1675] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:26 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:27.118770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ea2b5-1e7d-4d0c-a48a-109aa8a62ea7 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:27.132982 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ea2b5-1e7d-4d0c-a48a-109aa8a62ea7 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:27.204886 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87f38a-4f17-499c-8031-1a38c3c59e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:27.205668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87f38a-4f17-499c-8031-1a38c3c59e95 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:27.206056 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87f38a-4f17-499c-8031-1a38c3c59e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:27.206460 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87f38a-4f17-499c-8031-1a38c3c59e95 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:27.207352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87f38a-4f17-499c-8031-1a38c3c59e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:27.209698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87f38a-4f17-499c-8031-1a38c3c59e95 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:27.247203 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 841/1676] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:27 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:27.249326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536ad64-4b44-4f65-b887-d4018f435c6c admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:27.260595 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:27.265680 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536ad64-4b44-4f65-b887-d4018f435c6c admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:27.273083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1d720-bba1-4379-87d8-5d6bcfade16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:27.274056 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1d720-bba1-4379-87d8-5d6bcfade16b admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:27.274597 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1d720-bba1-4379-87d8-5d6bcfade16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:27.275260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1d720-bba1-4379-87d8-5d6bcfade16b admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:27.276167 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1d720-bba1-4379-87d8-5d6bcfade16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:27.278524 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1d720-bba1-4379-87d8-5d6bcfade16b admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:27.295963 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 836/1677] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:27.300276 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87f38a-4f17-499c-8031-1a38c3c59e95 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:27.311501 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87f38a-4f17-499c-8031-1a38c3c59e95 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:27.316808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5035b-921c-4d1a-8331-50666ff26b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:27.317491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5035b-921c-4d1a-8331-50666ff26b6b admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:27.317694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5035b-921c-4d1a-8331-50666ff26b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:27.317964 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5035b-921c-4d1a-8331-50666ff26b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:27.318598 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5035b-921c-4d1a-8331-50666ff26b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:27.320210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5035b-921c-4d1a-8331-50666ff26b6b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:27.338178 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 842/1678] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:27.359630 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1d720-bba1-4379-87d8-5d6bcfade16b admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:27.374975 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1d720-bba1-4379-87d8-5d6bcfade16b admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:27.380866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba81a7-0eb8-4e6e-bd54-d0cc9e34a9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:27.381632 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba81a7-0eb8-4e6e-bd54-d0cc9e34a9ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:27.381920 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba81a7-0eb8-4e6e-bd54-d0cc9e34a9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:27.382372 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba81a7-0eb8-4e6e-bd54-d0cc9e34a9ea admin admin] PATH_INFO: `/v3/projects/6ecdb40b0f5847ecaa618cdd8776c4ee/users/f40906a9bb034cd28c86fac1679d944d/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:27.416190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba81a7-0eb8-4e6e-bd54-d0cc9e34a9ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ecdb40b0f5847ecaa618cdd8776c4ee, user_id=f40906a9bb034cd28c86fac1679d944d, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:27.421038 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba81a7-0eb8-4e6e-bd54-d0cc9e34a9ea admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:27.450124 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 837/1679] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:27 2022] PUT /identity/v3/projects/6ecdb40b0f5847ecaa618cdd8776c4ee/users/f40906a9bb034cd28c86fac1679d944d/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:27.460189 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec76db-54ed-4436-9f65-61581ee5ca83 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:27.460747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec76db-54ed-4436-9f65-61581ee5ca83 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:27.460747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec76db-54ed-4436-9f65-61581ee5ca83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:27.488560 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:27.491968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-11ec76db-54ed-4436-9f65-61581ee5ca83 None None] MFA Rules not processed for user `f40906a9bb034cd28c86fac1679d944d`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:27.493417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-11ec76db-54ed-4436-9f65-61581ee5ca83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:27.538684 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba81a7-0eb8-4e6e-bd54-d0cc9e34a9ea admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:27.540830 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b3ba81a7-0eb8-4e6e-bd54-d0cc9e34a9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:27.659579 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 843/1680] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:27.667475 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec76db-54ed-4436-9f65-61581ee5ca83 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:27.707737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba81a7-0eb8-4e6e-bd54-d0cc9e34a9ea admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:27.715750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4943042-72d5-4aa8-bea4-ac5748ad13aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:27.717996 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943042-72d5-4aa8-bea4-ac5748ad13aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:27.719351 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943042-72d5-4aa8-bea4-ac5748ad13aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:27.719657 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4943042-72d5-4aa8-bea4-ac5748ad13aa admin admin] PATH_INFO: `/v3/users/8391d61829244f6b9b3074d82fef95b9` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:27.725686 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4943042-72d5-4aa8-bea4-ac5748ad13aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8391d61829244f6b9b3074d82fef95b9)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:27.727888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4943042-72d5-4aa8-bea4-ac5748ad13aa admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:27.799295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec76db-54ed-4436-9f65-61581ee5ca83 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:27.812909 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc46c9a-64fe-4cb6-a582-6acdf877e5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:27.814009 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc46c9a-64fe-4cb6-a582-6acdf877e5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:27.814456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc46c9a-64fe-4cb6-a582-6acdf877e5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:27.814856 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc46c9a-64fe-4cb6-a582-6acdf877e5e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:27.815561 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc46c9a-64fe-4cb6-a582-6acdf877e5e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:27.817687 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc46c9a-64fe-4cb6-a582-6acdf877e5e5 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:27.829718 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b4943042-72d5-4aa8-bea4-ac5748ad13aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8391d61829244f6b9b3074d82fef95b9'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:27.831666 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b4943042-72d5-4aa8-bea4-ac5748ad13aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8391d61829244f6b9b3074d82fef95b9'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:27.847182 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b4943042-72d5-4aa8-bea4-ac5748ad13aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8391d61829244f6b9b3074d82fef95b9'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:27.871451 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b4943042-72d5-4aa8-bea4-ac5748ad13aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8391d61829244f6b9b3074d82fef95b9'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:27.872618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 844/1681] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:27 2022] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:36:27.877778 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b4943042-72d5-4aa8-bea4-ac5748ad13aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8391d61829244f6b9b3074d82fef95b9'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:27.878692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc46c9a-64fe-4cb6-a582-6acdf877e5e5 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:27.885695 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2dc46c9a-64fe-4cb6-a582-6acdf877e5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:27.911009 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 838/1682] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:27 2022] DELETE /identity/v3/users/8391d61829244f6b9b3074d82fef95b9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:27.915297 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b0ca4-4989-47b2-8700-e6134f14e353 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:27.915960 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b0ca4-4989-47b2-8700-e6134f14e353 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:27.917808 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b0ca4-4989-47b2-8700-e6134f14e353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:27.963893 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-869b0ca4-4989-47b2-8700-e6134f14e353 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:27.967448 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-869b0ca4-4989-47b2-8700-e6134f14e353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:28.055387 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc46c9a-64fe-4cb6-a582-6acdf877e5e5 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:28.081195 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:28.125551 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 839/1683] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:28.163114 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:28.200464 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b0ca4-4989-47b2-8700-e6134f14e353 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:28.201580 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778c1f4-27e9-4f4f-8abb-efe007f68cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:28.201790 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-869b0ca4-4989-47b2-8700-e6134f14e353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:28.202217 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778c1f4-27e9-4f4f-8abb-efe007f68cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:28.202858 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778c1f4-27e9-4f4f-8abb-efe007f68cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:28.203167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778c1f4-27e9-4f4f-8abb-efe007f68cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:28.204060 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778c1f4-27e9-4f4f-8abb-efe007f68cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:28.206278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778c1f4-27e9-4f4f-8abb-efe007f68cd9 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:28.223187 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b0ca4-4989-47b2-8700-e6134f14e353 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:28.236463 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0062af-e10d-4910-a7f6-9dc68c92eb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:28.237246 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0062af-e10d-4910-a7f6-9dc68c92eb3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:28.238633 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0062af-e10d-4910-a7f6-9dc68c92eb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:28.239089 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0062af-e10d-4910-a7f6-9dc68c92eb3a admin admin] PATH_INFO: `/v3/users/3cf164cd2ec349458aefffe139e426a2` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:28.243493 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 845/1684] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:27 2022] POST /identity/v3/users => generated 300 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:28.243493 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778c1f4-27e9-4f4f-8abb-efe007f68cd9 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:28.243777 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0062af-e10d-4910-a7f6-9dc68c92eb3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf164cd2ec349458aefffe139e426a2)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:28.243879 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0778c1f4-27e9-4f4f-8abb-efe007f68cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:28.248403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0062af-e10d-4910-a7f6-9dc68c92eb3a admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:28.347807 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778c1f4-27e9-4f4f-8abb-efe007f68cd9 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:28.354112 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6e0062af-e10d-4910-a7f6-9dc68c92eb3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf164cd2ec349458aefffe139e426a2'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:28.355883 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6e0062af-e10d-4910-a7f6-9dc68c92eb3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf164cd2ec349458aefffe139e426a2'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:28.359443 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09cff6-65d5-4c5d-9c81-f3ee73f1cce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:28.362189 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09cff6-65d5-4c5d-9c81-f3ee73f1cce8 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:28.362657 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09cff6-65d5-4c5d-9c81-f3ee73f1cce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:28.365136 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09cff6-65d5-4c5d-9c81-f3ee73f1cce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:28.375213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6e0062af-e10d-4910-a7f6-9dc68c92eb3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf164cd2ec349458aefffe139e426a2'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:28.383340 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09cff6-65d5-4c5d-9c81-f3ee73f1cce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:28.385731 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09cff6-65d5-4c5d-9c81-f3ee73f1cce8 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:28.397228 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6e0062af-e10d-4910-a7f6-9dc68c92eb3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf164cd2ec349458aefffe139e426a2'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:28.398220 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6e0062af-e10d-4910-a7f6-9dc68c92eb3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf164cd2ec349458aefffe139e426a2'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:28.410652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 846/1685] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:28.411976 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09cff6-65d5-4c5d-9c81-f3ee73f1cce8 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:28.418757 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 840/1686] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:28 2022] DELETE /identity/v3/users/3cf164cd2ec349458aefffe139e426a2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:36:28.423335 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da0e47-d266-4b5a-9c19-af887f0e99e9 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:28.423626 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da0e47-d266-4b5a-9c19-af887f0e99e9 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:28.423943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da0e47-d266-4b5a-9c19-af887f0e99e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:28.424572 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09cff6-65d5-4c5d-9c81-f3ee73f1cce8 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:28.465813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-f0da0e47-d266-4b5a-9c19-af887f0e99e9 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:28.470832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-f0da0e47-d266-4b5a-9c19-af887f0e99e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:28.531180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb433cfd-1646-4f5a-a6a7-b2ae04e45883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:28.532000 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb433cfd-1646-4f5a-a6a7-b2ae04e45883 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:28.532291 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb433cfd-1646-4f5a-a6a7-b2ae04e45883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:28.532564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb433cfd-1646-4f5a-a6a7-b2ae04e45883 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:28.533530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb433cfd-1646-4f5a-a6a7-b2ae04e45883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:28.536192 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb433cfd-1646-4f5a-a6a7-b2ae04e45883 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:28.555844 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 847/1687] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:28.561089 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb433cfd-1646-4f5a-a6a7-b2ae04e45883 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:28.563266 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-eb433cfd-1646-4f5a-a6a7-b2ae04e45883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:28.578742 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 841/1688] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:28.581884 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb433cfd-1646-4f5a-a6a7-b2ae04e45883 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:28.589249 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc4e6d-3735-46ae-bd1b-348a7932a0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:28.591006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc4e6d-3735-46ae-bd1b-348a7932a0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:28.591387 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc4e6d-3735-46ae-bd1b-348a7932a0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:28.591752 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc4e6d-3735-46ae-bd1b-348a7932a0f0 admin admin] PATH_INFO: `/v3/projects/5b22f5510c4044fd87f7b894534964e8/users/dc8f19fe647646c8ac3d46186047b7ea/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:28.612258 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc4e6d-3735-46ae-bd1b-348a7932a0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b22f5510c4044fd87f7b894534964e8, user_id=dc8f19fe647646c8ac3d46186047b7ea, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:28.614984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bc4e6d-3735-46ae-bd1b-348a7932a0f0 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:28.620691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da0e47-d266-4b5a-9c19-af887f0e99e9 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:28.624088 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-f0da0e47-d266-4b5a-9c19-af887f0e99e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:28.634718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 848/1689] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:28 2022] PUT /identity/v3/projects/5b22f5510c4044fd87f7b894534964e8/users/dc8f19fe647646c8ac3d46186047b7ea/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:28.640931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc4e6d-3735-46ae-bd1b-348a7932a0f0 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:28.713032 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:28.738070 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da0e47-d266-4b5a-9c19-af887f0e99e9 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:28.748063 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bc4e6d-3735-46ae-bd1b-348a7932a0f0 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:28.757742 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:28.762245 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe49ba-78ff-476a-96a0-7d99fa4101fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:28.762983 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe49ba-78ff-476a-96a0-7d99fa4101fe admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:28.763273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe49ba-78ff-476a-96a0-7d99fa4101fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:28.763547 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbe49ba-78ff-476a-96a0-7d99fa4101fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:28.764840 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe49ba-78ff-476a-96a0-7d99fa4101fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:28.766730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbe49ba-78ff-476a-96a0-7d99fa4101fe admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:28.789061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 849/1690] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:28.801368 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe49ba-78ff-476a-96a0-7d99fa4101fe admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:28.820141 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbe49ba-78ff-476a-96a0-7d99fa4101fe admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:28.829158 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16a60b-ed6e-4e22-9942-329da03840ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:28.831275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16a60b-ed6e-4e22-9942-329da03840ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:28.832262 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16a60b-ed6e-4e22-9942-329da03840ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:28.832519 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16a60b-ed6e-4e22-9942-329da03840ba admin admin] PATH_INFO: `/v3/projects/5b22f5510c4044fd87f7b894534964e8/users/dc8f19fe647646c8ac3d46186047b7ea/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:28.836648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16a60b-ed6e-4e22-9942-329da03840ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b22f5510c4044fd87f7b894534964e8, user_id=dc8f19fe647646c8ac3d46186047b7ea, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:28.837782 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6191b1-2d5c-4faa-90c1-0f11b22a0b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:28.838608 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6191b1-2d5c-4faa-90c1-0f11b22a0b00 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:28.839125 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6191b1-2d5c-4faa-90c1-0f11b22a0b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:28.839592 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6191b1-2d5c-4faa-90c1-0f11b22a0b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:28.843231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16a60b-ed6e-4e22-9942-329da03840ba admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:28.856434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6191b1-2d5c-4faa-90c1-0f11b22a0b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:28.858489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6191b1-2d5c-4faa-90c1-0f11b22a0b00 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:28.875651 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 850/1691] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:28 2022] PUT /identity/v3/projects/5b22f5510c4044fd87f7b894534964e8/users/dc8f19fe647646c8ac3d46186047b7ea/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:36:28.881200 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6869b2-51ff-46ed-9375-f47e84eb4de0 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:28.881625 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6869b2-51ff-46ed-9375-f47e84eb4de0 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:28.882060 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6869b2-51ff-46ed-9375-f47e84eb4de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:28.884040 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 842/1692] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:36:28.920340 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-6e6869b2-51ff-46ed-9375-f47e84eb4de0 None None] MFA Rules not processed for user `dc8f19fe647646c8ac3d46186047b7ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:28.921881 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6e6869b2-51ff-46ed-9375-f47e84eb4de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:29.029886 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 851/1693] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:28 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:29.032919 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6191b1-2d5c-4faa-90c1-0f11b22a0b00 service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:29.034730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8b6191b1-2d5c-4faa-90c1-0f11b22a0b00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:29.045720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6869b2-51ff-46ed-9375-f47e84eb4de0 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:29.048084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6e6869b2-51ff-46ed-9375-f47e84eb4de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:29.055572 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6191b1-2d5c-4faa-90c1-0f11b22a0b00 service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:29.169321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7d238-a8c3-452e-8660-a46ab2ac67d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:29.171196 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7d238-a8c3-452e-8660-a46ab2ac67d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:29.171535 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7d238-a8c3-452e-8660-a46ab2ac67d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:29.171917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7d238-a8c3-452e-8660-a46ab2ac67d0 admin admin] PATH_INFO: `/v3/projects/44f1d090238a4361b4e1e4c75a3e6a0d` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:29.173496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7d238-a8c3-452e-8660-a46ab2ac67d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44f1d090238a4361b4e1e4c75a3e6a0d)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:29.177406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7d238-a8c3-452e-8660-a46ab2ac67d0 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:29.207409 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6869b2-51ff-46ed-9375-f47e84eb4de0 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:29.212529 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65094aa2-8627-41b4-8ae9-33b12aa30516 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:29.213338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65094aa2-8627-41b4-8ae9-33b12aa30516 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:29.213721 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65094aa2-8627-41b4-8ae9-33b12aa30516 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:29.214105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65094aa2-8627-41b4-8ae9-33b12aa30516 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:29.227897 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65094aa2-8627-41b4-8ae9-33b12aa30516 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:29.231093 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65094aa2-8627-41b4-8ae9-33b12aa30516 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:29.252619 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 852/1694] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:29.277386 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b6c7d238-a8c3-452e-8660-a46ab2ac67d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44f1d090238a4361b4e1e4c75a3e6a0d', 'request_id': 'req-b6c7d238-a8c3-452e-8660-a46ab2ac67d0'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:29.285032 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b6c7d238-a8c3-452e-8660-a46ab2ac67d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44f1d090238a4361b4e1e4c75a3e6a0d', 'request_id': 'req-b6c7d238-a8c3-452e-8660-a46ab2ac67d0'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:29.292448 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b6c7d238-a8c3-452e-8660-a46ab2ac67d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44f1d090238a4361b4e1e4c75a3e6a0d', 'request_id': 'req-b6c7d238-a8c3-452e-8660-a46ab2ac67d0'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:29.320389 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b6c7d238-a8c3-452e-8660-a46ab2ac67d0 admin admin] The token cache is being invalidate because project 44f1d090238a4361b4e1e4c75a3e6a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:29.320765 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b6c7d238-a8c3-452e-8660-a46ab2ac67d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:29.322579 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b6c7d238-a8c3-452e-8660-a46ab2ac67d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:29.327126 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 843/1695] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:29 2022] DELETE /identity/v3/projects/44f1d090238a4361b4e1e4c75a3e6a0d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:29.332044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f229e4-4709-4df5-9938-c6032c408010 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:29.332357 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f229e4-4709-4df5-9938-c6032c408010 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:29.332648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f229e4-4709-4df5-9938-c6032c408010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:29.378118 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-36f229e4-4709-4df5-9938-c6032c408010 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:29.379560 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-36f229e4-4709-4df5-9938-c6032c408010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:29.489767 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:29.529824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 853/1696] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:36:29.538199 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81999859-ef4f-48bb-ba61-7aa0cb06e4b0 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:29.538701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81999859-ef4f-48bb-ba61-7aa0cb06e4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:29.539152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81999859-ef4f-48bb-ba61-7aa0cb06e4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:29.582110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-81999859-ef4f-48bb-ba61-7aa0cb06e4b0 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:29.586558 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-81999859-ef4f-48bb-ba61-7aa0cb06e4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:29.602968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 844/1697] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:29.607897 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f229e4-4709-4df5-9938-c6032c408010 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:29.627505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f229e4-4709-4df5-9938-c6032c408010 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:29.639787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef9b3c-9e1f-4c8a-8727-63ce922bd847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:29.641406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef9b3c-9e1f-4c8a-8727-63ce922bd847 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:29.642871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef9b3c-9e1f-4c8a-8727-63ce922bd847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:29.643904 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef9b3c-9e1f-4c8a-8727-63ce922bd847 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:29.646152 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef9b3c-9e1f-4c8a-8727-63ce922bd847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:29.649024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef9b3c-9e1f-4c8a-8727-63ce922bd847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:29.651766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef9b3c-9e1f-4c8a-8727-63ce922bd847 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:29.679425 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81999859-ef4f-48bb-ba61-7aa0cb06e4b0 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:29.680926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-81999859-ef4f-48bb-ba61-7aa0cb06e4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:29.700145 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81999859-ef4f-48bb-ba61-7aa0cb06e4b0 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:29.705249 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 854/1698] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:36:29.709849 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef9b3c-9e1f-4c8a-8727-63ce922bd847 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:29.717473 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfd67a-9382-45b3-a1fd-2aa0b225a44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:29.719852 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfd67a-9382-45b3-a1fd-2aa0b225a44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:29.720166 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfd67a-9382-45b3-a1fd-2aa0b225a44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:29.720451 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfd67a-9382-45b3-a1fd-2aa0b225a44a admin admin] PATH_INFO: `/v3/users/adf109b854c24b348cf5ae1f2bb75526` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:29.723381 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfd67a-9382-45b3-a1fd-2aa0b225a44a admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf109b854c24b348cf5ae1f2bb75526)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:29.728737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfd67a-9382-45b3-a1fd-2aa0b225a44a admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:29.731643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef9b3c-9e1f-4c8a-8727-63ce922bd847 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:29.756983 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c3575-0609-4762-9bfb-63f9cb04eaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:29.757685 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c3575-0609-4762-9bfb-63f9cb04eaaf admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:29.763788 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c3575-0609-4762-9bfb-63f9cb04eaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:29.766097 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c3575-0609-4762-9bfb-63f9cb04eaaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:29.770308 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c3575-0609-4762-9bfb-63f9cb04eaaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:29.774757 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c3575-0609-4762-9bfb-63f9cb04eaaf admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:29.852905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:29.866565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-88bfd67a-9382-45b3-a1fd-2aa0b225a44a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf109b854c24b348cf5ae1f2bb75526'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:29.867361 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-88bfd67a-9382-45b3-a1fd-2aa0b225a44a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf109b854c24b348cf5ae1f2bb75526'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:29.887873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-88bfd67a-9382-45b3-a1fd-2aa0b225a44a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf109b854c24b348cf5ae1f2bb75526'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:29.905475 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 855/1699] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:29 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:29.914864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c3575-0609-4762-9bfb-63f9cb04eaaf admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:29.924122 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-88bfd67a-9382-45b3-a1fd-2aa0b225a44a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf109b854c24b348cf5ae1f2bb75526'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:29.924692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ee1c3575-0609-4762-9bfb-63f9cb04eaaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:29.925129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-88bfd67a-9382-45b3-a1fd-2aa0b225a44a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf109b854c24b348cf5ae1f2bb75526'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:29.970767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 845/1700] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:29 2022] DELETE /identity/v3/users/adf109b854c24b348cf5ae1f2bb75526 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:29.976304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfd67a-9382-45b3-a1fd-2aa0b225a44a admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:29.982387 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-88bfd67a-9382-45b3-a1fd-2aa0b225a44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:30.071796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c3575-0609-4762-9bfb-63f9cb04eaaf admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:30.115470 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfd67a-9382-45b3-a1fd-2aa0b225a44a admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:30.121838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dc3d94-6da2-48c5-9581-625a61cd9dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:30.123189 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc3d94-6da2-48c5-9581-625a61cd9dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:30.123479 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc3d94-6da2-48c5-9581-625a61cd9dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:30.123758 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dc3d94-6da2-48c5-9581-625a61cd9dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:30.124405 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc3d94-6da2-48c5-9581-625a61cd9dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:30.126654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dc3d94-6da2-48c5-9581-625a61cd9dd6 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:30.157917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 846/1701] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:29 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:30.157917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b214e8b-d265-4d03-91d4-7879b46d2b3b None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:30.157917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b214e8b-d265-4d03-91d4-7879b46d2b3b None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:30.157917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b214e8b-d265-4d03-91d4-7879b46d2b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:30.165910 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02616725-3262-4d4f-8b6f-d01aee06bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:30.166761 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02616725-3262-4d4f-8b6f-d01aee06bb7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:30.167233 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02616725-3262-4d4f-8b6f-d01aee06bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:30.167777 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02616725-3262-4d4f-8b6f-d01aee06bb7a admin admin] PATH_INFO: `/v3/projects/23db7f69423641b29656dd860515604d` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:30.170364 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02616725-3262-4d4f-8b6f-d01aee06bb7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=23db7f69423641b29656dd860515604d)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:30.173890 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02616725-3262-4d4f-8b6f-d01aee06bb7a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:30.182519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-6b214e8b-d265-4d03-91d4-7879b46d2b3b None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:30.183920 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6b214e8b-d265-4d03-91d4-7879b46d2b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:30.193229 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 847/1702] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:30.194144 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b214e8b-d265-4d03-91d4-7879b46d2b3b None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:30.212490 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b214e8b-d265-4d03-91d4-7879b46d2b3b None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:30.226680 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f35beb-9035-4ab0-84de-9d248bba233f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:30.227488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f35beb-9035-4ab0-84de-9d248bba233f admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:30.227767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f35beb-9035-4ab0-84de-9d248bba233f admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:30.228221 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f35beb-9035-4ab0-84de-9d248bba233f admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:30.228975 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f35beb-9035-4ab0-84de-9d248bba233f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:30.232364 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f35beb-9035-4ab0-84de-9d248bba233f admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:30.249964 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 848/1703] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:30.250749 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f35beb-9035-4ab0-84de-9d248bba233f admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:30.252989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-66f35beb-9035-4ab0-84de-9d248bba233f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:30.259277 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-02616725-3262-4d4f-8b6f-d01aee06bb7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23db7f69423641b29656dd860515604d', 'request_id': 'req-02616725-3262-4d4f-8b6f-d01aee06bb7a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:30.269977 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-02616725-3262-4d4f-8b6f-d01aee06bb7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23db7f69423641b29656dd860515604d', 'request_id': 'req-02616725-3262-4d4f-8b6f-d01aee06bb7a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:30.287890 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-02616725-3262-4d4f-8b6f-d01aee06bb7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23db7f69423641b29656dd860515604d', 'request_id': 'req-02616725-3262-4d4f-8b6f-d01aee06bb7a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:30.298606 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:30.310087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-02616725-3262-4d4f-8b6f-d01aee06bb7a admin admin] The token cache is being invalidate because project 23db7f69423641b29656dd860515604d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:30.310604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-02616725-3262-4d4f-8b6f-d01aee06bb7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:30.312218 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-02616725-3262-4d4f-8b6f-d01aee06bb7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:30.314309 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 856/1704] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:29 2022] DELETE /identity/v3/projects/23db7f69423641b29656dd860515604d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:30.315041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02616725-3262-4d4f-8b6f-d01aee06bb7a admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:30.316969 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-02616725-3262-4d4f-8b6f-d01aee06bb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:30.343465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f35beb-9035-4ab0-84de-9d248bba233f admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:30.386224 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02616725-3262-4d4f-8b6f-d01aee06bb7a admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:30.391144 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b75328-2293-43ef-9171-f5f1db782321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:30.392212 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b75328-2293-43ef-9171-f5f1db782321 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:30.392494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b75328-2293-43ef-9171-f5f1db782321 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:30.392919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b75328-2293-43ef-9171-f5f1db782321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:30.394664 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-44b75328-2293-43ef-9171-f5f1db782321 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:30.406395 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:30.420490 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9613d4-08c2-4582-aea8-73ced1219756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:30.421662 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9613d4-08c2-4582-aea8-73ced1219756 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:30.422103 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9613d4-08c2-4582-aea8-73ced1219756 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:30.422591 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9613d4-08c2-4582-aea8-73ced1219756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:30.424884 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0c9613d4-08c2-4582-aea8-73ced1219756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:30.467498 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b75328-2293-43ef-9171-f5f1db782321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:30.468979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b75328-2293-43ef-9171-f5f1db782321 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:30.479277 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 857/1705] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:30 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:30.480296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b75328-2293-43ef-9171-f5f1db782321 service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:30.481681 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-44b75328-2293-43ef-9171-f5f1db782321 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:30.509108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9613d4-08c2-4582-aea8-73ced1219756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:30.510644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9613d4-08c2-4582-aea8-73ced1219756 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:30.527163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 849/1706] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:30.528085 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9613d4-08c2-4582-aea8-73ced1219756 service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:30.529524 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0c9613d4-08c2-4582-aea8-73ced1219756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:30.555845 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9613d4-08c2-4582-aea8-73ced1219756 service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:30.562926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a9717-5bb0-4b61-a67d-1a930e85c291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:30.564450 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a9717-5bb0-4b61-a67d-1a930e85c291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:30.564830 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a9717-5bb0-4b61-a67d-1a930e85c291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:30.565355 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a9717-5bb0-4b61-a67d-1a930e85c291 admin admin] PATH_INFO: `/v3/users/83db80b02bf64c9aaffd659c54628b66` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:30.567273 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a9717-5bb0-4b61-a67d-1a930e85c291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83db80b02bf64c9aaffd659c54628b66)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:30.569627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a9717-5bb0-4b61-a67d-1a930e85c291 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:30.584421 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b75328-2293-43ef-9171-f5f1db782321 service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:30.596873 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2fb30-9235-4e50-ac99-d5a5e6ff7fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:30.597772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2fb30-9235-4e50-ac99-d5a5e6ff7fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:30.598206 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2fb30-9235-4e50-ac99-d5a5e6ff7fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:30.598635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2fb30-9235-4e50-ac99-d5a5e6ff7fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:30.599516 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2fb30-9235-4e50-ac99-d5a5e6ff7fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:30.602684 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2fb30-9235-4e50-ac99-d5a5e6ff7fb3 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:30.628920 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 858/1707] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:30.633120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2fb30-9235-4e50-ac99-d5a5e6ff7fb3 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:30.667097 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2fb30-9235-4e50-ac99-d5a5e6ff7fb3 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:30.677580 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f04caa-f98f-45ec-a0e0-d265a4d5d51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:30.678067 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f04caa-f98f-45ec-a0e0-d265a4d5d51f admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:30.678421 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f04caa-f98f-45ec-a0e0-d265a4d5d51f admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:30.678631 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f04caa-f98f-45ec-a0e0-d265a4d5d51f admin admin] PATH_INFO: `/v3/projects/69be329ef33a46fd9ec471c967f89145/users/2465fc5f6fef4d14ba6921ef724eab04/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:30.680687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-ec0a9717-5bb0-4b61-a67d-1a930e85c291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83db80b02bf64c9aaffd659c54628b66'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:30.682353 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-ec0a9717-5bb0-4b61-a67d-1a930e85c291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83db80b02bf64c9aaffd659c54628b66'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:30.698594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-ec0a9717-5bb0-4b61-a67d-1a930e85c291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83db80b02bf64c9aaffd659c54628b66'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:30.704797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f04caa-f98f-45ec-a0e0-d265a4d5d51f admin admin] RBAC: Authorizing `identity:create_grant(project_id=69be329ef33a46fd9ec471c967f89145, user_id=2465fc5f6fef4d14ba6921ef724eab04, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:30.709554 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f04caa-f98f-45ec-a0e0-d265a4d5d51f admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:30.734417 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-ec0a9717-5bb0-4b61-a67d-1a930e85c291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83db80b02bf64c9aaffd659c54628b66'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:30.735495 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-ec0a9717-5bb0-4b61-a67d-1a930e85c291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83db80b02bf64c9aaffd659c54628b66'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:30.755530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 859/1708] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:30 2022] PUT /identity/v3/projects/69be329ef33a46fd9ec471c967f89145/users/2465fc5f6fef4d14ba6921ef724eab04/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:36:30.766536 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab7b05-d6e8-4e89-8cd3-7823dac48269 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:30.766858 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab7b05-d6e8-4e89-8cd3-7823dac48269 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:30.767131 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab7b05-d6e8-4e89-8cd3-7823dac48269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:30.768356 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 850/1709] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:30 2022] DELETE /identity/v3/users/83db80b02bf64c9aaffd659c54628b66 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:30.842518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c6ab7b05-d6e8-4e89-8cd3-7823dac48269 None None] MFA Rules not processed for user `2465fc5f6fef4d14ba6921ef724eab04`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:30.844362 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c6ab7b05-d6e8-4e89-8cd3-7823dac48269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:30.860768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:31.035779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 860/1710] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:31.048328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a9717-5bb0-4b61-a67d-1a930e85c291 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:31.050007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-ec0a9717-5bb0-4b61-a67d-1a930e85c291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:31.139733 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab7b05-d6e8-4e89-8cd3-7823dac48269 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:31.141483 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c6ab7b05-d6e8-4e89-8cd3-7823dac48269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:31.146026 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a9717-5bb0-4b61-a67d-1a930e85c291 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:31.156599 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa473d49-c631-47be-bfa6-a9a71fcc8c4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:31.157231 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa473d49-c631-47be-bfa6-a9a71fcc8c4f service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:31.157518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa473d49-c631-47be-bfa6-a9a71fcc8c4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:31.157793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa473d49-c631-47be-bfa6-a9a71fcc8c4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:31.172682 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa473d49-c631-47be-bfa6-a9a71fcc8c4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:31.176039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa473d49-c631-47be-bfa6-a9a71fcc8c4f service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:31.200636 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 851/1711] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:31.267742 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab7b05-d6e8-4e89-8cd3-7823dac48269 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:31.272602 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1971a5a-59fb-409f-9502-29efed2c2bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:31.273238 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1971a5a-59fb-409f-9502-29efed2c2bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:31.273514 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1971a5a-59fb-409f-9502-29efed2c2bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:31.273780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1971a5a-59fb-409f-9502-29efed2c2bf5 admin admin] PATH_INFO: `/v3/projects/bbcae1114a67439f959fcd34e9ea7550` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:31.274909 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1971a5a-59fb-409f-9502-29efed2c2bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbcae1114a67439f959fcd34e9ea7550)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:31.276868 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1971a5a-59fb-409f-9502-29efed2c2bf5 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:31.375826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f1971a5a-59fb-409f-9502-29efed2c2bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbcae1114a67439f959fcd34e9ea7550', 'request_id': 'req-f1971a5a-59fb-409f-9502-29efed2c2bf5'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:31.392041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f1971a5a-59fb-409f-9502-29efed2c2bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbcae1114a67439f959fcd34e9ea7550', 'request_id': 'req-f1971a5a-59fb-409f-9502-29efed2c2bf5'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:31.402610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f1971a5a-59fb-409f-9502-29efed2c2bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbcae1114a67439f959fcd34e9ea7550', 'request_id': 'req-f1971a5a-59fb-409f-9502-29efed2c2bf5'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:31.427758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f1971a5a-59fb-409f-9502-29efed2c2bf5 admin admin] The token cache is being invalidate because project bbcae1114a67439f959fcd34e9ea7550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:31.428169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f1971a5a-59fb-409f-9502-29efed2c2bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:31.431410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f1971a5a-59fb-409f-9502-29efed2c2bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:31.437256 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 861/1712] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:31 2022] DELETE /identity/v3/projects/bbcae1114a67439f959fcd34e9ea7550 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:36:31.437452 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa473d49-c631-47be-bfa6-a9a71fcc8c4f service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:31.452310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa473d49-c631-47be-bfa6-a9a71fcc8c4f service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:31.466557 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:31.530628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1971a5a-59fb-409f-9502-29efed2c2bf5 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:31.532319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f1971a5a-59fb-409f-9502-29efed2c2bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:31.564647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485c9ef-bc43-4b69-b366-ea185909ec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:31.565346 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485c9ef-bc43-4b69-b366-ea185909ec01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:31.565682 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485c9ef-bc43-4b69-b366-ea185909ec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:31.565997 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485c9ef-bc43-4b69-b366-ea185909ec01 admin admin] PATH_INFO: `/v3/users/56202d01210742358b24b020f7bc1eef` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:31.568434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485c9ef-bc43-4b69-b366-ea185909ec01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56202d01210742358b24b020f7bc1eef)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:31.570602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485c9ef-bc43-4b69-b366-ea185909ec01 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:31.627773 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:31.646912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1485c9ef-bc43-4b69-b366-ea185909ec01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56202d01210742358b24b020f7bc1eef'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:31.648893 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1485c9ef-bc43-4b69-b366-ea185909ec01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56202d01210742358b24b020f7bc1eef'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:31.658706 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1485c9ef-bc43-4b69-b366-ea185909ec01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56202d01210742358b24b020f7bc1eef'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:31.676066 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1485c9ef-bc43-4b69-b366-ea185909ec01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56202d01210742358b24b020f7bc1eef'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:31.676745 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1485c9ef-bc43-4b69-b366-ea185909ec01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56202d01210742358b24b020f7bc1eef'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:31.689727 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1971a5a-59fb-409f-9502-29efed2c2bf5 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:31.703083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 852/1713] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:31 2022] DELETE /identity/v3/users/56202d01210742358b24b020f7bc1eef => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:31.714496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1485541-e4b2-4098-8164-db7b8c885ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:31.716328 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1485541-e4b2-4098-8164-db7b8c885ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:31.716624 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1485541-e4b2-4098-8164-db7b8c885ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:31.718362 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1485541-e4b2-4098-8164-db7b8c885ab8 admin admin] PATH_INFO: `/v3/projects/bb1eff1b69c34e3a9be466f6359fa8ec` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:31.721914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1485541-e4b2-4098-8164-db7b8c885ab8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb1eff1b69c34e3a9be466f6359fa8ec)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:31.726492 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1485541-e4b2-4098-8164-db7b8c885ab8 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:31.811891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-a1485541-e4b2-4098-8164-db7b8c885ab8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb1eff1b69c34e3a9be466f6359fa8ec', 'request_id': 'req-a1485541-e4b2-4098-8164-db7b8c885ab8'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:31.828816 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-a1485541-e4b2-4098-8164-db7b8c885ab8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb1eff1b69c34e3a9be466f6359fa8ec', 'request_id': 'req-a1485541-e4b2-4098-8164-db7b8c885ab8'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:31.853325 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-a1485541-e4b2-4098-8164-db7b8c885ab8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb1eff1b69c34e3a9be466f6359fa8ec', 'request_id': 'req-a1485541-e4b2-4098-8164-db7b8c885ab8'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:31.869525 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-a1485541-e4b2-4098-8164-db7b8c885ab8 admin admin] The token cache is being invalidate because project bb1eff1b69c34e3a9be466f6359fa8ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:31.870566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-a1485541-e4b2-4098-8164-db7b8c885ab8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:31.870930 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-a1485541-e4b2-4098-8164-db7b8c885ab8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:31.874072 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 862/1714] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:31 2022] DELETE /identity/v3/projects/bb1eff1b69c34e3a9be466f6359fa8ec => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:31.879667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028d139-730a-4709-a9c2-a038f0e156f4 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:31.880086 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028d139-730a-4709-a9c2-a038f0e156f4 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:31.880615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028d139-730a-4709-a9c2-a038f0e156f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:31.913548 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-3028d139-730a-4709-a9c2-a038f0e156f4 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:31.914934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-3028d139-730a-4709-a9c2-a038f0e156f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:32.026764 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 853/1715] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:32.034550 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a38f7-f56d-4bea-9a13-6e22a2169168 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:32.035439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a38f7-f56d-4bea-9a13-6e22a2169168 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:32.035803 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a38f7-f56d-4bea-9a13-6e22a2169168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:32.085152 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-171a38f7-f56d-4bea-9a13-6e22a2169168 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:32.087603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-171a38f7-f56d-4bea-9a13-6e22a2169168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:32.116228 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 863/1716] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:32.119690 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028d139-730a-4709-a9c2-a038f0e156f4 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:32.134703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028d139-730a-4709-a9c2-a038f0e156f4 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:32.147981 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feef823-0181-4fa8-95af-1751fa4d5a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:32.149185 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef823-0181-4fa8-95af-1751fa4d5a3b admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:32.149185 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef823-0181-4fa8-95af-1751fa4d5a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:32.149185 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef823-0181-4fa8-95af-1751fa4d5a3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:32.150017 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feef823-0181-4fa8-95af-1751fa4d5a3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:32.150384 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feef823-0181-4fa8-95af-1751fa4d5a3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:32.152126 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feef823-0181-4fa8-95af-1751fa4d5a3b admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:32.183994 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 854/1717] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:36:32.185298 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a38f7-f56d-4bea-9a13-6e22a2169168 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:32.201428 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a38f7-f56d-4bea-9a13-6e22a2169168 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:32.222155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df67ff-ccd7-4f6f-94c4-fc746a3155a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:32.222885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df67ff-ccd7-4f6f-94c4-fc746a3155a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:32.223273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df67ff-ccd7-4f6f-94c4-fc746a3155a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:32.223625 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df67ff-ccd7-4f6f-94c4-fc746a3155a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:32.224665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df67ff-ccd7-4f6f-94c4-fc746a3155a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:32.232290 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df67ff-ccd7-4f6f-94c4-fc746a3155a2 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:32.285206 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 864/1718] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:32 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:32.286738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feef823-0181-4fa8-95af-1751fa4d5a3b admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:32.299989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df67ff-ccd7-4f6f-94c4-fc746a3155a2 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:32.309895 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feef823-0181-4fa8-95af-1751fa4d5a3b admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:32.313828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-86df67ff-ccd7-4f6f-94c4-fc746a3155a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:32.347313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:32.410694 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea22d5-583c-40f9-9bd3-449d78faa718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:32.411337 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea22d5-583c-40f9-9bd3-449d78faa718 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:32.411660 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea22d5-583c-40f9-9bd3-449d78faa718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:32.411958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea22d5-583c-40f9-9bd3-449d78faa718 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:32.412658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea22d5-583c-40f9-9bd3-449d78faa718 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:32.414723 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea22d5-583c-40f9-9bd3-449d78faa718 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:32.418571 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df67ff-ccd7-4f6f-94c4-fc746a3155a2 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:32.423970 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8334af-8a59-4ac2-a2f6-c884073060e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:32.424879 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8334af-8a59-4ac2-a2f6-c884073060e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:32.425102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8334af-8a59-4ac2-a2f6-c884073060e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:32.425869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8334af-8a59-4ac2-a2f6-c884073060e6 admin admin] PATH_INFO: `/v3/projects/0be7cbc7d910416bbb5634462aef3a88` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:32.427324 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8334af-8a59-4ac2-a2f6-c884073060e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be7cbc7d910416bbb5634462aef3a88)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:32.429606 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8334af-8a59-4ac2-a2f6-c884073060e6 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:32.439207 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 855/1719] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:32 2022] POST /identity/v3/users => generated 285 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:36:32.443499 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea22d5-583c-40f9-9bd3-449d78faa718 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:32.454203 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea22d5-583c-40f9-9bd3-449d78faa718 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:32.459976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab6d57-3b4a-44af-a30c-7c34f16d5884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:32.460644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab6d57-3b4a-44af-a30c-7c34f16d5884 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:32.460953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab6d57-3b4a-44af-a30c-7c34f16d5884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:32.461223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab6d57-3b4a-44af-a30c-7c34f16d5884 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:32.461992 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab6d57-3b4a-44af-a30c-7c34f16d5884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:32.463868 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab6d57-3b4a-44af-a30c-7c34f16d5884 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:32.477074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 856/1720] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:36:32.481771 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab6d57-3b4a-44af-a30c-7c34f16d5884 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:32.485250 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:32.491979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-8e8334af-8a59-4ac2-a2f6-c884073060e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be7cbc7d910416bbb5634462aef3a88', 'request_id': 'req-8e8334af-8a59-4ac2-a2f6-c884073060e6'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:32.493620 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab6d57-3b4a-44af-a30c-7c34f16d5884 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:32.505957 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-8e8334af-8a59-4ac2-a2f6-c884073060e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be7cbc7d910416bbb5634462aef3a88', 'request_id': 'req-8e8334af-8a59-4ac2-a2f6-c884073060e6'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:32.515908 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-8e8334af-8a59-4ac2-a2f6-c884073060e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be7cbc7d910416bbb5634462aef3a88', 'request_id': 'req-8e8334af-8a59-4ac2-a2f6-c884073060e6'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:32.529718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-8e8334af-8a59-4ac2-a2f6-c884073060e6 admin admin] The token cache is being invalidate because project 0be7cbc7d910416bbb5634462aef3a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:32.530323 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-8e8334af-8a59-4ac2-a2f6-c884073060e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:32.531028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-8e8334af-8a59-4ac2-a2f6-c884073060e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:32.533119 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 865/1721] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:32 2022] DELETE /identity/v3/projects/0be7cbc7d910416bbb5634462aef3a88 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:36:32.538096 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2655f-7173-41d1-962d-31858d63c393 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:32.538381 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2655f-7173-41d1-962d-31858d63c393 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:32.538739 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2655f-7173-41d1-962d-31858d63c393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:32.561261 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-e9e2655f-7173-41d1-962d-31858d63c393 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:32.562489 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e9e2655f-7173-41d1-962d-31858d63c393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:32.569504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1b7f8-018a-44d1-96dd-5d9ea42e7224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:32.570230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1b7f8-018a-44d1-96dd-5d9ea42e7224 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:32.570580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1b7f8-018a-44d1-96dd-5d9ea42e7224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:32.570924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1b7f8-018a-44d1-96dd-5d9ea42e7224 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:32.571745 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1b7f8-018a-44d1-96dd-5d9ea42e7224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:32.573337 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1b7f8-018a-44d1-96dd-5d9ea42e7224 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:32.585023 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 857/1722] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:36:32.588869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1b7f8-018a-44d1-96dd-5d9ea42e7224 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:32.591415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-93f1b7f8-018a-44d1-96dd-5d9ea42e7224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:32.607567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1b7f8-018a-44d1-96dd-5d9ea42e7224 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:32.612680 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68dba4-1546-47f4-a2cc-2254756e47ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:32.613352 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68dba4-1546-47f4-a2cc-2254756e47ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:32.613762 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68dba4-1546-47f4-a2cc-2254756e47ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:32.614049 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68dba4-1546-47f4-a2cc-2254756e47ef admin admin] PATH_INFO: `/v3/projects/05d33a94e26444efb19a845227fac8ba/users/0efea46493194e97b40902898a905139/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:32.632332 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68dba4-1546-47f4-a2cc-2254756e47ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=05d33a94e26444efb19a845227fac8ba, user_id=0efea46493194e97b40902898a905139, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:32.635392 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68dba4-1546-47f4-a2cc-2254756e47ef admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:32.642327 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 866/1723] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:36:32.644381 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a03e85-a828-4bc9-b317-de4949d1edb1 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:32.644772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a03e85-a828-4bc9-b317-de4949d1edb1 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:32.645190 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a03e85-a828-4bc9-b317-de4949d1edb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:32.657849 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 858/1724] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:32 2022] PUT /identity/v3/projects/05d33a94e26444efb19a845227fac8ba/users/0efea46493194e97b40902898a905139/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:36:32.668344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-64a03e85-a828-4bc9-b317-de4949d1edb1 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:32.669285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04deab69-d3f1-4b57-9bc9-269efc64b9fd None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:32.669577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04deab69-d3f1-4b57-9bc9-269efc64b9fd None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:32.669804 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-64a03e85-a828-4bc9-b317-de4949d1edb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:32.669912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04deab69-d3f1-4b57-9bc9-269efc64b9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:32.701597 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-04deab69-d3f1-4b57-9bc9-269efc64b9fd None None] MFA Rules not processed for user `0efea46493194e97b40902898a905139`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:32.702828 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-04deab69-d3f1-4b57-9bc9-269efc64b9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:32.745045 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 867/1725] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:36:32.749862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a03e85-a828-4bc9-b317-de4949d1edb1 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:32.762014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a03e85-a828-4bc9-b317-de4949d1edb1 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:32.766584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:32.768778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fa85f-ff72-46c7-9522-a1a29fbc4c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:32.769539 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fa85f-ff72-46c7-9522-a1a29fbc4c10 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:32.769823 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fa85f-ff72-46c7-9522-a1a29fbc4c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:32.770097 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fa85f-ff72-46c7-9522-a1a29fbc4c10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:32.770995 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90fa85f-ff72-46c7-9522-a1a29fbc4c10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:32.771118 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90fa85f-ff72-46c7-9522-a1a29fbc4c10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:32.772802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90fa85f-ff72-46c7-9522-a1a29fbc4c10 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:32.779182 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 859/1726] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:36:32.783346 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04deab69-d3f1-4b57-9bc9-269efc64b9fd None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:32.786704 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 868/1727] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:36:32.790769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fa85f-ff72-46c7-9522-a1a29fbc4c10 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:32.797392 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04deab69-d3f1-4b57-9bc9-269efc64b9fd None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:32.802717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fa85f-ff72-46c7-9522-a1a29fbc4c10 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:32.807750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff035be-306f-47b2-985d-bf5031f15e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:32.807922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22343a9-2f72-40eb-aff7-d8a5aad523e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:32.809036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff035be-306f-47b2-985d-bf5031f15e57 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:32.809146 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22343a9-2f72-40eb-aff7-d8a5aad523e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:32.809315 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff035be-306f-47b2-985d-bf5031f15e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:32.809586 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff035be-306f-47b2-985d-bf5031f15e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:32.809880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22343a9-2f72-40eb-aff7-d8a5aad523e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:32.810229 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff035be-306f-47b2-985d-bf5031f15e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:32.810338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22343a9-2f72-40eb-aff7-d8a5aad523e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:32.810942 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22343a9-2f72-40eb-aff7-d8a5aad523e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:32.812654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff035be-306f-47b2-985d-bf5031f15e57 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:32.813344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22343a9-2f72-40eb-aff7-d8a5aad523e6 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:32.850490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 869/1728] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:32 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:36:32.855153 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 860/1729] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:32 2022] POST /identity/v3/projects => generated 369 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:36:32.859954 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22343a9-2f72-40eb-aff7-d8a5aad523e6 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:32.860253 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff035be-306f-47b2-985d-bf5031f15e57 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:32.913519 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:32.957719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff035be-306f-47b2-985d-bf5031f15e57 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:32.963857 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc65e7-3a45-4365-a9c8-16505335cd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:32.964625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc65e7-3a45-4365-a9c8-16505335cd92 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:32.965075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc65e7-3a45-4365-a9c8-16505335cd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:32.965769 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc65e7-3a45-4365-a9c8-16505335cd92 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:32.966516 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc65e7-3a45-4365-a9c8-16505335cd92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:32.968611 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc65e7-3a45-4365-a9c8-16505335cd92 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:32.982646 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22343a9-2f72-40eb-aff7-d8a5aad523e6 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:32.990466 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f598c1-0e91-4994-a7e4-0688ee6f8654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:32.991951 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f598c1-0e91-4994-a7e4-0688ee6f8654 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:32.992364 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f598c1-0e91-4994-a7e4-0688ee6f8654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:32.992594 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f598c1-0e91-4994-a7e4-0688ee6f8654 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:33.004301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f598c1-0e91-4994-a7e4-0688ee6f8654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:33.006259 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f598c1-0e91-4994-a7e4-0688ee6f8654 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:33.009610 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 861/1730] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:32 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:33.010911 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc65e7-3a45-4365-a9c8-16505335cd92 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:33.038807 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc65e7-3a45-4365-a9c8-16505335cd92 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:33.052032 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a297a-c51f-4017-b198-b1348eeff317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:33.058874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a297a-c51f-4017-b198-b1348eeff317 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:33.059431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a297a-c51f-4017-b198-b1348eeff317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:33.060083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a297a-c51f-4017-b198-b1348eeff317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:33.060938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a297a-c51f-4017-b198-b1348eeff317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:33.063380 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 870/1731] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:32 2022] POST /identity/v3/users => generated 284 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:33.064289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f598c1-0e91-4994-a7e4-0688ee6f8654 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:33.064729 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a297a-c51f-4017-b198-b1348eeff317 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:33.083846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f598c1-0e91-4994-a7e4-0688ee6f8654 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:33.090644 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd0b6d-fc4f-44af-8611-d3f3661ca449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:33.095514 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 862/1732] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:33.096081 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a297a-c51f-4017-b198-b1348eeff317 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:33.097327 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd0b6d-fc4f-44af-8611-d3f3661ca449 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:33.097611 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd0b6d-fc4f-44af-8611-d3f3661ca449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:33.097892 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd0b6d-fc4f-44af-8611-d3f3661ca449 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:33.098558 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd0b6d-fc4f-44af-8611-d3f3661ca449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:33.105014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd0b6d-fc4f-44af-8611-d3f3661ca449 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:33.113167 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a297a-c51f-4017-b198-b1348eeff317 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:33.129546 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 871/1733] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:33.129677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ba2ee-2991-4106-9808-f2fccee925dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:33.130440 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ba2ee-2991-4106-9808-f2fccee925dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:33.130618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd0b6d-fc4f-44af-8611-d3f3661ca449 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:33.130723 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ba2ee-2991-4106-9808-f2fccee925dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:33.130996 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ba2ee-2991-4106-9808-f2fccee925dd admin admin] PATH_INFO: `/v3/projects/1360f7f84a134c3abe420bb5b1860a13/users/a0308b31ceef4a0885be3fd79dfc69fa/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:33.144300 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd0b6d-fc4f-44af-8611-d3f3661ca449 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:33.151130 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7d01a-7c8f-4ceb-88c6-6a17dd992b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:33.151891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7d01a-7c8f-4ceb-88c6-6a17dd992b42 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:33.152235 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7d01a-7c8f-4ceb-88c6-6a17dd992b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:33.152515 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7d01a-7c8f-4ceb-88c6-6a17dd992b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:33.154069 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7d01a-7c8f-4ceb-88c6-6a17dd992b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:33.155014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7d01a-7c8f-4ceb-88c6-6a17dd992b42 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:33.174978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ba2ee-2991-4106-9808-f2fccee925dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1360f7f84a134c3abe420bb5b1860a13, user_id=a0308b31ceef4a0885be3fd79dfc69fa, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:33.175855 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 872/1734] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:36:33.180135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ba2ee-2991-4106-9808-f2fccee925dd admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:33.194571 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7d01a-7c8f-4ceb-88c6-6a17dd992b42 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:33.208478 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 863/1735] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:33 2022] PUT /identity/v3/projects/1360f7f84a134c3abe420bb5b1860a13/users/a0308b31ceef4a0885be3fd79dfc69fa/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:33.209482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ba2ee-2991-4106-9808-f2fccee925dd admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:33.225382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7d01a-7c8f-4ceb-88c6-6a17dd992b42 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:33.323486 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8a4cc-7c96-4c13-b46f-95b21afd00f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:33.325454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a4cc-7c96-4c13-b46f-95b21afd00f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:33.325746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a4cc-7c96-4c13-b46f-95b21afd00f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:33.326109 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8a4cc-7c96-4c13-b46f-95b21afd00f8 admin admin] PATH_INFO: `/v3/projects/1ee3e2a0abae4cca9c74a462fee70bcf/users/ba596365374747e9a209b5b57cc9ff83/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:33.329036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ba2ee-2991-4106-9808-f2fccee925dd admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:33.341416 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6836702-9834-459f-9d25-d0074c0de8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:33.342074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836702-9834-459f-9d25-d0074c0de8ae admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:33.342349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836702-9834-459f-9d25-d0074c0de8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:33.342617 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6836702-9834-459f-9d25-d0074c0de8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:33.344076 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6836702-9834-459f-9d25-d0074c0de8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:33.346255 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6836702-9834-459f-9d25-d0074c0de8ae admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:33.354596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8a4cc-7c96-4c13-b46f-95b21afd00f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee3e2a0abae4cca9c74a462fee70bcf, user_id=ba596365374747e9a209b5b57cc9ff83, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:33.364017 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8a4cc-7c96-4c13-b46f-95b21afd00f8 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:33.365829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 864/1736] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:33.368689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6836702-9834-459f-9d25-d0074c0de8ae admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:33.381423 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6836702-9834-459f-9d25-d0074c0de8ae admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:33.405169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 873/1737] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:33 2022] PUT /identity/v3/projects/1ee3e2a0abae4cca9c74a462fee70bcf/users/ba596365374747e9a209b5b57cc9ff83/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:33.407306 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01722a-fb8b-434c-b1a6-44ce8391d9d7 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:33.407602 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01722a-fb8b-434c-b1a6-44ce8391d9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:33.407909 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01722a-fb8b-434c-b1a6-44ce8391d9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:33.416558 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:33.515982 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-8a01722a-fb8b-434c-b1a6-44ce8391d9d7 None None] MFA Rules not processed for user `ba596365374747e9a209b5b57cc9ff83`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:33.521352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8a01722a-fb8b-434c-b1a6-44ce8391d9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:33.559740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256930e-a0d3-400a-8ad8-143695fdcb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:33.561018 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256930e-a0d3-400a-8ad8-143695fdcb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:33.561285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256930e-a0d3-400a-8ad8-143695fdcb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:33.561878 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256930e-a0d3-400a-8ad8-143695fdcb12 admin admin] PATH_INFO: `/v3/projects/1360f7f84a134c3abe420bb5b1860a13/users/a0308b31ceef4a0885be3fd79dfc69fa/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:33.567487 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256930e-a0d3-400a-8ad8-143695fdcb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1360f7f84a134c3abe420bb5b1860a13, user_id=a0308b31ceef4a0885be3fd79dfc69fa, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:33.570447 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256930e-a0d3-400a-8ad8-143695fdcb12 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:33.614045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 865/1738] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:33 2022] PUT /identity/v3/projects/1360f7f84a134c3abe420bb5b1860a13/users/a0308b31ceef4a0885be3fd79dfc69fa/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:33.626813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8904e-7e5d-41a8-be9a-bddc1dee3cf6 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:33.627225 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8904e-7e5d-41a8-be9a-bddc1dee3cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:33.627709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8904e-7e5d-41a8-be9a-bddc1dee3cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:33.659596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 874/1739] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:33.663694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01722a-fb8b-434c-b1a6-44ce8391d9d7 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:33.677327 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01722a-fb8b-434c-b1a6-44ce8391d9d7 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:33.686736 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-00a8904e-7e5d-41a8-be9a-bddc1dee3cf6 None None] MFA Rules not processed for user `a0308b31ceef4a0885be3fd79dfc69fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:33.688727 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-00a8904e-7e5d-41a8-be9a-bddc1dee3cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:33.706882 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:33.799825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97504c-f73c-4cb7-8d2f-ef594cd0a46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:33.800555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97504c-f73c-4cb7-8d2f-ef594cd0a46d admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:33.800891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97504c-f73c-4cb7-8d2f-ef594cd0a46d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:33.801280 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97504c-f73c-4cb7-8d2f-ef594cd0a46d admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:33.802177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97504c-f73c-4cb7-8d2f-ef594cd0a46d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:33.806184 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97504c-f73c-4cb7-8d2f-ef594cd0a46d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:33.865268 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 875/1740] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:33 2022] POST /identity/v3/projects => generated 365 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:33.869729 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97504c-f73c-4cb7-8d2f-ef594cd0a46d admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:33.893502 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 866/1741] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:33 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:36:33.906576 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8904e-7e5d-41a8-be9a-bddc1dee3cf6 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:33.909369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-00a8904e-7e5d-41a8-be9a-bddc1dee3cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:34.002689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8904e-7e5d-41a8-be9a-bddc1dee3cf6 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:34.028371 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97504c-f73c-4cb7-8d2f-ef594cd0a46d admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:34.041787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac8dbb-1ddb-4152-a2a3-a739b5a7219d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:34.042493 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac8dbb-1ddb-4152-a2a3-a739b5a7219d admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:34.047134 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac8dbb-1ddb-4152-a2a3-a739b5a7219d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:34.047134 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac8dbb-1ddb-4152-a2a3-a739b5a7219d admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:34.047134 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac8dbb-1ddb-4152-a2a3-a739b5a7219d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:34.052131 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac8dbb-1ddb-4152-a2a3-a739b5a7219d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:34.086205 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 876/1742] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:33 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:34.087392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac8dbb-1ddb-4152-a2a3-a739b5a7219d admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:34.094991 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3256c6-ff69-4d15-b716-9a000258e987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:34.095696 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3256c6-ff69-4d15-b716-9a000258e987 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:34.096044 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3256c6-ff69-4d15-b716-9a000258e987 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:34.096385 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3256c6-ff69-4d15-b716-9a000258e987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:34.103265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac8dbb-1ddb-4152-a2a3-a739b5a7219d admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:34.110866 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc4810-9cc8-4313-9cce-2f3eb2479424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:34.111679 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc4810-9cc8-4313-9cce-2f3eb2479424 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:34.112071 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc4810-9cc8-4313-9cce-2f3eb2479424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:34.112490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc4810-9cc8-4313-9cce-2f3eb2479424 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:34.113378 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc4810-9cc8-4313-9cce-2f3eb2479424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:34.115195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc4810-9cc8-4313-9cce-2f3eb2479424 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:34.115547 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:34.146260 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 877/1743] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:34.156535 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc4810-9cc8-4313-9cce-2f3eb2479424 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:34.169111 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc4810-9cc8-4313-9cce-2f3eb2479424 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:34.175720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2460e-5910-499b-a09c-c3aae965bc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:34.176852 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2460e-5910-499b-a09c-c3aae965bc0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:34.177712 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2460e-5910-499b-a09c-c3aae965bc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:34.178423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2460e-5910-499b-a09c-c3aae965bc0f admin admin] PATH_INFO: `/v3/projects/3121735260134ea09a5d03441aed7d11/users/b3dcaa14de9d41faa04c712b72e38fe1/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:34.188782 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3256c6-ff69-4d15-b716-9a000258e987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:34.190383 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3256c6-ff69-4d15-b716-9a000258e987 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:34.197494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2460e-5910-499b-a09c-c3aae965bc0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3121735260134ea09a5d03441aed7d11, user_id=b3dcaa14de9d41faa04c712b72e38fe1, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:34.201664 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2460e-5910-499b-a09c-c3aae965bc0f admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:34.210432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 867/1744] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:33 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:34.223000 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 878/1745] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:34 2022] PUT /identity/v3/projects/3121735260134ea09a5d03441aed7d11/users/b3dcaa14de9d41faa04c712b72e38fe1/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:34.227238 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3256c6-ff69-4d15-b716-9a000258e987 service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:34.256257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3256c6-ff69-4d15-b716-9a000258e987 service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:34.330152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234ae90-240b-463b-a2ae-3bb2fb2c2a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:34.330787 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234ae90-240b-463b-a2ae-3bb2fb2c2a87 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:34.331121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234ae90-240b-463b-a2ae-3bb2fb2c2a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:34.331400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234ae90-240b-463b-a2ae-3bb2fb2c2a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:34.332056 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234ae90-240b-463b-a2ae-3bb2fb2c2a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:34.333662 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234ae90-240b-463b-a2ae-3bb2fb2c2a87 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:34.351345 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 868/1746] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:34.352646 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2460e-5910-499b-a09c-c3aae965bc0f admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:34.369509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2460e-5910-499b-a09c-c3aae965bc0f admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:34.377158 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23090f63-9f9c-4eba-bace-b22d07c070e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:34.377847 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23090f63-9f9c-4eba-bace-b22d07c070e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:34.378133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23090f63-9f9c-4eba-bace-b22d07c070e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:34.378522 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23090f63-9f9c-4eba-bace-b22d07c070e0 admin admin] PATH_INFO: `/v3/projects/3121735260134ea09a5d03441aed7d11/users/b3dcaa14de9d41faa04c712b72e38fe1/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:34.380780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23090f63-9f9c-4eba-bace-b22d07c070e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3121735260134ea09a5d03441aed7d11, user_id=b3dcaa14de9d41faa04c712b72e38fe1, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:34.383471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23090f63-9f9c-4eba-bace-b22d07c070e0 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:34.403731 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 879/1747] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:34 2022] PUT /identity/v3/projects/3121735260134ea09a5d03441aed7d11/users/b3dcaa14de9d41faa04c712b72e38fe1/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:34.413822 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d6b37-1c52-4be1-8b86-538c40bf0ef9 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:34.414195 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d6b37-1c52-4be1-8b86-538c40bf0ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:34.414617 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d6b37-1c52-4be1-8b86-538c40bf0ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:34.450756 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-719d6b37-1c52-4be1-8b86-538c40bf0ef9 None None] MFA Rules not processed for user `b3dcaa14de9d41faa04c712b72e38fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:34.452294 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-719d6b37-1c52-4be1-8b86-538c40bf0ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:34.547237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 869/1748] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:34.563941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23090f63-9f9c-4eba-bace-b22d07c070e0 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:34.678052 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:34.688992 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23090f63-9f9c-4eba-bace-b22d07c070e0 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:34.697465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff299ec-cc5d-4366-ab24-ffeb2f7a41b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:34.698125 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff299ec-cc5d-4366-ab24-ffeb2f7a41b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:34.699757 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff299ec-cc5d-4366-ab24-ffeb2f7a41b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:34.700394 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff299ec-cc5d-4366-ab24-ffeb2f7a41b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:34.712401 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff299ec-cc5d-4366-ab24-ffeb2f7a41b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:34.714511 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff299ec-cc5d-4366-ab24-ffeb2f7a41b4 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:34.753071 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 880/1749] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:34.913199 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d6b37-1c52-4be1-8b86-538c40bf0ef9 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:34.927784 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d6b37-1c52-4be1-8b86-538c40bf0ef9 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:34.933788 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb464b-c698-4b3e-bfeb-3b0ef871bf0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:34.934697 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb464b-c698-4b3e-bfeb-3b0ef871bf0e service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:34.935193 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb464b-c698-4b3e-bfeb-3b0ef871bf0e service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:34.935512 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb464b-c698-4b3e-bfeb-3b0ef871bf0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:34.971759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:35.004000 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb464b-c698-4b3e-bfeb-3b0ef871bf0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:35.005439 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb464b-c698-4b3e-bfeb-3b0ef871bf0e service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:35.016837 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 870/1750] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:35.572792 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff299ec-cc5d-4366-ab24-ffeb2f7a41b4 service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:35.575105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-fff299ec-cc5d-4366-ab24-ffeb2f7a41b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:35.587263 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff299ec-cc5d-4366-ab24-ffeb2f7a41b4 service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:35.593495 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0638b-05f9-444f-a99f-8fe057128378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:35.594108 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0638b-05f9-444f-a99f-8fe057128378 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:35.594387 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0638b-05f9-444f-a99f-8fe057128378 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:35.594655 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0638b-05f9-444f-a99f-8fe057128378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:35.596753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0ff0638b-05f9-444f-a99f-8fe057128378 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:35.682039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0638b-05f9-444f-a99f-8fe057128378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:35.684260 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0638b-05f9-444f-a99f-8fe057128378 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:35.694807 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 881/1751] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:35 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:36.780087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb464b-c698-4b3e-bfeb-3b0ef871bf0e service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:36.871424 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb464b-c698-4b3e-bfeb-3b0ef871bf0e service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:36.883893 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc0384-8c4b-4769-bc79-799d2b556f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:36.884550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc0384-8c4b-4769-bc79-799d2b556f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:36.884829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc0384-8c4b-4769-bc79-799d2b556f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:36.885099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc0384-8c4b-4769-bc79-799d2b556f90 admin admin] PATH_INFO: `/v3/users/0efea46493194e97b40902898a905139` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:36.886939 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc0384-8c4b-4769-bc79-799d2b556f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0efea46493194e97b40902898a905139)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:36.888894 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc0384-8c4b-4769-bc79-799d2b556f90 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:37.008924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-42fc0384-8c4b-4769-bc79-799d2b556f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0efea46493194e97b40902898a905139'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:37.009700 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-42fc0384-8c4b-4769-bc79-799d2b556f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0efea46493194e97b40902898a905139'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:37.027973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-42fc0384-8c4b-4769-bc79-799d2b556f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0efea46493194e97b40902898a905139'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:37.048442 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-42fc0384-8c4b-4769-bc79-799d2b556f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0efea46493194e97b40902898a905139'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:37.051296 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-42fc0384-8c4b-4769-bc79-799d2b556f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0efea46493194e97b40902898a905139'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:37.088338 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 871/1752] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:36 2022] DELETE /identity/v3/users/0efea46493194e97b40902898a905139 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:37.092622 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e694a-6c81-4483-8e5a-a1e5b35af713 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:37.093131 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e694a-6c81-4483-8e5a-a1e5b35af713 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:37.094193 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e694a-6c81-4483-8e5a-a1e5b35af713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:37.134528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-3e1e694a-6c81-4483-8e5a-a1e5b35af713 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:37.136614 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3e1e694a-6c81-4483-8e5a-a1e5b35af713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:37.245077 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 882/1753] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:37.258206 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc0384-8c4b-4769-bc79-799d2b556f90 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:37.259884 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-42fc0384-8c4b-4769-bc79-799d2b556f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:37.320500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:37.325376 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc0384-8c4b-4769-bc79-799d2b556f90 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:37.333665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4458708-6217-4b3d-86a5-b84c4f5c4ffc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:37.334289 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4458708-6217-4b3d-86a5-b84c4f5c4ffc service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:37.334570 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4458708-6217-4b3d-86a5-b84c4f5c4ffc service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:37.334856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4458708-6217-4b3d-86a5-b84c4f5c4ffc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:37.346032 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4458708-6217-4b3d-86a5-b84c4f5c4ffc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:37.347856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4458708-6217-4b3d-86a5-b84c4f5c4ffc service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:37.358252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 872/1754] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:37.612855 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e694a-6c81-4483-8e5a-a1e5b35af713 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:37.616707 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3e1e694a-6c81-4483-8e5a-a1e5b35af713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:37.637175 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e694a-6c81-4483-8e5a-a1e5b35af713 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:37.644202 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93f56d-0692-4aff-bfa9-8172a02fd49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:37.644712 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93f56d-0692-4aff-bfa9-8172a02fd49a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:37.645057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93f56d-0692-4aff-bfa9-8172a02fd49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:37.645421 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93f56d-0692-4aff-bfa9-8172a02fd49a admin admin] PATH_INFO: `/v3/users/4167bf397969459792feae68f6cc33e6` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:37.649711 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93f56d-0692-4aff-bfa9-8172a02fd49a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4167bf397969459792feae68f6cc33e6)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:37.652508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93f56d-0692-4aff-bfa9-8172a02fd49a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:37.719924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4458708-6217-4b3d-86a5-b84c4f5c4ffc service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:37.722390 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-c4458708-6217-4b3d-86a5-b84c4f5c4ffc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:37.753522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4458708-6217-4b3d-86a5-b84c4f5c4ffc service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:37.757431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce390ba-3608-42ec-97cc-07ecd4ecd196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:37.758098 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce390ba-3608-42ec-97cc-07ecd4ecd196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:37.758419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce390ba-3608-42ec-97cc-07ecd4ecd196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:37.758777 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce390ba-3608-42ec-97cc-07ecd4ecd196 admin admin] PATH_INFO: `/v3/projects/05d33a94e26444efb19a845227fac8ba` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:37.760317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce390ba-3608-42ec-97cc-07ecd4ecd196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05d33a94e26444efb19a845227fac8ba)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:37.762677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce390ba-3608-42ec-97cc-07ecd4ecd196 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:37.764407 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0c93f56d-0692-4aff-bfa9-8172a02fd49a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4167bf397969459792feae68f6cc33e6'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:37.765905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0c93f56d-0692-4aff-bfa9-8172a02fd49a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4167bf397969459792feae68f6cc33e6'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:37.783145 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0c93f56d-0692-4aff-bfa9-8172a02fd49a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4167bf397969459792feae68f6cc33e6'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:37.809405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0c93f56d-0692-4aff-bfa9-8172a02fd49a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4167bf397969459792feae68f6cc33e6'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:37.814978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-0c93f56d-0692-4aff-bfa9-8172a02fd49a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4167bf397969459792feae68f6cc33e6'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:37.840290 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:37.850422 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 883/1755] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:37 2022] DELETE /identity/v3/users/4167bf397969459792feae68f6cc33e6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:37.857677 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ac6c3-982f-486f-8756-288915d69127 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:37.857977 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ac6c3-982f-486f-8756-288915d69127 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:37.858247 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ac6c3-982f-486f-8756-288915d69127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:37.901366 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-1f5ac6c3-982f-486f-8756-288915d69127 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:37.903745 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1f5ac6c3-982f-486f-8756-288915d69127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:37.904982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-8ce390ba-3608-42ec-97cc-07ecd4ecd196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05d33a94e26444efb19a845227fac8ba', 'request_id': 'req-8ce390ba-3608-42ec-97cc-07ecd4ecd196'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:37.922550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-8ce390ba-3608-42ec-97cc-07ecd4ecd196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05d33a94e26444efb19a845227fac8ba', 'request_id': 'req-8ce390ba-3608-42ec-97cc-07ecd4ecd196'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:37.939867 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-8ce390ba-3608-42ec-97cc-07ecd4ecd196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05d33a94e26444efb19a845227fac8ba', 'request_id': 'req-8ce390ba-3608-42ec-97cc-07ecd4ecd196'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:37.973886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-8ce390ba-3608-42ec-97cc-07ecd4ecd196 admin admin] The token cache is being invalidate because project 05d33a94e26444efb19a845227fac8ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:37.973886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-8ce390ba-3608-42ec-97cc-07ecd4ecd196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:37.974575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-8ce390ba-3608-42ec-97cc-07ecd4ecd196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:37.980939 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 873/1756] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:37 2022] DELETE /identity/v3/projects/05d33a94e26444efb19a845227fac8ba => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:37.983185 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce390ba-3608-42ec-97cc-07ecd4ecd196 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:37.985141 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8ce390ba-3608-42ec-97cc-07ecd4ecd196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:38.042993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 884/1757] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:38.054640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ac6c3-982f-486f-8756-288915d69127 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:38.056549 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1f5ac6c3-982f-486f-8756-288915d69127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:38.155584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce390ba-3608-42ec-97cc-07ecd4ecd196 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:38.161512 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c9f69-7133-46ac-a2b6-91dc46efd3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:38.162449 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c9f69-7133-46ac-a2b6-91dc46efd3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:38.162904 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c9f69-7133-46ac-a2b6-91dc46efd3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:38.163388 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c9f69-7133-46ac-a2b6-91dc46efd3c1 admin admin] PATH_INFO: `/v3/users/a0308b31ceef4a0885be3fd79dfc69fa` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:38.165099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c9f69-7133-46ac-a2b6-91dc46efd3c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0308b31ceef4a0885be3fd79dfc69fa)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:38.168025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198c9f69-7133-46ac-a2b6-91dc46efd3c1 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:38.194369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ac6c3-982f-486f-8756-288915d69127 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:38.223532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e451ef2-2054-414d-b94c-8bedd1cc4e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:38.224264 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e451ef2-2054-414d-b94c-8bedd1cc4e12 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:38.224549 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e451ef2-2054-414d-b94c-8bedd1cc4e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:38.224834 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e451ef2-2054-414d-b94c-8bedd1cc4e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:38.239566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e451ef2-2054-414d-b94c-8bedd1cc4e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:38.241635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e451ef2-2054-414d-b94c-8bedd1cc4e12 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:38.257372 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 885/1758] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:36:38.280363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-198c9f69-7133-46ac-a2b6-91dc46efd3c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0308b31ceef4a0885be3fd79dfc69fa'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:38.281276 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-198c9f69-7133-46ac-a2b6-91dc46efd3c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0308b31ceef4a0885be3fd79dfc69fa'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:38.299033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-198c9f69-7133-46ac-a2b6-91dc46efd3c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0308b31ceef4a0885be3fd79dfc69fa'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:38.326758 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-198c9f69-7133-46ac-a2b6-91dc46efd3c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0308b31ceef4a0885be3fd79dfc69fa'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:38.327988 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-198c9f69-7133-46ac-a2b6-91dc46efd3c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0308b31ceef4a0885be3fd79dfc69fa'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:38.332223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:38.356451 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 874/1759] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:37 2022] DELETE /identity/v3/users/a0308b31ceef4a0885be3fd79dfc69fa => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:39.012713 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e451ef2-2054-414d-b94c-8bedd1cc4e12 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:39.022819 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e451ef2-2054-414d-b94c-8bedd1cc4e12 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:39.147452 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d9e67-a6d0-4a4c-b5d5-494e82a1d598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:39.148108 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d9e67-a6d0-4a4c-b5d5-494e82a1d598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:39.148573 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d9e67-a6d0-4a4c-b5d5-494e82a1d598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:39.148853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d9e67-a6d0-4a4c-b5d5-494e82a1d598 admin admin] PATH_INFO: `/v3/projects/1360f7f84a134c3abe420bb5b1860a13` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:39.150040 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d9e67-a6d0-4a4c-b5d5-494e82a1d598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1360f7f84a134c3abe420bb5b1860a13)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:39.152047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d9e67-a6d0-4a4c-b5d5-494e82a1d598 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:39.234928 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:39.238918 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-875d9e67-a6d0-4a4c-b5d5-494e82a1d598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1360f7f84a134c3abe420bb5b1860a13', 'request_id': 'req-875d9e67-a6d0-4a4c-b5d5-494e82a1d598'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:39.252837 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-875d9e67-a6d0-4a4c-b5d5-494e82a1d598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1360f7f84a134c3abe420bb5b1860a13', 'request_id': 'req-875d9e67-a6d0-4a4c-b5d5-494e82a1d598'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:39.272145 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-875d9e67-a6d0-4a4c-b5d5-494e82a1d598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1360f7f84a134c3abe420bb5b1860a13', 'request_id': 'req-875d9e67-a6d0-4a4c-b5d5-494e82a1d598'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:39.276623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c9f69-7133-46ac-a2b6-91dc46efd3c1 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:39.278452 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-198c9f69-7133-46ac-a2b6-91dc46efd3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:39.301469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198c9f69-7133-46ac-a2b6-91dc46efd3c1 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:39.301826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-875d9e67-a6d0-4a4c-b5d5-494e82a1d598 admin admin] The token cache is being invalidate because project 1360f7f84a134c3abe420bb5b1860a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:39.302130 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-875d9e67-a6d0-4a4c-b5d5-494e82a1d598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:39.302829 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-875d9e67-a6d0-4a4c-b5d5-494e82a1d598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:39.308087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 886/1760] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:39 2022] DELETE /identity/v3/projects/1360f7f84a134c3abe420bb5b1860a13 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:39.310321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7e535-5ef2-401b-b28b-bcced85039e2 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:39.310615 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7e535-5ef2-401b-b28b-bcced85039e2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:39.311042 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7e535-5ef2-401b-b28b-bcced85039e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:39.352522 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-30e7e535-5ef2-401b-b28b-bcced85039e2 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:39.353751 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-30e7e535-5ef2-401b-b28b-bcced85039e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:39.490586 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81857301-7e90-4f62-9ba5-117189145371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:39.491301 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81857301-7e90-4f62-9ba5-117189145371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:39.491597 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81857301-7e90-4f62-9ba5-117189145371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:39.492311 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81857301-7e90-4f62-9ba5-117189145371 admin admin] PATH_INFO: `/v3/projects/43b608b6df3649ba92b725c62310b0a7` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:39.495373 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81857301-7e90-4f62-9ba5-117189145371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43b608b6df3649ba92b725c62310b0a7)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:39.498444 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81857301-7e90-4f62-9ba5-117189145371 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:39.530706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 887/1761] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:36:39.539787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69284176-a6d8-40fd-a4a5-9e944006a78d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:39.542319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69284176-a6d8-40fd-a4a5-9e944006a78d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:39.542768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69284176-a6d8-40fd-a4a5-9e944006a78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:39.605221 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-69284176-a6d8-40fd-a4a5-9e944006a78d None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:39.606783 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-69284176-a6d8-40fd-a4a5-9e944006a78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:39.622694 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-81857301-7e90-4f62-9ba5-117189145371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b608b6df3649ba92b725c62310b0a7', 'request_id': 'req-81857301-7e90-4f62-9ba5-117189145371'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:39.654710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-81857301-7e90-4f62-9ba5-117189145371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b608b6df3649ba92b725c62310b0a7', 'request_id': 'req-81857301-7e90-4f62-9ba5-117189145371'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:39.677512 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-81857301-7e90-4f62-9ba5-117189145371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b608b6df3649ba92b725c62310b0a7', 'request_id': 'req-81857301-7e90-4f62-9ba5-117189145371'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:39.702788 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-81857301-7e90-4f62-9ba5-117189145371 admin admin] The token cache is being invalidate because project 43b608b6df3649ba92b725c62310b0a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:39.703184 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-81857301-7e90-4f62-9ba5-117189145371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:39.705779 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-81857301-7e90-4f62-9ba5-117189145371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:39.713754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 875/1762] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:39 2022] DELETE /identity/v3/projects/43b608b6df3649ba92b725c62310b0a7 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:36:39.715259 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81857301-7e90-4f62-9ba5-117189145371 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:39.717964 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-81857301-7e90-4f62-9ba5-117189145371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:39.799768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 888/1763] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:36:39.804812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69284176-a6d8-40fd-a4a5-9e944006a78d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:39.817733 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69284176-a6d8-40fd-a4a5-9e944006a78d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:39.825385 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43c813-9d96-4e01-a422-5d7f9b7bc851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:39.826408 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43c813-9d96-4e01-a422-5d7f9b7bc851 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:39.826931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43c813-9d96-4e01-a422-5d7f9b7bc851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:39.827501 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43c813-9d96-4e01-a422-5d7f9b7bc851 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:39.828449 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43c813-9d96-4e01-a422-5d7f9b7bc851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:39.829039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43c813-9d96-4e01-a422-5d7f9b7bc851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:39.831230 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43c813-9d96-4e01-a422-5d7f9b7bc851 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:39.857748 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 889/1764] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:36:39.862002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43c813-9d96-4e01-a422-5d7f9b7bc851 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:39.883533 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43c813-9d96-4e01-a422-5d7f9b7bc851 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:39.885657 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81857301-7e90-4f62-9ba5-117189145371 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:39.890601 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cbc07e-0270-4da5-931d-5df37d58dd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:39.891324 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbc07e-0270-4da5-931d-5df37d58dd38 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:39.891601 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbc07e-0270-4da5-931d-5df37d58dd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:39.891895 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbc07e-0270-4da5-931d-5df37d58dd38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:39.892606 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cbc07e-0270-4da5-931d-5df37d58dd38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:39.894527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cbc07e-0270-4da5-931d-5df37d58dd38 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:39.898027 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8952b6-4b6d-4942-a02f-83c1d2c4d65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:39.899580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8952b6-4b6d-4942-a02f-83c1d2c4d65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:39.901225 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8952b6-4b6d-4942-a02f-83c1d2c4d65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:39.901713 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8952b6-4b6d-4942-a02f-83c1d2c4d65b admin admin] PATH_INFO: `/v3/users/f40906a9bb034cd28c86fac1679d944d` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:39.904849 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8952b6-4b6d-4942-a02f-83c1d2c4d65b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f40906a9bb034cd28c86fac1679d944d)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:39.907135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8952b6-4b6d-4942-a02f-83c1d2c4d65b admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:39.946180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 890/1765] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:39 2022] POST /identity/v3/projects => generated 379 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:39.951131 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cbc07e-0270-4da5-931d-5df37d58dd38 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:39.973884 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:40.000192 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5b8952b6-4b6d-4942-a02f-83c1d2c4d65b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f40906a9bb034cd28c86fac1679d944d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:40.001105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5b8952b6-4b6d-4942-a02f-83c1d2c4d65b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f40906a9bb034cd28c86fac1679d944d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:40.009883 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5b8952b6-4b6d-4942-a02f-83c1d2c4d65b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f40906a9bb034cd28c86fac1679d944d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:40.010425 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:40.027797 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5b8952b6-4b6d-4942-a02f-83c1d2c4d65b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f40906a9bb034cd28c86fac1679d944d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:40.028730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5b8952b6-4b6d-4942-a02f-83c1d2c4d65b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f40906a9bb034cd28c86fac1679d944d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:40.042328 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cbc07e-0270-4da5-931d-5df37d58dd38 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:40.047413 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 876/1766] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:39 2022] DELETE /identity/v3/users/f40906a9bb034cd28c86fac1679d944d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:40.047740 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad6b36-4967-419d-bb25-12b8072255d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:40.048364 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad6b36-4967-419d-bb25-12b8072255d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:40.048683 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad6b36-4967-419d-bb25-12b8072255d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:40.048960 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad6b36-4967-419d-bb25-12b8072255d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:40.049877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad6b36-4967-419d-bb25-12b8072255d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:40.051645 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad6b36-4967-419d-bb25-12b8072255d8 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:40.083448 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 891/1767] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:39 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:40.084780 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8952b6-4b6d-4942-a02f-83c1d2c4d65b admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:40.086687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-5b8952b6-4b6d-4942-a02f-83c1d2c4d65b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:40.194738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8952b6-4b6d-4942-a02f-83c1d2c4d65b admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:40.203257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9a3cc-eb08-4dba-84e7-73ddfb72e348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:40.203950 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9a3cc-eb08-4dba-84e7-73ddfb72e348 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:40.204235 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9a3cc-eb08-4dba-84e7-73ddfb72e348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:40.204557 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9a3cc-eb08-4dba-84e7-73ddfb72e348 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:40.205218 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9a3cc-eb08-4dba-84e7-73ddfb72e348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:40.207224 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9a3cc-eb08-4dba-84e7-73ddfb72e348 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:40.222506 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 877/1768] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:40.225744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad6b36-4967-419d-bb25-12b8072255d8 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:40.241479 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad6b36-4967-419d-bb25-12b8072255d8 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:40.249129 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fbb37-ea34-411a-a050-ec6d7e8b88bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:40.250008 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fbb37-ea34-411a-a050-ec6d7e8b88bc admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:40.250556 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fbb37-ea34-411a-a050-ec6d7e8b88bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:40.251425 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fbb37-ea34-411a-a050-ec6d7e8b88bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:40.252318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fbb37-ea34-411a-a050-ec6d7e8b88bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:40.255590 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fbb37-ea34-411a-a050-ec6d7e8b88bc admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:40.272853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 892/1769] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:40.277120 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9a3cc-eb08-4dba-84e7-73ddfb72e348 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:40.302416 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9a3cc-eb08-4dba-84e7-73ddfb72e348 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:40.311314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2685e-a3fa-4300-b6f3-60f7239bedb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:40.312025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2685e-a3fa-4300-b6f3-60f7239bedb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:40.312313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2685e-a3fa-4300-b6f3-60f7239bedb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:40.312596 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2685e-a3fa-4300-b6f3-60f7239bedb0 admin admin] PATH_INFO: `/v3/projects/822fdfa0b0ed45f39ba10d980a58601c/users/0796906f4faa45c09ca5a1ae59749ce0/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:40.354547 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2685e-a3fa-4300-b6f3-60f7239bedb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=822fdfa0b0ed45f39ba10d980a58601c, user_id=0796906f4faa45c09ca5a1ae59749ce0, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:40.359561 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2685e-a3fa-4300-b6f3-60f7239bedb0 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:40.398530 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 878/1770] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:40 2022] PUT /identity/v3/projects/822fdfa0b0ed45f39ba10d980a58601c/users/0796906f4faa45c09ca5a1ae59749ce0/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:40.401457 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c9a65-6a8a-4971-a92e-30e1732a76a2 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:40.402285 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c9a65-6a8a-4971-a92e-30e1732a76a2 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:40.402642 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c9a65-6a8a-4971-a92e-30e1732a76a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:40.450185 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-8d2c9a65-6a8a-4971-a92e-30e1732a76a2 None None] MFA Rules not processed for user `0796906f4faa45c09ca5a1ae59749ce0`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:40.453360 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8d2c9a65-6a8a-4971-a92e-30e1732a76a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:40.475225 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2685e-a3fa-4300-b6f3-60f7239bedb0 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:40.477174 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7bf2685e-a3fa-4300-b6f3-60f7239bedb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:40.546147 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 893/1771] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:40.550291 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c9a65-6a8a-4971-a92e-30e1732a76a2 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:40.587532 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2685e-a3fa-4300-b6f3-60f7239bedb0 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:40.596367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee07fe1-451f-4a43-b151-131bcb136efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:40.597493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee07fe1-451f-4a43-b151-131bcb136efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:40.598874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee07fe1-451f-4a43-b151-131bcb136efa admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:40.599572 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee07fe1-451f-4a43-b151-131bcb136efa admin admin] PATH_INFO: `/v3/projects/6ecdb40b0f5847ecaa618cdd8776c4ee` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:40.602263 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee07fe1-451f-4a43-b151-131bcb136efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ecdb40b0f5847ecaa618cdd8776c4ee)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:40.604689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee07fe1-451f-4a43-b151-131bcb136efa admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:40.631457 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:40.639773 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c9a65-6a8a-4971-a92e-30e1732a76a2 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:40.646753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398629-3753-45d9-80db-0e4293eee8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:40.648044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398629-3753-45d9-80db-0e4293eee8cd admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:40.648341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398629-3753-45d9-80db-0e4293eee8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:40.648613 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398629-3753-45d9-80db-0e4293eee8cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:40.650697 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01398629-3753-45d9-80db-0e4293eee8cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:40.654391 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01398629-3753-45d9-80db-0e4293eee8cd admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:40.689907 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-eee07fe1-451f-4a43-b151-131bcb136efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ecdb40b0f5847ecaa618cdd8776c4ee', 'request_id': 'req-eee07fe1-451f-4a43-b151-131bcb136efa'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:40.694005 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 894/1772] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:40 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:36:40.694487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398629-3753-45d9-80db-0e4293eee8cd admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:40.701695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-eee07fe1-451f-4a43-b151-131bcb136efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ecdb40b0f5847ecaa618cdd8776c4ee', 'request_id': 'req-eee07fe1-451f-4a43-b151-131bcb136efa'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:40.712920 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-eee07fe1-451f-4a43-b151-131bcb136efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ecdb40b0f5847ecaa618cdd8776c4ee', 'request_id': 'req-eee07fe1-451f-4a43-b151-131bcb136efa'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:40.765511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-eee07fe1-451f-4a43-b151-131bcb136efa admin admin] The token cache is being invalidate because project 6ecdb40b0f5847ecaa618cdd8776c4ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:40.766441 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-eee07fe1-451f-4a43-b151-131bcb136efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:40.767544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-eee07fe1-451f-4a43-b151-131bcb136efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:40.772920 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 879/1773] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:40 2022] DELETE /identity/v3/projects/6ecdb40b0f5847ecaa618cdd8776c4ee => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:40.774727 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee07fe1-451f-4a43-b151-131bcb136efa admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:40.779167 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-eee07fe1-451f-4a43-b151-131bcb136efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:40.794644 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:40.845080 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398629-3753-45d9-80db-0e4293eee8cd admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:40.851561 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8df681-b108-4746-8401-2ddb4c6906f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:40.852373 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8df681-b108-4746-8401-2ddb4c6906f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:40.853396 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8df681-b108-4746-8401-2ddb4c6906f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:40.853847 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8df681-b108-4746-8401-2ddb4c6906f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:40.854635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8df681-b108-4746-8401-2ddb4c6906f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:40.858235 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8df681-b108-4746-8401-2ddb4c6906f3 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:40.898709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 895/1774] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:40 2022] POST /identity/v3/users => generated 295 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:40.903671 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8df681-b108-4746-8401-2ddb4c6906f3 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:40.905911 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-4d8df681-b108-4746-8401-2ddb4c6906f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:40.924040 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8df681-b108-4746-8401-2ddb4c6906f3 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:40.931431 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d2ff4-06f7-44d4-81c0-523d6f7fc870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:40.932418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d2ff4-06f7-44d4-81c0-523d6f7fc870 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:40.932714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d2ff4-06f7-44d4-81c0-523d6f7fc870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:40.933545 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d2ff4-06f7-44d4-81c0-523d6f7fc870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:40.934219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d2ff4-06f7-44d4-81c0-523d6f7fc870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:40.936523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d2ff4-06f7-44d4-81c0-523d6f7fc870 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:40.958230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee07fe1-451f-4a43-b151-131bcb136efa admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:40.965638 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 896/1775] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:40.968035 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d2ff4-06f7-44d4-81c0-523d6f7fc870 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:40.985496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a0be9-147d-4b4a-9a8e-c5ef5d99144b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:40.986165 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a0be9-147d-4b4a-9a8e-c5ef5d99144b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:40.986448 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a0be9-147d-4b4a-9a8e-c5ef5d99144b admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:40.986722 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a0be9-147d-4b4a-9a8e-c5ef5d99144b admin admin] PATH_INFO: `/v3/users/dc8f19fe647646c8ac3d46186047b7ea` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:40.990792 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a0be9-147d-4b4a-9a8e-c5ef5d99144b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8f19fe647646c8ac3d46186047b7ea)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:40.992619 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d2ff4-06f7-44d4-81c0-523d6f7fc870 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:40.995289 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a0be9-147d-4b4a-9a8e-c5ef5d99144b admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:41.004878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc488ecd-ed94-4bf1-94fc-0c39e369e72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:41.005838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc488ecd-ed94-4bf1-94fc-0c39e369e72a admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:41.006135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc488ecd-ed94-4bf1-94fc-0c39e369e72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:41.006418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc488ecd-ed94-4bf1-94fc-0c39e369e72a admin admin] PATH_INFO: `/v3/projects/32e3b0a023b9450686ee231b64bac6dc/users/70131c3f63294889ad0f4e9c831847ab/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:41.049782 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc488ecd-ed94-4bf1-94fc-0c39e369e72a admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e3b0a023b9450686ee231b64bac6dc, user_id=70131c3f63294889ad0f4e9c831847ab, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:41.054635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc488ecd-ed94-4bf1-94fc-0c39e369e72a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:41.090891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 897/1776] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:40 2022] PUT /identity/v3/projects/32e3b0a023b9450686ee231b64bac6dc/users/70131c3f63294889ad0f4e9c831847ab/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:41.097204 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc488ecd-ed94-4bf1-94fc-0c39e369e72a admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:41.145485 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f43a0be9-147d-4b4a-9a8e-c5ef5d99144b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8f19fe647646c8ac3d46186047b7ea'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:41.147837 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f43a0be9-147d-4b4a-9a8e-c5ef5d99144b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8f19fe647646c8ac3d46186047b7ea'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:41.189270 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f43a0be9-147d-4b4a-9a8e-c5ef5d99144b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8f19fe647646c8ac3d46186047b7ea'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:41.228383 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f43a0be9-147d-4b4a-9a8e-c5ef5d99144b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8f19fe647646c8ac3d46186047b7ea'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:41.229638 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f43a0be9-147d-4b4a-9a8e-c5ef5d99144b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8f19fe647646c8ac3d46186047b7ea'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:41.274473 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 880/1777] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:40 2022] DELETE /identity/v3/users/dc8f19fe647646c8ac3d46186047b7ea => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:41.336674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc488ecd-ed94-4bf1-94fc-0c39e369e72a admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:41.481864 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a0be9-147d-4b4a-9a8e-c5ef5d99144b admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:41.483621 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-f43a0be9-147d-4b4a-9a8e-c5ef5d99144b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:41.574650 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df126f20-4c64-49ce-bf8f-6406d9de0f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:41.576062 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df126f20-4c64-49ce-bf8f-6406d9de0f27 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:41.576743 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df126f20-4c64-49ce-bf8f-6406d9de0f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:41.577020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df126f20-4c64-49ce-bf8f-6406d9de0f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:41.577695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:41.578262 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df126f20-4c64-49ce-bf8f-6406d9de0f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:41.580649 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df126f20-4c64-49ce-bf8f-6406d9de0f27 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:41.611498 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 898/1778] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 515 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:41.618057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df126f20-4c64-49ce-bf8f-6406d9de0f27 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:41.620105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-df126f20-4c64-49ce-bf8f-6406d9de0f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:41.638995 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df126f20-4c64-49ce-bf8f-6406d9de0f27 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:41.652227 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4e658-e4cb-44dd-a141-e168eb9f4d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:41.653101 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4e658-e4cb-44dd-a141-e168eb9f4d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:41.653391 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4e658-e4cb-44dd-a141-e168eb9f4d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:41.653668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4e658-e4cb-44dd-a141-e168eb9f4d23 admin admin] PATH_INFO: `/v3/projects/32e3b0a023b9450686ee231b64bac6dc/users/70131c3f63294889ad0f4e9c831847ab/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:41.655752 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4e658-e4cb-44dd-a141-e168eb9f4d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32e3b0a023b9450686ee231b64bac6dc, user_id=70131c3f63294889ad0f4e9c831847ab, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:41.659987 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4e658-e4cb-44dd-a141-e168eb9f4d23 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:41.671247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a0be9-147d-4b4a-9a8e-c5ef5d99144b admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:41.686663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb6695a-fd5c-4956-a142-8c304d7d78a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:41.688012 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 899/1779] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:41 2022] PUT /identity/v3/projects/32e3b0a023b9450686ee231b64bac6dc/users/70131c3f63294889ad0f4e9c831847ab/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:41.696293 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6695a-fd5c-4956-a142-8c304d7d78a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:41.696582 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6695a-fd5c-4956-a142-8c304d7d78a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:41.696863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb6695a-fd5c-4956-a142-8c304d7d78a1 admin admin] PATH_INFO: `/v3/users/ba596365374747e9a209b5b57cc9ff83` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:41.697556 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6358af-e2b3-4cfb-a50b-0ebb2edf1084 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:41.697918 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6358af-e2b3-4cfb-a50b-0ebb2edf1084 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:41.698174 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6695a-fd5c-4956-a142-8c304d7d78a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba596365374747e9a209b5b57cc9ff83)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:41.698459 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6358af-e2b3-4cfb-a50b-0ebb2edf1084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:41.700777 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb6695a-fd5c-4956-a142-8c304d7d78a1 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:41.781491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ce6358af-e2b3-4cfb-a50b-0ebb2edf1084 None None] MFA Rules not processed for user `70131c3f63294889ad0f4e9c831847ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:41.785387 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ce6358af-e2b3-4cfb-a50b-0ebb2edf1084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:41.794895 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:41.816589 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5eb6695a-fd5c-4956-a142-8c304d7d78a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba596365374747e9a209b5b57cc9ff83'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:41.819606 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5eb6695a-fd5c-4956-a142-8c304d7d78a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba596365374747e9a209b5b57cc9ff83'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:41.838449 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5eb6695a-fd5c-4956-a142-8c304d7d78a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba596365374747e9a209b5b57cc9ff83'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:41.890198 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5eb6695a-fd5c-4956-a142-8c304d7d78a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba596365374747e9a209b5b57cc9ff83'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:41.892658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5eb6695a-fd5c-4956-a142-8c304d7d78a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba596365374747e9a209b5b57cc9ff83'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:41.923928 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 881/1780] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:41 2022] DELETE /identity/v3/users/ba596365374747e9a209b5b57cc9ff83 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:41.928677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fc5af-9673-422e-bb62-df2b499bb140 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:41.932727 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fc5af-9673-422e-bb62-df2b499bb140 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:41.936331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fc5af-9673-422e-bb62-df2b499bb140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:41.973630 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 900/1781] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:41.983284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-411fc5af-9673-422e-bb62-df2b499bb140 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:41.984609 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-411fc5af-9673-422e-bb62-df2b499bb140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:41.986793 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6358af-e2b3-4cfb-a50b-0ebb2edf1084 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:41.988251 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ce6358af-e2b3-4cfb-a50b-0ebb2edf1084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:42.094812 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 882/1782] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:42.107493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fc5af-9673-422e-bb62-df2b499bb140 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:42.117467 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-411fc5af-9673-422e-bb62-df2b499bb140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:42.127243 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6358af-e2b3-4cfb-a50b-0ebb2edf1084 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:42.270295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:42.287582 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90295b0-6924-4e86-901c-05155ab392dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:42.288224 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90295b0-6924-4e86-901c-05155ab392dd service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:42.288505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90295b0-6924-4e86-901c-05155ab392dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:42.293132 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90295b0-6924-4e86-901c-05155ab392dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:42.298019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fc5af-9673-422e-bb62-df2b499bb140 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:42.300626 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f90295b0-6924-4e86-901c-05155ab392dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:42.302088 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6cbea-f4e3-4f5d-a2bc-73877a7d5dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:42.302720 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6cbea-f4e3-4f5d-a2bc-73877a7d5dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:42.303028 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6cbea-f4e3-4f5d-a2bc-73877a7d5dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:42.303307 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6cbea-f4e3-4f5d-a2bc-73877a7d5dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:42.319300 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6cbea-f4e3-4f5d-a2bc-73877a7d5dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:42.321209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6cbea-f4e3-4f5d-a2bc-73877a7d5dc9 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:42.334393 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 883/1783] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:42.406631 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90295b0-6924-4e86-901c-05155ab392dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:42.409296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90295b0-6924-4e86-901c-05155ab392dd service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:42.423231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 901/1784] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:42.481198 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6cbea-f4e3-4f5d-a2bc-73877a7d5dc9 service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:42.483300 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-23d6cbea-f4e3-4f5d-a2bc-73877a7d5dc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:42.504176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6cbea-f4e3-4f5d-a2bc-73877a7d5dc9 service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:42.517713 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9125ad6e-2097-4e95-a504-fa9ac0003425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:42.518368 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125ad6e-2097-4e95-a504-fa9ac0003425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:42.518647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125ad6e-2097-4e95-a504-fa9ac0003425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:42.519506 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9125ad6e-2097-4e95-a504-fa9ac0003425 admin admin] PATH_INFO: `/v3/projects/5b22f5510c4044fd87f7b894534964e8` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:42.521872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125ad6e-2097-4e95-a504-fa9ac0003425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b22f5510c4044fd87f7b894534964e8)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:42.524053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9125ad6e-2097-4e95-a504-fa9ac0003425 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:42.663688 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9125ad6e-2097-4e95-a504-fa9ac0003425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b22f5510c4044fd87f7b894534964e8', 'request_id': 'req-9125ad6e-2097-4e95-a504-fa9ac0003425'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:42.689884 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9125ad6e-2097-4e95-a504-fa9ac0003425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b22f5510c4044fd87f7b894534964e8', 'request_id': 'req-9125ad6e-2097-4e95-a504-fa9ac0003425'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:42.697417 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9125ad6e-2097-4e95-a504-fa9ac0003425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b22f5510c4044fd87f7b894534964e8', 'request_id': 'req-9125ad6e-2097-4e95-a504-fa9ac0003425'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:42.723434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9125ad6e-2097-4e95-a504-fa9ac0003425 admin admin] The token cache is being invalidate because project 5b22f5510c4044fd87f7b894534964e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:42.724415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9125ad6e-2097-4e95-a504-fa9ac0003425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:42.726778 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9125ad6e-2097-4e95-a504-fa9ac0003425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:42.735429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 884/1785] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:42 2022] DELETE /identity/v3/projects/5b22f5510c4044fd87f7b894534964e8 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:42.736850 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67211527-f5e3-4a3d-8f82-aee264aa5559 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:42.737147 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67211527-f5e3-4a3d-8f82-aee264aa5559 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:42.737896 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67211527-f5e3-4a3d-8f82-aee264aa5559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:42.776104 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-67211527-f5e3-4a3d-8f82-aee264aa5559 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:42.777427 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-67211527-f5e3-4a3d-8f82-aee264aa5559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:42.790559 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:42.919458 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 902/1786] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:42.926208 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22df122-d2ae-4416-a653-da5c58eeabd2 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:42.926509 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22df122-d2ae-4416-a653-da5c58eeabd2 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:42.926880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22df122-d2ae-4416-a653-da5c58eeabd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:42.950583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-e22df122-d2ae-4416-a653-da5c58eeabd2 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:42.952182 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e22df122-d2ae-4416-a653-da5c58eeabd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:42.966201 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67211527-f5e3-4a3d-8f82-aee264aa5559 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:42.973185 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 885/1787] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:42.977325 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67211527-f5e3-4a3d-8f82-aee264aa5559 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:42.983032 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0ee87-25e9-4ec6-bf26-a042959b2fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:42.996984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0ee87-25e9-4ec6-bf26-a042959b2fac admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:42.996984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0ee87-25e9-4ec6-bf26-a042959b2fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:42.996984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0ee87-25e9-4ec6-bf26-a042959b2fac admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:42.996984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0ee87-25e9-4ec6-bf26-a042959b2fac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:42.996984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0ee87-25e9-4ec6-bf26-a042959b2fac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:42.996984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0ee87-25e9-4ec6-bf26-a042959b2fac admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:43.011017 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22df122-d2ae-4416-a653-da5c58eeabd2 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:43.017099 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 903/1788] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:36:43.024530 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22df122-d2ae-4416-a653-da5c58eeabd2 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:43.035977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17339a65-6a25-4c2c-8954-d57c58837dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:43.037724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17339a65-6a25-4c2c-8954-d57c58837dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:43.038502 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17339a65-6a25-4c2c-8954-d57c58837dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:43.038593 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17339a65-6a25-4c2c-8954-d57c58837dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:43.040608 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17339a65-6a25-4c2c-8954-d57c58837dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:43.046344 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17339a65-6a25-4c2c-8954-d57c58837dd8 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:43.090080 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 886/1789] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:43 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:43.095290 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0ee87-25e9-4ec6-bf26-a042959b2fac admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:43.123879 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0ee87-25e9-4ec6-bf26-a042959b2fac admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:43.198291 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0554c81-6b26-4af1-9c4d-4de99d1fb519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:43.199214 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0554c81-6b26-4af1-9c4d-4de99d1fb519 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:43.199704 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0554c81-6b26-4af1-9c4d-4de99d1fb519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:43.199987 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0554c81-6b26-4af1-9c4d-4de99d1fb519 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:43.200958 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0554c81-6b26-4af1-9c4d-4de99d1fb519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:43.203795 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0554c81-6b26-4af1-9c4d-4de99d1fb519 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:43.237398 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 904/1790] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:43 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:36:43.238821 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17339a65-6a25-4c2c-8954-d57c58837dd8 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:43.250210 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17339a65-6a25-4c2c-8954-d57c58837dd8 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:43.255563 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3129f2-7f1d-4e12-a49f-3ccd02a8f513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:43.256214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3129f2-7f1d-4e12-a49f-3ccd02a8f513 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:43.256741 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3129f2-7f1d-4e12-a49f-3ccd02a8f513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:43.257024 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3129f2-7f1d-4e12-a49f-3ccd02a8f513 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:43.257668 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3129f2-7f1d-4e12-a49f-3ccd02a8f513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:43.259382 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3129f2-7f1d-4e12-a49f-3ccd02a8f513 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:43.293145 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 887/1791] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:43.294872 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0554c81-6b26-4af1-9c4d-4de99d1fb519 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:43.314566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0554c81-6b26-4af1-9c4d-4de99d1fb519 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:43.335657 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee80c0-1336-4769-91a0-9201f1b9bda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:43.336290 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee80c0-1336-4769-91a0-9201f1b9bda7 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:43.336399 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3129f2-7f1d-4e12-a49f-3ccd02a8f513 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:43.336565 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee80c0-1336-4769-91a0-9201f1b9bda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:43.336835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee80c0-1336-4769-91a0-9201f1b9bda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:43.337486 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee80c0-1336-4769-91a0-9201f1b9bda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:43.338620 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0f3129f2-7f1d-4e12-a49f-3ccd02a8f513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:43.339120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ee80c0-1336-4769-91a0-9201f1b9bda7 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:43.360241 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3129f2-7f1d-4e12-a49f-3ccd02a8f513 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:43.366629 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 905/1792] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:43.371069 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee80c0-1336-4769-91a0-9201f1b9bda7 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:43.373272 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2a48e-417d-4a09-9590-c6d728263316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:43.373872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a48e-417d-4a09-9590-c6d728263316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:43.374157 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a48e-417d-4a09-9590-c6d728263316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:43.374433 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a48e-417d-4a09-9590-c6d728263316 admin admin] PATH_INFO: `/v3/projects/1ee3e2a0abae4cca9c74a462fee70bcf` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:43.375597 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2a48e-417d-4a09-9590-c6d728263316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee3e2a0abae4cca9c74a462fee70bcf)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:43.377594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2a48e-417d-4a09-9590-c6d728263316 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:43.388118 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee80c0-1336-4769-91a0-9201f1b9bda7 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:43.401652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5875b-8ad5-4eaf-95ef-377135b660b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:43.403848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5875b-8ad5-4eaf-95ef-377135b660b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:43.404170 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5875b-8ad5-4eaf-95ef-377135b660b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:43.405743 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5875b-8ad5-4eaf-95ef-377135b660b1 admin admin] PATH_INFO: `/v3/projects/f1fffc3f405a469485b8fee622928aa3/users/2370a9817fcd47d7b7bc7fd63d0bf73b/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:43.439392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5875b-8ad5-4eaf-95ef-377135b660b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1fffc3f405a469485b8fee622928aa3, user_id=2370a9817fcd47d7b7bc7fd63d0bf73b, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:43.443391 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5875b-8ad5-4eaf-95ef-377135b660b1 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:43.478072 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 906/1793] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:43 2022] PUT /identity/v3/projects/f1fffc3f405a469485b8fee622928aa3/users/2370a9817fcd47d7b7bc7fd63d0bf73b/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:36:43.492766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4ffcb-7d2f-49fd-8f4b-78c77305318c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:43.493054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4ffcb-7d2f-49fd-8f4b-78c77305318c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:43.498420 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4ffcb-7d2f-49fd-8f4b-78c77305318c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:43.502855 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-59f2a48e-417d-4a09-9590-c6d728263316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee3e2a0abae4cca9c74a462fee70bcf', 'request_id': 'req-59f2a48e-417d-4a09-9590-c6d728263316'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:43.521335 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-59f2a48e-417d-4a09-9590-c6d728263316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee3e2a0abae4cca9c74a462fee70bcf', 'request_id': 'req-59f2a48e-417d-4a09-9590-c6d728263316'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:43.543714 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-59f2a48e-417d-4a09-9590-c6d728263316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee3e2a0abae4cca9c74a462fee70bcf', 'request_id': 'req-59f2a48e-417d-4a09-9590-c6d728263316'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:43.544518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-20f4ffcb-7d2f-49fd-8f4b-78c77305318c None None] MFA Rules not processed for user `2370a9817fcd47d7b7bc7fd63d0bf73b`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:43.545899 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-20f4ffcb-7d2f-49fd-8f4b-78c77305318c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:43.577332 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-59f2a48e-417d-4a09-9590-c6d728263316 admin admin] The token cache is being invalidate because project 1ee3e2a0abae4cca9c74a462fee70bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:43.577627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-59f2a48e-417d-4a09-9590-c6d728263316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:43.579110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-59f2a48e-417d-4a09-9590-c6d728263316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:43.580861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 888/1794] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:43 2022] DELETE /identity/v3/projects/1ee3e2a0abae4cca9c74a462fee70bcf => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:43.584698 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2a48e-417d-4a09-9590-c6d728263316 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:43.588079 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-59f2a48e-417d-4a09-9590-c6d728263316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:43.621137 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:43.638544 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:43.685707 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 907/1795] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:43.701238 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4ffcb-7d2f-49fd-8f4b-78c77305318c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:43.703627 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-20f4ffcb-7d2f-49fd-8f4b-78c77305318c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:43.710528 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2a48e-417d-4a09-9590-c6d728263316 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:43.819815 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4ffcb-7d2f-49fd-8f4b-78c77305318c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:43.825427 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a4272-9530-4bfc-be23-32719f90db1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:43.825994 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ce5e6-58c1-4832-b15b-1a5f4d1cc4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:43.826131 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a4272-9530-4bfc-be23-32719f90db1c service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:43.826321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a4272-9530-4bfc-be23-32719f90db1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:43.826597 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a4272-9530-4bfc-be23-32719f90db1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:43.827088 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ce5e6-58c1-4832-b15b-1a5f4d1cc4a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:43.827524 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ce5e6-58c1-4832-b15b-1a5f4d1cc4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:43.827888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ce5e6-58c1-4832-b15b-1a5f4d1cc4a3 admin admin] PATH_INFO: `/v3/users/b3dcaa14de9d41faa04c712b72e38fe1` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:43.829147 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ce5e6-58c1-4832-b15b-1a5f4d1cc4a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3dcaa14de9d41faa04c712b72e38fe1)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:43.832939 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ce5e6-58c1-4832-b15b-1a5f4d1cc4a3 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:43.841577 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a4272-9530-4bfc-be23-32719f90db1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:43.843475 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a4272-9530-4bfc-be23-32719f90db1c service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:43.856964 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 908/1796] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:36:43.859523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a4272-9530-4bfc-be23-32719f90db1c service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:43.861137 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-102a4272-9530-4bfc-be23-32719f90db1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:43.881219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a4272-9530-4bfc-be23-32719f90db1c service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:43.891729 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455cfcf8-f470-400b-ae18-4d146f07f698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:43.892540 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cfcf8-f470-400b-ae18-4d146f07f698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:43.892972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cfcf8-f470-400b-ae18-4d146f07f698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:43.893308 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455cfcf8-f470-400b-ae18-4d146f07f698 admin admin] PATH_INFO: `/v3/users/2465fc5f6fef4d14ba6921ef724eab04` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:43.894642 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cfcf8-f470-400b-ae18-4d146f07f698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2465fc5f6fef4d14ba6921ef724eab04)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:43.896738 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455cfcf8-f470-400b-ae18-4d146f07f698 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:43.907378 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6e7ce5e6-58c1-4832-b15b-1a5f4d1cc4a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3dcaa14de9d41faa04c712b72e38fe1'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:43.909121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6e7ce5e6-58c1-4832-b15b-1a5f4d1cc4a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3dcaa14de9d41faa04c712b72e38fe1'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:43.921932 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6e7ce5e6-58c1-4832-b15b-1a5f4d1cc4a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3dcaa14de9d41faa04c712b72e38fe1'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:43.943099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6e7ce5e6-58c1-4832-b15b-1a5f4d1cc4a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3dcaa14de9d41faa04c712b72e38fe1'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:43.944122 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6e7ce5e6-58c1-4832-b15b-1a5f4d1cc4a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3dcaa14de9d41faa04c712b72e38fe1'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:43.980489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 889/1797] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:43 2022] DELETE /identity/v3/users/b3dcaa14de9d41faa04c712b72e38fe1 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:36:43.988375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ce5e6-58c1-4832-b15b-1a5f4d1cc4a3 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:43.990427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6e7ce5e6-58c1-4832-b15b-1a5f4d1cc4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:43.998820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-455cfcf8-f470-400b-ae18-4d146f07f698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2465fc5f6fef4d14ba6921ef724eab04'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:44.000698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-455cfcf8-f470-400b-ae18-4d146f07f698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2465fc5f6fef4d14ba6921ef724eab04'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:44.018610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-455cfcf8-f470-400b-ae18-4d146f07f698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2465fc5f6fef4d14ba6921ef724eab04'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:44.041782 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-455cfcf8-f470-400b-ae18-4d146f07f698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2465fc5f6fef4d14ba6921ef724eab04'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:44.042728 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-455cfcf8-f470-400b-ae18-4d146f07f698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2465fc5f6fef4d14ba6921ef724eab04'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:44.057353 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:44.066993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 909/1798] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:43 2022] DELETE /identity/v3/users/2465fc5f6fef4d14ba6921ef724eab04 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:44.073289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ef9c0-b03f-4052-92d4-1cf42568c5ef None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:44.075309 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ef9c0-b03f-4052-92d4-1cf42568c5ef None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:44.075780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ef9c0-b03f-4052-92d4-1cf42568c5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:44.082636 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ce5e6-58c1-4832-b15b-1a5f4d1cc4a3 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:44.118168 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0e9ef9c0-b03f-4052-92d4-1cf42568c5ef None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:44.118168 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0e9ef9c0-b03f-4052-92d4-1cf42568c5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:44.199303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:44.208786 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b3dfb-54d8-4fc9-856b-eff5327289f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:44.209490 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b3dfb-54d8-4fc9-856b-eff5327289f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:44.209786 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b3dfb-54d8-4fc9-856b-eff5327289f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:44.210082 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b3dfb-54d8-4fc9-856b-eff5327289f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:44.217173 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b67b3dfb-54d8-4fc9-856b-eff5327289f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:44.226350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 910/1799] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:44.268503 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ef9c0-b03f-4052-92d4-1cf42568c5ef None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:44.270831 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0e9ef9c0-b03f-4052-92d4-1cf42568c5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:44.329129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b3dfb-54d8-4fc9-856b-eff5327289f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:44.347914 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b3dfb-54d8-4fc9-856b-eff5327289f7 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:44.376846 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 890/1800] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:44.378853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b3dfb-54d8-4fc9-856b-eff5327289f7 service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:44.381695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b67b3dfb-54d8-4fc9-856b-eff5327289f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:44.402518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ef9c0-b03f-4052-92d4-1cf42568c5ef None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:44.410052 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b3dfb-54d8-4fc9-856b-eff5327289f7 service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:44.412081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4964b1-c314-4ec9-8048-ab83a5acf11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:44.412786 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4964b1-c314-4ec9-8048-ab83a5acf11c service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:44.413128 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4964b1-c314-4ec9-8048-ab83a5acf11c service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:44.413597 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4964b1-c314-4ec9-8048-ab83a5acf11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:44.438982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99364ffa-760f-4394-acf6-c598a2867bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:44.438982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99364ffa-760f-4394-acf6-c598a2867bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:44.438982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99364ffa-760f-4394-acf6-c598a2867bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:44.438982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99364ffa-760f-4394-acf6-c598a2867bb9 admin admin] PATH_INFO: `/v3/users/c876087fad0e47878030edc53e43c39d` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:44.439691 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4964b1-c314-4ec9-8048-ab83a5acf11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:44.439691 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4964b1-c314-4ec9-8048-ab83a5acf11c service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:44.442256 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99364ffa-760f-4394-acf6-c598a2867bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c876087fad0e47878030edc53e43c39d)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:44.444773 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99364ffa-760f-4394-acf6-c598a2867bb9 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:44.466308 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 911/1801] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:44.491845 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4964b1-c314-4ec9-8048-ab83a5acf11c service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:44.494280 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ad4964b1-c314-4ec9-8048-ab83a5acf11c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:44.523882 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4964b1-c314-4ec9-8048-ab83a5acf11c service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:44.538042 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe776afc-2bd7-434f-8b80-fe7995cc6e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:44.539274 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe776afc-2bd7-434f-8b80-fe7995cc6e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:44.539717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe776afc-2bd7-434f-8b80-fe7995cc6e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:44.539969 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe776afc-2bd7-434f-8b80-fe7995cc6e32 admin admin] PATH_INFO: `/v3/projects/3121735260134ea09a5d03441aed7d11` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:44.540623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-99364ffa-760f-4394-acf6-c598a2867bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c876087fad0e47878030edc53e43c39d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:44.541169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe776afc-2bd7-434f-8b80-fe7995cc6e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3121735260134ea09a5d03441aed7d11)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:44.541591 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-99364ffa-760f-4394-acf6-c598a2867bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c876087fad0e47878030edc53e43c39d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:44.544213 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe776afc-2bd7-434f-8b80-fe7995cc6e32 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:44.556627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-99364ffa-760f-4394-acf6-c598a2867bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c876087fad0e47878030edc53e43c39d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:44.574654 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-99364ffa-760f-4394-acf6-c598a2867bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c876087fad0e47878030edc53e43c39d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:44.575853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-99364ffa-760f-4394-acf6-c598a2867bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c876087fad0e47878030edc53e43c39d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:44.601460 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 891/1802] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:44 2022] DELETE /identity/v3/users/c876087fad0e47878030edc53e43c39d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:44.603104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99364ffa-760f-4394-acf6-c598a2867bb9 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:44.608326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-99364ffa-760f-4394-acf6-c598a2867bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:44.621374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-fe776afc-2bd7-434f-8b80-fe7995cc6e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3121735260134ea09a5d03441aed7d11', 'request_id': 'req-fe776afc-2bd7-434f-8b80-fe7995cc6e32'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:44.634773 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-fe776afc-2bd7-434f-8b80-fe7995cc6e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3121735260134ea09a5d03441aed7d11', 'request_id': 'req-fe776afc-2bd7-434f-8b80-fe7995cc6e32'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:44.645557 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-fe776afc-2bd7-434f-8b80-fe7995cc6e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3121735260134ea09a5d03441aed7d11', 'request_id': 'req-fe776afc-2bd7-434f-8b80-fe7995cc6e32'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:44.668027 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:44.671614 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-fe776afc-2bd7-434f-8b80-fe7995cc6e32 admin admin] The token cache is being invalidate because project 3121735260134ea09a5d03441aed7d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:44.672131 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-fe776afc-2bd7-434f-8b80-fe7995cc6e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:44.672624 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-fe776afc-2bd7-434f-8b80-fe7995cc6e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:44.675666 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 912/1803] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:44 2022] DELETE /identity/v3/projects/3121735260134ea09a5d03441aed7d11 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:44.681389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c64cb2-40d0-469b-93a5-acbffde9f61f None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:44.682079 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c64cb2-40d0-469b-93a5-acbffde9f61f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:44.682079 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c64cb2-40d0-469b-93a5-acbffde9f61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:44.708952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-67c64cb2-40d0-469b-93a5-acbffde9f61f None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:44.710306 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-67c64cb2-40d0-469b-93a5-acbffde9f61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:44.765982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99364ffa-760f-4394-acf6-c598a2867bb9 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:44.774662 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd033d4-f528-465c-9af7-92f4a9723258 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:44.775841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd033d4-f528-465c-9af7-92f4a9723258 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:44.776060 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd033d4-f528-465c-9af7-92f4a9723258 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:44.776342 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd033d4-f528-465c-9af7-92f4a9723258 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:44.779043 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-1bd033d4-f528-465c-9af7-92f4a9723258 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:44.859883 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 913/1804] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:44.863997 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c64cb2-40d0-469b-93a5-acbffde9f61f None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:44.872509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-67c64cb2-40d0-469b-93a5-acbffde9f61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:44.891879 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c64cb2-40d0-469b-93a5-acbffde9f61f None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:44.897771 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91e934-8d6e-4232-a001-d8327ff8126b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:44.898493 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91e934-8d6e-4232-a001-d8327ff8126b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:44.898828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91e934-8d6e-4232-a001-d8327ff8126b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:44.899147 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91e934-8d6e-4232-a001-d8327ff8126b admin admin] PATH_INFO: `/v3/projects/0a187d79a34348969024e69cd93247ef` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:44.900365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91e934-8d6e-4232-a001-d8327ff8126b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a187d79a34348969024e69cd93247ef)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:44.903516 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91e934-8d6e-4232-a001-d8327ff8126b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:44.930661 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:44.954314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd033d4-f528-465c-9af7-92f4a9723258 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:44.955990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd033d4-f528-465c-9af7-92f4a9723258 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:44.969157 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 892/1805] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:44.970993 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d1fd0-612e-4e06-8d3c-93222e6ad33a None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:44.971273 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d1fd0-612e-4e06-8d3c-93222e6ad33a None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:44.971545 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d1fd0-612e-4e06-8d3c-93222e6ad33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:44.975622 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ae91e934-8d6e-4232-a001-d8327ff8126b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a187d79a34348969024e69cd93247ef', 'request_id': 'req-ae91e934-8d6e-4232-a001-d8327ff8126b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:44.987907 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ae91e934-8d6e-4232-a001-d8327ff8126b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a187d79a34348969024e69cd93247ef', 'request_id': 'req-ae91e934-8d6e-4232-a001-d8327ff8126b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:45.004644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-957d1fd0-612e-4e06-8d3c-93222e6ad33a None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:45.005896 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-957d1fd0-612e-4e06-8d3c-93222e6ad33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:45.009607 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ae91e934-8d6e-4232-a001-d8327ff8126b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a187d79a34348969024e69cd93247ef', 'request_id': 'req-ae91e934-8d6e-4232-a001-d8327ff8126b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:45.030291 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ae91e934-8d6e-4232-a001-d8327ff8126b admin admin] The token cache is being invalidate because project 0a187d79a34348969024e69cd93247ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:45.030789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ae91e934-8d6e-4232-a001-d8327ff8126b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:45.031642 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ae91e934-8d6e-4232-a001-d8327ff8126b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:45.033700 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 914/1806] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:44 2022] DELETE /identity/v3/projects/0a187d79a34348969024e69cd93247ef => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:45.035839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91e934-8d6e-4232-a001-d8327ff8126b admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:45.039029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ae91e934-8d6e-4232-a001-d8327ff8126b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:45.100922 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 893/1807] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:45.102367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9127a-0f6e-48d8-97c9-cf83f8a312bc None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.102719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9127a-0f6e-48d8-97c9-cf83f8a312bc None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.103226 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9127a-0f6e-48d8-97c9-cf83f8a312bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.129426 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91e934-8d6e-4232-a001-d8327ff8126b admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:45.132697 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-8dc9127a-0f6e-48d8-97c9-cf83f8a312bc None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:45.134712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8dc9127a-0f6e-48d8-97c9-cf83f8a312bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:45.135540 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d85f8f-f744-4b1d-917d-3c674c652bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:45.136987 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d85f8f-f744-4b1d-917d-3c674c652bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.137270 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d85f8f-f744-4b1d-917d-3c674c652bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.137563 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d85f8f-f744-4b1d-917d-3c674c652bcb admin admin] PATH_INFO: `/v3/projects/69be329ef33a46fd9ec471c967f89145` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.139900 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d85f8f-f744-4b1d-917d-3c674c652bcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=69be329ef33a46fd9ec471c967f89145)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:45.142071 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d85f8f-f744-4b1d-917d-3c674c652bcb admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:45.145478 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 894/1808] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:45.151009 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9127a-0f6e-48d8-97c9-cf83f8a312bc None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:45.169161 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9127a-0f6e-48d8-97c9-cf83f8a312bc None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:45.174690 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bca9be-adf2-4ec7-8277-b778d1901839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:45.175522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bca9be-adf2-4ec7-8277-b778d1901839 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.175943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bca9be-adf2-4ec7-8277-b778d1901839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.176349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bca9be-adf2-4ec7-8277-b778d1901839 admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.177430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bca9be-adf2-4ec7-8277-b778d1901839 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:45.177978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bca9be-adf2-4ec7-8277-b778d1901839 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:45.180139 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bca9be-adf2-4ec7-8277-b778d1901839 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:45.197870 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 895/1809] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:36:45.197870 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419fa14-6c0c-48a9-bc58-549a2d77ba3f None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.197870 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419fa14-6c0c-48a9-bc58-549a2d77ba3f None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.197870 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419fa14-6c0c-48a9-bc58-549a2d77ba3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.213294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-06d85f8f-f744-4b1d-917d-3c674c652bcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69be329ef33a46fd9ec471c967f89145', 'request_id': 'req-06d85f8f-f744-4b1d-917d-3c674c652bcb'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:45.224933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-8419fa14-6c0c-48a9-bc58-549a2d77ba3f None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:45.226553 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8419fa14-6c0c-48a9-bc58-549a2d77ba3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:45.237667 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-06d85f8f-f744-4b1d-917d-3c674c652bcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69be329ef33a46fd9ec471c967f89145', 'request_id': 'req-06d85f8f-f744-4b1d-917d-3c674c652bcb'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:45.246622 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-06d85f8f-f744-4b1d-917d-3c674c652bcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69be329ef33a46fd9ec471c967f89145', 'request_id': 'req-06d85f8f-f744-4b1d-917d-3c674c652bcb'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:45.281168 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-06d85f8f-f744-4b1d-917d-3c674c652bcb admin admin] The token cache is being invalidate because project 69be329ef33a46fd9ec471c967f89145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:45.281498 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-06d85f8f-f744-4b1d-917d-3c674c652bcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:45.283413 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-06d85f8f-f744-4b1d-917d-3c674c652bcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:45.284922 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:45.289048 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 915/1810] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:45 2022] DELETE /identity/v3/projects/69be329ef33a46fd9ec471c967f89145 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:45.289048 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d85f8f-f744-4b1d-917d-3c674c652bcb admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:45.291987 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-06d85f8f-f744-4b1d-917d-3c674c652bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:45.307562 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 896/1811] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:45.309436 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1288-94ef-4612-bdc9-9352a8f36522 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.309898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1288-94ef-4612-bdc9-9352a8f36522 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.310183 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee1288-94ef-4612-bdc9-9352a8f36522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.333576 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-e7ee1288-94ef-4612-bdc9-9352a8f36522 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:45.334797 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e7ee1288-94ef-4612-bdc9-9352a8f36522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:45.350985 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 897/1812] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:45.352005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee1288-94ef-4612-bdc9-9352a8f36522 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:45.377205 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:45.378028 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ee1288-94ef-4612-bdc9-9352a8f36522 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:45.385874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c3d68-3454-482a-89cb-1e948698c750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:45.386741 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3d68-3454-482a-89cb-1e948698c750 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.387052 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3d68-3454-482a-89cb-1e948698c750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.387329 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c3d68-3454-482a-89cb-1e948698c750 admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.388170 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c3d68-3454-482a-89cb-1e948698c750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:45.388481 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c3d68-3454-482a-89cb-1e948698c750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:45.390507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c3d68-3454-482a-89cb-1e948698c750 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:45.411317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 898/1813] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:36:45.411317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01fe18-dd85-4f8b-9511-9f227dcee49b None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.411317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01fe18-dd85-4f8b-9511-9f227dcee49b None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.411317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01fe18-dd85-4f8b-9511-9f227dcee49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.420968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d85f8f-f744-4b1d-917d-3c674c652bcb admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:45.427639 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c7a02-6964-4377-a293-78288bdb6783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:45.429016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c7a02-6964-4377-a293-78288bdb6783 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.429566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c7a02-6964-4377-a293-78288bdb6783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.429844 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c7a02-6964-4377-a293-78288bdb6783 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.430610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c7a02-6964-4377-a293-78288bdb6783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:45.432529 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c7a02-6964-4377-a293-78288bdb6783 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:45.433171 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-1f01fe18-dd85-4f8b-9511-9f227dcee49b None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:45.434467 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-1f01fe18-dd85-4f8b-9511-9f227dcee49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:45.445386 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 899/1814] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:45.446379 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01fe18-dd85-4f8b-9511-9f227dcee49b None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:45.458085 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01fe18-dd85-4f8b-9511-9f227dcee49b None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:45.465369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857b308-9312-40cf-be41-c918189926bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:45.466045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857b308-9312-40cf-be41-c918189926bc admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.466264 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857b308-9312-40cf-be41-c918189926bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.466540 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857b308-9312-40cf-be41-c918189926bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.467358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857b308-9312-40cf-be41-c918189926bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:45.468390 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 916/1815] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:45 2022] POST /identity/v3/projects => generated 383 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:45.469393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c7a02-6964-4377-a293-78288bdb6783 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:45.472893 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857b308-9312-40cf-be41-c918189926bc admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:45.508931 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 900/1816] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:45 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:45.510051 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857b308-9312-40cf-be41-c918189926bc admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:45.553847 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c7a02-6964-4377-a293-78288bdb6783 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:45.607553 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857b308-9312-40cf-be41-c918189926bc admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:45.615387 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbfaf2-cf64-4bce-b64e-63fcefa18aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:45.616464 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbfaf2-cf64-4bce-b64e-63fcefa18aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.616951 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbfaf2-cf64-4bce-b64e-63fcefa18aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.617400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbbfaf2-cf64-4bce-b64e-63fcefa18aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.618469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbfaf2-cf64-4bce-b64e-63fcefa18aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:45.621896 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbbfaf2-cf64-4bce-b64e-63fcefa18aa5 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:45.648523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 901/1817] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:45 2022] POST /identity/v3/users => generated 292 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:45.648523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbfaf2-cf64-4bce-b64e-63fcefa18aa5 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:45.654795 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a7a5d-5eb1-4f86-aa41-a60ba7de18d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:45.655715 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7a5d-5eb1-4f86-aa41-a60ba7de18d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.656070 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7a5d-5eb1-4f86-aa41-a60ba7de18d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.656462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a7a5d-5eb1-4f86-aa41-a60ba7de18d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.657148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a7a5d-5eb1-4f86-aa41-a60ba7de18d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:45.657528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a7a5d-5eb1-4f86-aa41-a60ba7de18d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:45.659377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a7a5d-5eb1-4f86-aa41-a60ba7de18d2 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:45.660127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbbfaf2-cf64-4bce-b64e-63fcefa18aa5 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:45.668116 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4b425-ad12-4bc0-ba94-c73f101dadf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:45.668833 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4b425-ad12-4bc0-ba94-c73f101dadf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.669116 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4b425-ad12-4bc0-ba94-c73f101dadf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.669403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4b425-ad12-4bc0-ba94-c73f101dadf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.670059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4b425-ad12-4bc0-ba94-c73f101dadf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:45.672275 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4b425-ad12-4bc0-ba94-c73f101dadf2 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:45.677186 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 917/1818] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:36:45.680269 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a7a5d-5eb1-4f86-aa41-a60ba7de18d2 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:45.696061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a7a5d-5eb1-4f86-aa41-a60ba7de18d2 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:45.700223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 902/1819] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:45 2022] POST /identity/v3/users => generated 293 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:45.701898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4b425-ad12-4bc0-ba94-c73f101dadf2 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:45.702077 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af87cc-7feb-4c15-892c-06618b88a4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:45.702690 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af87cc-7feb-4c15-892c-06618b88a4ec admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.703020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af87cc-7feb-4c15-892c-06618b88a4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.703318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af87cc-7feb-4c15-892c-06618b88a4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.704088 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af87cc-7feb-4c15-892c-06618b88a4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:45.705699 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af87cc-7feb-4c15-892c-06618b88a4ec admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:45.712571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4b425-ad12-4bc0-ba94-c73f101dadf2 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:45.719784 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 918/1820] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:45.720974 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af87cc-7feb-4c15-892c-06618b88a4ec admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:45.725382 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7220c-3af0-4fbc-9cf2-54bb9b0b0544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:45.726369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7220c-3af0-4fbc-9cf2-54bb9b0b0544 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.726802 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7220c-3af0-4fbc-9cf2-54bb9b0b0544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.727250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e7220c-3af0-4fbc-9cf2-54bb9b0b0544 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.728059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7220c-3af0-4fbc-9cf2-54bb9b0b0544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:45.730434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e7220c-3af0-4fbc-9cf2-54bb9b0b0544 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:45.731628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af87cc-7feb-4c15-892c-06618b88a4ec admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:45.737426 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcce3c-6ae0-4171-9e67-339213145bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:45.738096 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcce3c-6ae0-4171-9e67-339213145bff admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.738376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcce3c-6ae0-4171-9e67-339213145bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.738649 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcce3c-6ae0-4171-9e67-339213145bff admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.739332 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcce3c-6ae0-4171-9e67-339213145bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:45.741169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcce3c-6ae0-4171-9e67-339213145bff admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:45.756179 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 919/1821] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:45.757077 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcce3c-6ae0-4171-9e67-339213145bff admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:45.776147 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcce3c-6ae0-4171-9e67-339213145bff admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:45.780490 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 903/1822] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:45 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:45.780490 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7220c-3af0-4fbc-9cf2-54bb9b0b0544 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:45.822477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:45.838154 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:45.842718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602d6c5-a318-4bc3-96e6-870fe0d85402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:45.843364 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d6c5-a318-4bc3-96e6-870fe0d85402 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.843646 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d6c5-a318-4bc3-96e6-870fe0d85402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.843922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d6c5-a318-4bc3-96e6-870fe0d85402 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.844581 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602d6c5-a318-4bc3-96e6-870fe0d85402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:45.846216 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602d6c5-a318-4bc3-96e6-870fe0d85402 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:45.851132 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e7220c-3af0-4fbc-9cf2-54bb9b0b0544 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:45.857045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27407c8b-107f-43e9-80f5-149fccf6483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:45.857178 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 920/1823] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:45.857657 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27407c8b-107f-43e9-80f5-149fccf6483c admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.857851 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602d6c5-a318-4bc3-96e6-870fe0d85402 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:45.857934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27407c8b-107f-43e9-80f5-149fccf6483c admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.858345 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27407c8b-107f-43e9-80f5-149fccf6483c admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.859027 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27407c8b-107f-43e9-80f5-149fccf6483c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:45.860626 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27407c8b-107f-43e9-80f5-149fccf6483c admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:45.869125 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602d6c5-a318-4bc3-96e6-870fe0d85402 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:45.875488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 904/1824] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:45.875488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27407c8b-107f-43e9-80f5-149fccf6483c admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:45.878614 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c5329-2014-492d-96c7-40cea132d365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:45.879406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5329-2014-492d-96c7-40cea132d365 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.879813 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5329-2014-492d-96c7-40cea132d365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.880172 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5329-2014-492d-96c7-40cea132d365 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.880885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c5329-2014-492d-96c7-40cea132d365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:45.883243 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261c5329-2014-492d-96c7-40cea132d365 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:45.887101 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27407c8b-107f-43e9-80f5-149fccf6483c admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:45.891896 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73518f-eb46-4284-85a4-308034a7a2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:45.892559 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73518f-eb46-4284-85a4-308034a7a2da admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.892840 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73518f-eb46-4284-85a4-308034a7a2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.893120 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73518f-eb46-4284-85a4-308034a7a2da admin admin] PATH_INFO: `/v3/projects/91134815e3724c458b4dff6bcf974414/users/19c4b2a2f39e4781b9c89c26e6250c42/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.907133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 921/1825] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:45 2022] POST /identity/v3/users => generated 291 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:45.908121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c5329-2014-492d-96c7-40cea132d365 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:45.911521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73518f-eb46-4284-85a4-308034a7a2da admin admin] RBAC: Authorizing `identity:create_grant(project_id=91134815e3724c458b4dff6bcf974414, user_id=19c4b2a2f39e4781b9c89c26e6250c42, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:45.914385 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73518f-eb46-4284-85a4-308034a7a2da admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:45.921917 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c5329-2014-492d-96c7-40cea132d365 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:45.927734 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411185e8-3561-442d-88a7-550911ee2671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:45.928425 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411185e8-3561-442d-88a7-550911ee2671 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.928706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411185e8-3561-442d-88a7-550911ee2671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.928979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411185e8-3561-442d-88a7-550911ee2671 admin admin] PATH_INFO: `/v3/projects/a42d68adcb2d4ab3b51590dcdbb8cfbc/users/b3455d2a3c3d4d139544e88e7b04b0d3/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:45.930521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 905/1826] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:45 2022] PUT /identity/v3/projects/91134815e3724c458b4dff6bcf974414/users/19c4b2a2f39e4781b9c89c26e6250c42/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:45.931312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73518f-eb46-4284-85a4-308034a7a2da admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:45.946743 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411185e8-3561-442d-88a7-550911ee2671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42d68adcb2d4ab3b51590dcdbb8cfbc, user_id=b3455d2a3c3d4d139544e88e7b04b0d3, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:45.951536 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411185e8-3561-442d-88a7-550911ee2671 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:45.968438 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 922/1827] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:45 2022] PUT /identity/v3/projects/a42d68adcb2d4ab3b51590dcdbb8cfbc/users/b3455d2a3c3d4d139544e88e7b04b0d3/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:45.969869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45e10f-24c4-4c07-951e-b60427049f18 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:45.970297 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45e10f-24c4-4c07-951e-b60427049f18 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:45.970588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45e10f-24c4-4c07-951e-b60427049f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:46.004701 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-1f45e10f-24c4-4c07-951e-b60427049f18 None None] MFA Rules not processed for user `19c4b2a2f39e4781b9c89c26e6250c42`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:46.005923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1f45e10f-24c4-4c07-951e-b60427049f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:46.014172 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73518f-eb46-4284-85a4-308034a7a2da admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:46.073067 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 923/1828] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:46.075298 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc679b-17ca-4589-b0ea-6e13ae1b26d3 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:46.075718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc679b-17ca-4589-b0ea-6e13ae1b26d3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:46.076001 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc679b-17ca-4589-b0ea-6e13ae1b26d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:46.078719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf80f39-cf35-4ece-9375-a05499aa8c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:46.079371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf80f39-cf35-4ece-9375-a05499aa8c9e admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:46.079653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf80f39-cf35-4ece-9375-a05499aa8c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:46.079929 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf80f39-cf35-4ece-9375-a05499aa8c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:46.080603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf80f39-cf35-4ece-9375-a05499aa8c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:46.082198 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf80f39-cf35-4ece-9375-a05499aa8c9e admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:46.096390 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 906/1829] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:46.096390 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf80f39-cf35-4ece-9375-a05499aa8c9e admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:46.096675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-51bc679b-17ca-4589-b0ea-6e13ae1b26d3 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:46.096675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-51bc679b-17ca-4589-b0ea-6e13ae1b26d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:46.104184 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf80f39-cf35-4ece-9375-a05499aa8c9e admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:46.104501 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 924/1830] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:46.104501 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc679b-17ca-4589-b0ea-6e13ae1b26d3 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:46.109947 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b1ad1-c481-4b59-8041-3f9a1e4faa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:46.110427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b1ad1-c481-4b59-8041-3f9a1e4faa1b admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:46.110710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b1ad1-c481-4b59-8041-3f9a1e4faa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:46.111553 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b1ad1-c481-4b59-8041-3f9a1e4faa1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:46.111659 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b1ad1-c481-4b59-8041-3f9a1e4faa1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:46.113525 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b1ad1-c481-4b59-8041-3f9a1e4faa1b admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:46.114777 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc679b-17ca-4589-b0ea-6e13ae1b26d3 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:46.119829 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842cca9-6790-4e8b-afdf-f5c0e3315101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:46.120973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842cca9-6790-4e8b-afdf-f5c0e3315101 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:46.121371 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842cca9-6790-4e8b-afdf-f5c0e3315101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:46.121646 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842cca9-6790-4e8b-afdf-f5c0e3315101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:46.122283 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842cca9-6790-4e8b-afdf-f5c0e3315101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:46.123898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842cca9-6790-4e8b-afdf-f5c0e3315101 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:46.135262 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 925/1831] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:46.140050 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842cca9-6790-4e8b-afdf-f5c0e3315101 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:46.141765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5842cca9-6790-4e8b-afdf-f5c0e3315101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:46.145097 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 907/1832] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:46 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:46.145857 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b1ad1-c481-4b59-8041-3f9a1e4faa1b admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:46.203276 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842cca9-6790-4e8b-afdf-f5c0e3315101 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:46.203841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:46.226158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b1ad1-c481-4b59-8041-3f9a1e4faa1b admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:46.227130 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:46.232626 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec10052-234b-463a-a0a2-c399b9d8b3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:46.233446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec10052-234b-463a-a0a2-c399b9d8b3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:46.233749 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec10052-234b-463a-a0a2-c399b9d8b3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:46.234130 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec10052-234b-463a-a0a2-c399b9d8b3f0 admin admin] PATH_INFO: `/v3/projects/8f16eaa708654a069faa6434afea597b/users/534a714eb912475fb8cc8e5008b63a6d/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:46.252527 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec10052-234b-463a-a0a2-c399b9d8b3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f16eaa708654a069faa6434afea597b, user_id=534a714eb912475fb8cc8e5008b63a6d, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:46.255251 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec10052-234b-463a-a0a2-c399b9d8b3f0 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:46.260582 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3068eb6-fa93-48b6-b936-14ba216f61de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:46.262575 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3068eb6-fa93-48b6-b936-14ba216f61de service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:46.262927 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3068eb6-fa93-48b6-b936-14ba216f61de service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:46.263305 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3068eb6-fa93-48b6-b936-14ba216f61de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:46.272970 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3068eb6-fa93-48b6-b936-14ba216f61de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:46.274378 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3068eb6-fa93-48b6-b936-14ba216f61de service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:46.275405 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 908/1833] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:46 2022] PUT /identity/v3/projects/8f16eaa708654a069faa6434afea597b/users/534a714eb912475fb8cc8e5008b63a6d/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:46.281547 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec10052-234b-463a-a0a2-c399b9d8b3f0 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:46.285281 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 926/1834] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:46.286407 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f37fd-b2b6-4461-a707-44099cb8b008 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:46.286678 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f37fd-b2b6-4461-a707-44099cb8b008 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:46.286959 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f37fd-b2b6-4461-a707-44099cb8b008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:46.308523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-2a5f37fd-b2b6-4461-a707-44099cb8b008 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:46.310101 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2a5f37fd-b2b6-4461-a707-44099cb8b008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:46.379555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec10052-234b-463a-a0a2-c399b9d8b3f0 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:46.384591 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69607249-a09a-4ac6-8c46-c99ca2929683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:46.385353 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69607249-a09a-4ac6-8c46-c99ca2929683 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:46.385731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69607249-a09a-4ac6-8c46-c99ca2929683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:46.386137 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69607249-a09a-4ac6-8c46-c99ca2929683 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:46.387621 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69607249-a09a-4ac6-8c46-c99ca2929683 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:46.389594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69607249-a09a-4ac6-8c46-c99ca2929683 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:46.415420 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 927/1835] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:46.419479 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 909/1836] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:46 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:46.420886 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f37fd-b2b6-4461-a707-44099cb8b008 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:46.431779 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69607249-a09a-4ac6-8c46-c99ca2929683 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:46.434777 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f37fd-b2b6-4461-a707-44099cb8b008 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:46.437049 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-69607249-a09a-4ac6-8c46-c99ca2929683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:46.440785 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834b333-39c3-4c5e-b9c6-14b054f92f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:46.441533 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834b333-39c3-4c5e-b9c6-14b054f92f7d admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:46.441882 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834b333-39c3-4c5e-b9c6-14b054f92f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:46.442263 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834b333-39c3-4c5e-b9c6-14b054f92f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:46.443090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834b333-39c3-4c5e-b9c6-14b054f92f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:46.445100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834b333-39c3-4c5e-b9c6-14b054f92f7d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:46.460687 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 928/1837] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:36:46.467203 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834b333-39c3-4c5e-b9c6-14b054f92f7d admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:46.479545 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834b333-39c3-4c5e-b9c6-14b054f92f7d admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:46.486809 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d9a34-fdb6-470d-9598-bd7a6b4479bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:46.487451 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d9a34-fdb6-470d-9598-bd7a6b4479bc admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:46.487730 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d9a34-fdb6-470d-9598-bd7a6b4479bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:46.488035 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d9a34-fdb6-470d-9598-bd7a6b4479bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:46.488873 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d9a34-fdb6-470d-9598-bd7a6b4479bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:46.490566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d9a34-fdb6-470d-9598-bd7a6b4479bc admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:46.506513 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 929/1838] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:46.510587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d9a34-fdb6-470d-9598-bd7a6b4479bc admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:46.549957 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d9a34-fdb6-470d-9598-bd7a6b4479bc admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:46.555852 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcad3cb-7c8e-4581-94a7-4a872057eed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:46.557083 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcad3cb-7c8e-4581-94a7-4a872057eed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:46.558752 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcad3cb-7c8e-4581-94a7-4a872057eed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:46.559223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcad3cb-7c8e-4581-94a7-4a872057eed4 admin admin] PATH_INFO: `/v3/projects/884268a3c2fb4e13a4090fbedf8fcd84/users/3cf7e71db3204b09bd0fedf5f5ce30b3/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:46.582026 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcad3cb-7c8e-4581-94a7-4a872057eed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884268a3c2fb4e13a4090fbedf8fcd84, user_id=3cf7e71db3204b09bd0fedf5f5ce30b3, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:46.586740 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcad3cb-7c8e-4581-94a7-4a872057eed4 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:46.588400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69607249-a09a-4ac6-8c46-c99ca2929683 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:46.593104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5211822-77af-4f50-9116-f4d4fa2e5c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:46.593811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5211822-77af-4f50-9116-f4d4fa2e5c88 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:46.594157 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5211822-77af-4f50-9116-f4d4fa2e5c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:46.594517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5211822-77af-4f50-9116-f4d4fa2e5c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:46.608321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5211822-77af-4f50-9116-f4d4fa2e5c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:46.610517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5211822-77af-4f50-9116-f4d4fa2e5c88 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:46.614255 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 930/1839] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:46 2022] PUT /identity/v3/projects/884268a3c2fb4e13a4090fbedf8fcd84/users/3cf7e71db3204b09bd0fedf5f5ce30b3/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:46.627739 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95ba80-c316-4881-addf-d5b7abe6bbdc None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:46.627739 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95ba80-c316-4881-addf-d5b7abe6bbdc None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:46.627916 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95ba80-c316-4881-addf-d5b7abe6bbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:46.650340 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 910/1840] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:46.688466 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-9e95ba80-c316-4881-addf-d5b7abe6bbdc None None] MFA Rules not processed for user `3cf7e71db3204b09bd0fedf5f5ce30b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:46.689974 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9e95ba80-c316-4881-addf-d5b7abe6bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:46.771095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 931/1841] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:46.777474 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5211822-77af-4f50-9116-f4d4fa2e5c88 service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:46.821779 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5211822-77af-4f50-9116-f4d4fa2e5c88 service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:46.960902 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5930be4-dd20-47a2-ab61-b44dceb1624f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:46.961691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5930be4-dd20-47a2-ab61-b44dceb1624f admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:46.962073 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5930be4-dd20-47a2-ab61-b44dceb1624f admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:46.963174 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5930be4-dd20-47a2-ab61-b44dceb1624f admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:46.964073 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5930be4-dd20-47a2-ab61-b44dceb1624f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:46.967286 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5930be4-dd20-47a2-ab61-b44dceb1624f admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:46.973607 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:47.018987 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 911/1842] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:46 2022] POST /identity/v3/projects => generated 383 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:47.021393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95ba80-c316-4881-addf-d5b7abe6bbdc None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:47.032991 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95ba80-c316-4881-addf-d5b7abe6bbdc None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:47.046625 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:47.135949 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980249b-0bbe-41ca-9f8f-7a46121594d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:47.136914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980249b-0bbe-41ca-9f8f-7a46121594d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:47.137462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980249b-0bbe-41ca-9f8f-7a46121594d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:47.139027 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a980249b-0bbe-41ca-9f8f-7a46121594d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:47.140382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980249b-0bbe-41ca-9f8f-7a46121594d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:47.142688 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a980249b-0bbe-41ca-9f8f-7a46121594d5 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:47.180934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 932/1843] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:47 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:47.183571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5930be4-dd20-47a2-ab61-b44dceb1624f admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:47.198335 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5930be4-dd20-47a2-ab61-b44dceb1624f admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:47.206087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a07fa-2a7b-4dcd-8a91-84325239a55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:47.207806 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a07fa-2a7b-4dcd-8a91-84325239a55e admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:47.208327 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a07fa-2a7b-4dcd-8a91-84325239a55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:47.208808 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a07fa-2a7b-4dcd-8a91-84325239a55e admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:47.209740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a07fa-2a7b-4dcd-8a91-84325239a55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:47.212558 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a07fa-2a7b-4dcd-8a91-84325239a55e admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:47.231620 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 912/1844] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:36:47.232771 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980249b-0bbe-41ca-9f8f-7a46121594d5 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:47.246970 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a980249b-0bbe-41ca-9f8f-7a46121594d5 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:47.264448 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bc997-c99c-452e-a248-2c83b90b841d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:47.265149 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bc997-c99c-452e-a248-2c83b90b841d admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:47.265439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bc997-c99c-452e-a248-2c83b90b841d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:47.265784 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bc997-c99c-452e-a248-2c83b90b841d admin admin] PATH_INFO: `/v3/projects/b9570641606c436786daa989839b778b/users/365a366a7a184f6cb3afb9dca21e31f7/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:47.299185 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bc997-c99c-452e-a248-2c83b90b841d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9570641606c436786daa989839b778b, user_id=365a366a7a184f6cb3afb9dca21e31f7, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:47.301856 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bc997-c99c-452e-a248-2c83b90b841d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:47.331321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 933/1845] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:47 2022] PUT /identity/v3/projects/b9570641606c436786daa989839b778b/users/365a366a7a184f6cb3afb9dca21e31f7/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:47.334033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a07fa-2a7b-4dcd-8a91-84325239a55e admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:47.354612 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a07fa-2a7b-4dcd-8a91-84325239a55e admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:47.461705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca56ba61-7707-463c-943a-80833e5be7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:47.462344 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56ba61-7707-463c-943a-80833e5be7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:47.462629 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56ba61-7707-463c-943a-80833e5be7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:47.462908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca56ba61-7707-463c-943a-80833e5be7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:47.466250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56ba61-7707-463c-943a-80833e5be7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:47.468352 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca56ba61-7707-463c-943a-80833e5be7e6 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:47.491421 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 913/1846] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:47.497637 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bc997-c99c-452e-a248-2c83b90b841d admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:47.516193 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bc997-c99c-452e-a248-2c83b90b841d admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:47.522531 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fefc2-6703-4826-8941-b17261132d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:47.523817 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fefc2-6703-4826-8941-b17261132d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:47.523817 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fefc2-6703-4826-8941-b17261132d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:47.524282 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141fefc2-6703-4826-8941-b17261132d4f admin admin] PATH_INFO: `/v3/projects/b9570641606c436786daa989839b778b/users/365a366a7a184f6cb3afb9dca21e31f7/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:47.532607 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fefc2-6703-4826-8941-b17261132d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9570641606c436786daa989839b778b, user_id=365a366a7a184f6cb3afb9dca21e31f7, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:47.535686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141fefc2-6703-4826-8941-b17261132d4f admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:47.577925 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 934/1847] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:47 2022] PUT /identity/v3/projects/b9570641606c436786daa989839b778b/users/365a366a7a184f6cb3afb9dca21e31f7/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:47.588872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c44b5e-c998-4d75-9ab0-7fb1ada2015d None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:47.589260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c44b5e-c998-4d75-9ab0-7fb1ada2015d None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:47.589571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c44b5e-c998-4d75-9ab0-7fb1ada2015d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:47.651270 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-93c44b5e-c998-4d75-9ab0-7fb1ada2015d None None] MFA Rules not processed for user `365a366a7a184f6cb3afb9dca21e31f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:47.653588 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-93c44b5e-c998-4d75-9ab0-7fb1ada2015d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:47.819539 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 914/1848] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:36:47.893377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fefc2-6703-4826-8941-b17261132d4f admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:47.895467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-141fefc2-6703-4826-8941-b17261132d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:48.012094 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141fefc2-6703-4826-8941-b17261132d4f admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:48.036755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d506c-b1e2-47a7-bdc5-681aaa4d15d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:48.037607 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d506c-b1e2-47a7-bdc5-681aaa4d15d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:48.038317 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d506c-b1e2-47a7-bdc5-681aaa4d15d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:48.038703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d506c-b1e2-47a7-bdc5-681aaa4d15d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:48.157865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d506c-b1e2-47a7-bdc5-681aaa4d15d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:48.159487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d506c-b1e2-47a7-bdc5-681aaa4d15d5 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:48.189491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 935/1849] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:48.665388 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d8f75-8076-4fd3-a439-6e2d48598af1 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:48.665839 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d8f75-8076-4fd3-a439-6e2d48598af1 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:48.666263 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d8f75-8076-4fd3-a439-6e2d48598af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:48.701321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-908d8f75-8076-4fd3-a439-6e2d48598af1 None None] MFA Rules not processed for user `534a714eb912475fb8cc8e5008b63a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:48.704364 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-908d8f75-8076-4fd3-a439-6e2d48598af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:48.782171 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:48.815002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 915/1850] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:48.827899 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d506c-b1e2-47a7-bdc5-681aaa4d15d5 service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:48.849573 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d506c-b1e2-47a7-bdc5-681aaa4d15d5 service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:48.857907 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e12467-a0d0-4767-9876-563526505a97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:48.858540 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e12467-a0d0-4767-9876-563526505a97 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:48.858845 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e12467-a0d0-4767-9876-563526505a97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:48.859167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e12467-a0d0-4767-9876-563526505a97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:48.875617 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e12467-a0d0-4767-9876-563526505a97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:48.882388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e12467-a0d0-4767-9876-563526505a97 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:48.897996 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 936/1851] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:36:49.225546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d8f75-8076-4fd3-a439-6e2d48598af1 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:49.226504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-908d8f75-8076-4fd3-a439-6e2d48598af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:49.410991 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d8f75-8076-4fd3-a439-6e2d48598af1 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:49.424787 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80b2d0-ba1c-4982-b861-047326f41050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:49.425615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80b2d0-ba1c-4982-b861-047326f41050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:49.426364 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80b2d0-ba1c-4982-b861-047326f41050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:49.426364 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80b2d0-ba1c-4982-b861-047326f41050 admin admin] PATH_INFO: `/v3/users/0796906f4faa45c09ca5a1ae59749ce0` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:49.428662 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80b2d0-ba1c-4982-b861-047326f41050 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0796906f4faa45c09ca5a1ae59749ce0)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:49.431070 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80b2d0-ba1c-4982-b861-047326f41050 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:49.536263 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-8a80b2d0-ba1c-4982-b861-047326f41050 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0796906f4faa45c09ca5a1ae59749ce0'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:49.537088 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-8a80b2d0-ba1c-4982-b861-047326f41050 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0796906f4faa45c09ca5a1ae59749ce0'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:49.557021 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-8a80b2d0-ba1c-4982-b861-047326f41050 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0796906f4faa45c09ca5a1ae59749ce0'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:49.581847 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-8a80b2d0-ba1c-4982-b861-047326f41050 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0796906f4faa45c09ca5a1ae59749ce0'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:49.583018 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-8a80b2d0-ba1c-4982-b861-047326f41050 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0796906f4faa45c09ca5a1ae59749ce0'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:49.603219 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 916/1852] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:49 2022] DELETE /identity/v3/users/0796906f4faa45c09ca5a1ae59749ce0 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:49.608405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29e55e-3036-4aee-9292-35520bdcecf4 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:49.608893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29e55e-3036-4aee-9292-35520bdcecf4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:49.609057 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29e55e-3036-4aee-9292-35520bdcecf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:49.618896 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:49.637152 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ff29e55e-3036-4aee-9292-35520bdcecf4 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:49.638594 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ff29e55e-3036-4aee-9292-35520bdcecf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:49.780209 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 937/1853] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:49.791208 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80b2d0-ba1c-4982-b861-047326f41050 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:49.794511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8a80b2d0-ba1c-4982-b861-047326f41050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:49.904869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80b2d0-ba1c-4982-b861-047326f41050 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:49.912045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe30840-9c83-4ec7-b4cf-9d055294c216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:49.913136 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe30840-9c83-4ec7-b4cf-9d055294c216 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:49.913608 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe30840-9c83-4ec7-b4cf-9d055294c216 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:49.914062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe30840-9c83-4ec7-b4cf-9d055294c216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:49.927906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe30840-9c83-4ec7-b4cf-9d055294c216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:49.930219 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe30840-9c83-4ec7-b4cf-9d055294c216 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:49.945184 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 917/1854] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:36:50.028413 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29e55e-3036-4aee-9292-35520bdcecf4 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:50.030565 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ff29e55e-3036-4aee-9292-35520bdcecf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:50.110897 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff29e55e-3036-4aee-9292-35520bdcecf4 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:50.114896 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d0def-aa38-4e1c-a391-07753fe1b498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:50.115555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d0def-aa38-4e1c-a391-07753fe1b498 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:50.115839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d0def-aa38-4e1c-a391-07753fe1b498 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:50.116111 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d0def-aa38-4e1c-a391-07753fe1b498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:50.118196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-048d0def-aa38-4e1c-a391-07753fe1b498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:50.196236 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe30840-9c83-4ec7-b4cf-9d055294c216 service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:50.199084 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-bfe30840-9c83-4ec7-b4cf-9d055294c216 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:50.228699 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe30840-9c83-4ec7-b4cf-9d055294c216 service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:50.235219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d0def-aa38-4e1c-a391-07753fe1b498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:50.239802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d0def-aa38-4e1c-a391-07753fe1b498 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:50.241428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70197742-5379-44ce-a078-6283485ce9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:50.242362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197742-5379-44ce-a078-6283485ce9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:50.243278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197742-5379-44ce-a078-6283485ce9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:50.244574 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70197742-5379-44ce-a078-6283485ce9de admin admin] PATH_INFO: `/v3/users/2370a9817fcd47d7b7bc7fd63d0bf73b` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:50.246266 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70197742-5379-44ce-a078-6283485ce9de admin admin] RBAC: Authorizing `identity:delete_user(user_id=2370a9817fcd47d7b7bc7fd63d0bf73b)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:50.249616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70197742-5379-44ce-a078-6283485ce9de admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:50.252892 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:50.262917 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 938/1855] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:50.357318 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-70197742-5379-44ce-a078-6283485ce9de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2370a9817fcd47d7b7bc7fd63d0bf73b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:50.358619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-70197742-5379-44ce-a078-6283485ce9de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2370a9817fcd47d7b7bc7fd63d0bf73b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:50.374917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-70197742-5379-44ce-a078-6283485ce9de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2370a9817fcd47d7b7bc7fd63d0bf73b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:50.397675 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-70197742-5379-44ce-a078-6283485ce9de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2370a9817fcd47d7b7bc7fd63d0bf73b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:50.398480 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-70197742-5379-44ce-a078-6283485ce9de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2370a9817fcd47d7b7bc7fd63d0bf73b'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:50.423391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 918/1856] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:50 2022] DELETE /identity/v3/users/2370a9817fcd47d7b7bc7fd63d0bf73b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:36:50.427835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c70ccf-73aa-495a-9c68-9ad79c062d18 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:50.428297 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c70ccf-73aa-495a-9c68-9ad79c062d18 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:50.429571 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c70ccf-73aa-495a-9c68-9ad79c062d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:50.487765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-11c70ccf-73aa-495a-9c68-9ad79c062d18 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:50.489727 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-11c70ccf-73aa-495a-9c68-9ad79c062d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:50.520723 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70197742-5379-44ce-a078-6283485ce9de admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:50.522471 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-70197742-5379-44ce-a078-6283485ce9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:50.591138 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:50.629647 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 939/1857] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:50.644101 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c70ccf-73aa-495a-9c68-9ad79c062d18 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:50.648523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-11c70ccf-73aa-495a-9c68-9ad79c062d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:50.703111 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70197742-5379-44ce-a078-6283485ce9de admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:50.713820 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade7ca0-c803-4390-9cf5-7ddff7573135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:50.723221 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade7ca0-c803-4390-9cf5-7ddff7573135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:50.723525 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade7ca0-c803-4390-9cf5-7ddff7573135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:50.723804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade7ca0-c803-4390-9cf5-7ddff7573135 admin admin] PATH_INFO: `/v3/projects/822fdfa0b0ed45f39ba10d980a58601c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:50.734610 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade7ca0-c803-4390-9cf5-7ddff7573135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=822fdfa0b0ed45f39ba10d980a58601c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:50.740410 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade7ca0-c803-4390-9cf5-7ddff7573135 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:50.884051 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c70ccf-73aa-495a-9c68-9ad79c062d18 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:50.907310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-dade7ca0-c803-4390-9cf5-7ddff7573135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822fdfa0b0ed45f39ba10d980a58601c', 'request_id': 'req-dade7ca0-c803-4390-9cf5-7ddff7573135'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:50.934369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-dade7ca0-c803-4390-9cf5-7ddff7573135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822fdfa0b0ed45f39ba10d980a58601c', 'request_id': 'req-dade7ca0-c803-4390-9cf5-7ddff7573135'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:50.963289 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-dade7ca0-c803-4390-9cf5-7ddff7573135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822fdfa0b0ed45f39ba10d980a58601c', 'request_id': 'req-dade7ca0-c803-4390-9cf5-7ddff7573135'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:50.999990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-dade7ca0-c803-4390-9cf5-7ddff7573135 admin admin] The token cache is being invalidate because project 822fdfa0b0ed45f39ba10d980a58601c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:50.999990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-dade7ca0-c803-4390-9cf5-7ddff7573135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:51.003111 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-dade7ca0-c803-4390-9cf5-7ddff7573135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:51.008013 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 919/1858] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:50 2022] DELETE /identity/v3/projects/822fdfa0b0ed45f39ba10d980a58601c => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:36:51.008013 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce03595-4be4-4867-961a-b6bd74a8547f None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:51.008013 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce03595-4be4-4867-961a-b6bd74a8547f None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:51.008013 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce03595-4be4-4867-961a-b6bd74a8547f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:51.054962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-0ce03595-4be4-4867-961a-b6bd74a8547f None None] MFA Rules not processed for user `534a714eb912475fb8cc8e5008b63a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:51.056236 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0ce03595-4be4-4867-961a-b6bd74a8547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:51.063678 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:51.113223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e8125-a2c0-4106-8421-fa839bd0a2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:51.114412 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e8125-a2c0-4106-8421-fa839bd0a2da service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:51.117616 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e8125-a2c0-4106-8421-fa839bd0a2da service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:51.119350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e8125-a2c0-4106-8421-fa839bd0a2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:51.124884 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-300e8125-a2c0-4106-8421-fa839bd0a2da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:51.191772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 920/1859] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:51.195637 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce03595-4be4-4867-961a-b6bd74a8547f None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:51.197519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0ce03595-4be4-4867-961a-b6bd74a8547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:51.328217 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e8125-a2c0-4106-8421-fa839bd0a2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:51.330122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e8125-a2c0-4106-8421-fa839bd0a2da service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:51.344809 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 940/1860] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:51.403132 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce03595-4be4-4867-961a-b6bd74a8547f None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:51.435923 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fe67f-511c-4029-a6c7-e999b647de03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:51.436712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fe67f-511c-4029-a6c7-e999b647de03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:51.436999 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fe67f-511c-4029-a6c7-e999b647de03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:51.437283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334fe67f-511c-4029-a6c7-e999b647de03 admin admin] PATH_INFO: `/v3/users/70131c3f63294889ad0f4e9c831847ab` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:51.439101 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fe67f-511c-4029-a6c7-e999b647de03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70131c3f63294889ad0f4e9c831847ab)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:51.441246 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334fe67f-511c-4029-a6c7-e999b647de03 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:51.466557 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e8125-a2c0-4106-8421-fa839bd0a2da service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:51.469864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-300e8125-a2c0-4106-8421-fa839bd0a2da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:51.560291 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-334fe67f-511c-4029-a6c7-e999b647de03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70131c3f63294889ad0f4e9c831847ab'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:51.561261 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-334fe67f-511c-4029-a6c7-e999b647de03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70131c3f63294889ad0f4e9c831847ab'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:51.581338 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-334fe67f-511c-4029-a6c7-e999b647de03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70131c3f63294889ad0f4e9c831847ab'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:51.590352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e8125-a2c0-4106-8421-fa839bd0a2da service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:51.601473 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60006c-57a0-4fcb-a830-d2815fa12f1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:51.602293 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60006c-57a0-4fcb-a830-d2815fa12f1c service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:51.603219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60006c-57a0-4fcb-a830-d2815fa12f1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:51.603573 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60006c-57a0-4fcb-a830-d2815fa12f1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:51.609227 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7e60006c-57a0-4fcb-a830-d2815fa12f1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:51.613060 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-334fe67f-511c-4029-a6c7-e999b647de03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70131c3f63294889ad0f4e9c831847ab'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:51.614033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-334fe67f-511c-4029-a6c7-e999b647de03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70131c3f63294889ad0f4e9c831847ab'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:51.634388 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 921/1861] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:51 2022] DELETE /identity/v3/users/70131c3f63294889ad0f4e9c831847ab => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:51.649393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:51.710696 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60006c-57a0-4fcb-a830-d2815fa12f1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:51.713219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60006c-57a0-4fcb-a830-d2815fa12f1c service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:51.726610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 941/1862] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:52.315632 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fe67f-511c-4029-a6c7-e999b647de03 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:52.317314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-334fe67f-511c-4029-a6c7-e999b647de03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:52.399578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:52.445317 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60006c-57a0-4fcb-a830-d2815fa12f1c service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:52.458226 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60006c-57a0-4fcb-a830-d2815fa12f1c service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:52.466845 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334fe67f-511c-4029-a6c7-e999b647de03 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:52.470792 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f8277-9636-4b84-b6bc-9f7e082c3e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:52.471913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f8277-9636-4b84-b6bc-9f7e082c3e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:52.471913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f8277-9636-4b84-b6bc-9f7e082c3e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:52.472137 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f8277-9636-4b84-b6bc-9f7e082c3e79 admin admin] PATH_INFO: `/v3/projects/32e3b0a023b9450686ee231b64bac6dc` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:52.477505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f8277-9636-4b84-b6bc-9f7e082c3e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32e3b0a023b9450686ee231b64bac6dc)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:52.479552 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f8277-9636-4b84-b6bc-9f7e082c3e79 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:52.486693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6febff-97eb-4b2a-8537-ff11af5bfb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:52.487675 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6febff-97eb-4b2a-8537-ff11af5bfb6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:52.489614 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6febff-97eb-4b2a-8537-ff11af5bfb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:52.490588 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6febff-97eb-4b2a-8537-ff11af5bfb6a admin admin] PATH_INFO: `/v3/projects/f1fffc3f405a469485b8fee622928aa3` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:52.510482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6febff-97eb-4b2a-8537-ff11af5bfb6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1fffc3f405a469485b8fee622928aa3)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:52.520219 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6febff-97eb-4b2a-8537-ff11af5bfb6a admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:52.564023 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-880f8277-9636-4b84-b6bc-9f7e082c3e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32e3b0a023b9450686ee231b64bac6dc', 'request_id': 'req-880f8277-9636-4b84-b6bc-9f7e082c3e79'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:52.576648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-880f8277-9636-4b84-b6bc-9f7e082c3e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32e3b0a023b9450686ee231b64bac6dc', 'request_id': 'req-880f8277-9636-4b84-b6bc-9f7e082c3e79'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:52.584315 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-880f8277-9636-4b84-b6bc-9f7e082c3e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32e3b0a023b9450686ee231b64bac6dc', 'request_id': 'req-880f8277-9636-4b84-b6bc-9f7e082c3e79'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:52.601930 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-880f8277-9636-4b84-b6bc-9f7e082c3e79 admin admin] The token cache is being invalidate because project 32e3b0a023b9450686ee231b64bac6dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:52.602327 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-880f8277-9636-4b84-b6bc-9f7e082c3e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:52.603722 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-880f8277-9636-4b84-b6bc-9f7e082c3e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:52.611404 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 942/1863] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:52 2022] DELETE /identity/v3/projects/32e3b0a023b9450686ee231b64bac6dc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:52.613752 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e54ef-1703-4185-8295-92af17646d95 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:52.614134 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e54ef-1703-4185-8295-92af17646d95 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:52.614546 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e54ef-1703-4185-8295-92af17646d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:52.639787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-861e54ef-1703-4185-8295-92af17646d95 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:52.641285 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-861e54ef-1703-4185-8295-92af17646d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:52.705023 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7c6febff-97eb-4b2a-8537-ff11af5bfb6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1fffc3f405a469485b8fee622928aa3', 'request_id': 'req-7c6febff-97eb-4b2a-8537-ff11af5bfb6a'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:52.717585 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7c6febff-97eb-4b2a-8537-ff11af5bfb6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1fffc3f405a469485b8fee622928aa3', 'request_id': 'req-7c6febff-97eb-4b2a-8537-ff11af5bfb6a'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:52.749928 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7c6febff-97eb-4b2a-8537-ff11af5bfb6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1fffc3f405a469485b8fee622928aa3', 'request_id': 'req-7c6febff-97eb-4b2a-8537-ff11af5bfb6a'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:52.774192 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7c6febff-97eb-4b2a-8537-ff11af5bfb6a admin admin] The token cache is being invalidate because project f1fffc3f405a469485b8fee622928aa3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:52.774496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7c6febff-97eb-4b2a-8537-ff11af5bfb6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:52.775334 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7c6febff-97eb-4b2a-8537-ff11af5bfb6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:52.780548 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 922/1864] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:52 2022] DELETE /identity/v3/projects/f1fffc3f405a469485b8fee622928aa3 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:52.794718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 943/1865] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:52.796813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaa580-9513-401a-b544-cd6105ca7fda None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:52.797131 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaa580-9513-401a-b544-cd6105ca7fda None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:52.797395 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaa580-9513-401a-b544-cd6105ca7fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:52.803648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cfe58-3bfa-42bd-a348-f3b05d120836 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:52.803932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cfe58-3bfa-42bd-a348-f3b05d120836 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:52.804456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cfe58-3bfa-42bd-a348-f3b05d120836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:52.838883 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-7bdaa580-9513-401a-b544-cd6105ca7fda None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:52.840649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7bdaa580-9513-401a-b544-cd6105ca7fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:52.851929 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-697cfe58-3bfa-42bd-a348-f3b05d120836 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:52.853597 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-697cfe58-3bfa-42bd-a348-f3b05d120836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:52.869538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 923/1866] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:52.886018 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67217321-1f38-41e5-af48-4f688d24a71a None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:52.886674 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67217321-1f38-41e5-af48-4f688d24a71a None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:52.887052 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67217321-1f38-41e5-af48-4f688d24a71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:52.891254 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 944/1867] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:36:52.892363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cfe58-3bfa-42bd-a348-f3b05d120836 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:52.915101 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cfe58-3bfa-42bd-a348-f3b05d120836 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:52.927598 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5bfd4-501b-4f25-b863-dbe73af29278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:52.928223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5bfd4-501b-4f25-b863-dbe73af29278 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:52.928503 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5bfd4-501b-4f25-b863-dbe73af29278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:52.928775 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5bfd4-501b-4f25-b863-dbe73af29278 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:52.932279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5bfd4-501b-4f25-b863-dbe73af29278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:52.932585 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5bfd4-501b-4f25-b863-dbe73af29278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:52.935083 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5bfd4-501b-4f25-b863-dbe73af29278 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:52.938008 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-67217321-1f38-41e5-af48-4f688d24a71a None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:52.939201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-67217321-1f38-41e5-af48-4f688d24a71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:52.970070 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 945/1868] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:36:52.975600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 924/1869] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:52.976125 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5bfd4-501b-4f25-b863-dbe73af29278 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:52.976725 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67217321-1f38-41e5-af48-4f688d24a71a None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:53.005025 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5bfd4-501b-4f25-b863-dbe73af29278 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:53.005581 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67217321-1f38-41e5-af48-4f688d24a71a None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:53.027383 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e77c0-2dc8-424e-a087-6d56bac11799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:53.028098 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e77c0-2dc8-424e-a087-6d56bac11799 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:53.028382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e77c0-2dc8-424e-a087-6d56bac11799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:53.028658 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e77c0-2dc8-424e-a087-6d56bac11799 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:53.028770 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0ef86-e3df-47c5-91f4-e978cbd115a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:53.029296 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0ef86-e3df-47c5-91f4-e978cbd115a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:53.029415 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e77c0-2dc8-424e-a087-6d56bac11799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:53.029602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0ef86-e3df-47c5-91f4-e978cbd115a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:53.031119 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0ef86-e3df-47c5-91f4-e978cbd115a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:53.031350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e77c0-2dc8-424e-a087-6d56bac11799 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:53.031800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0ef86-e3df-47c5-91f4-e978cbd115a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:36:53.032113 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0ef86-e3df-47c5-91f4-e978cbd115a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:53.035567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe0ef86-e3df-47c5-91f4-e978cbd115a9 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:53.067891 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 925/1870] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:36:53.069558 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0ef86-e3df-47c5-91f4-e978cbd115a9 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:53.088230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe0ef86-e3df-47c5-91f4-e978cbd115a9 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:53.104675 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997c42d-cc7c-4a19-a48b-888d61afdd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:53.106224 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997c42d-cc7c-4a19-a48b-888d61afdd6c admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:53.107702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997c42d-cc7c-4a19-a48b-888d61afdd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:53.108894 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997c42d-cc7c-4a19-a48b-888d61afdd6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:53.109940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997c42d-cc7c-4a19-a48b-888d61afdd6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:53.117165 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7997c42d-cc7c-4a19-a48b-888d61afdd6c admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:53.132112 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:53.150748 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 946/1871] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:52 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:53.154921 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e77c0-2dc8-424e-a087-6d56bac11799 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:53.203820 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 926/1872] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:53 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:53.209403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997c42d-cc7c-4a19-a48b-888d61afdd6c admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:53.422468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e77c0-2dc8-424e-a087-6d56bac11799 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:53.442523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ef0da-ec22-4ee9-a163-7201a33fd070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:53.444214 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ef0da-ec22-4ee9-a163-7201a33fd070 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:53.444540 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ef0da-ec22-4ee9-a163-7201a33fd070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:53.444823 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ef0da-ec22-4ee9-a163-7201a33fd070 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:53.446476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ef0da-ec22-4ee9-a163-7201a33fd070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:53.449763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ef0da-ec22-4ee9-a163-7201a33fd070 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:53.473875 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997c42d-cc7c-4a19-a48b-888d61afdd6c admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:53.495761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395e308-f3f0-4bba-a96c-79430d1a72c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:53.496580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395e308-f3f0-4bba-a96c-79430d1a72c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:53.496891 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395e308-f3f0-4bba-a96c-79430d1a72c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:53.497221 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395e308-f3f0-4bba-a96c-79430d1a72c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:53.498046 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395e308-f3f0-4bba-a96c-79430d1a72c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:53.502638 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395e308-f3f0-4bba-a96c-79430d1a72c7 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:53.523558 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 947/1873] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:53 2022] POST /identity/v3/users => generated 292 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:53.527433 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ef0da-ec22-4ee9-a163-7201a33fd070 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:53.545684 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 927/1874] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:53 2022] POST /identity/v3/users => generated 283 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:53.552998 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ef0da-ec22-4ee9-a163-7201a33fd070 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:53.567537 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395e308-f3f0-4bba-a96c-79430d1a72c7 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:53.578037 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:53.584183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67500c7-4e08-4751-9515-7b95ddb4e485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:53.584341 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395e308-f3f0-4bba-a96c-79430d1a72c7 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:53.588601 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67500c7-4e08-4751-9515-7b95ddb4e485 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:53.590919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67500c7-4e08-4751-9515-7b95ddb4e485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:53.592609 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67500c7-4e08-4751-9515-7b95ddb4e485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:53.595530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67500c7-4e08-4751-9515-7b95ddb4e485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:53.601686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67500c7-4e08-4751-9515-7b95ddb4e485 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:53.607138 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270912f-5e21-45ca-8fe9-da76373aa5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:53.607832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270912f-5e21-45ca-8fe9-da76373aa5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:53.608193 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270912f-5e21-45ca-8fe9-da76373aa5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:53.608400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7270912f-5e21-45ca-8fe9-da76373aa5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:53.609354 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270912f-5e21-45ca-8fe9-da76373aa5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:53.612863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7270912f-5e21-45ca-8fe9-da76373aa5d3 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:53.649726 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 928/1875] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:53.655151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270912f-5e21-45ca-8fe9-da76373aa5d3 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:53.673098 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 948/1876] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:53.680262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7270912f-5e21-45ca-8fe9-da76373aa5d3 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:53.685124 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67500c7-4e08-4751-9515-7b95ddb4e485 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:53.713665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67500c7-4e08-4751-9515-7b95ddb4e485 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:53.715375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891b8b3-4864-4031-9027-492e740821d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:53.716091 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891b8b3-4864-4031-9027-492e740821d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:53.716383 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891b8b3-4864-4031-9027-492e740821d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:53.716660 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891b8b3-4864-4031-9027-492e740821d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:53.717337 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891b8b3-4864-4031-9027-492e740821d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:53.733799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d6403-0c8c-4a66-92e9-fa64ef5e0cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:53.733983 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891b8b3-4864-4031-9027-492e740821d4 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:53.735035 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d6403-0c8c-4a66-92e9-fa64ef5e0cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:53.735488 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d6403-0c8c-4a66-92e9-fa64ef5e0cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:53.735908 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d6403-0c8c-4a66-92e9-fa64ef5e0cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:53.736880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d6403-0c8c-4a66-92e9-fa64ef5e0cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:53.739641 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d6403-0c8c-4a66-92e9-fa64ef5e0cb1 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:53.769980 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 929/1877] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:36:53.769980 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879e2df-2737-419b-8470-1177664454ee None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:53.769980 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879e2df-2737-419b-8470-1177664454ee None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:53.769980 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879e2df-2737-419b-8470-1177664454ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:53.775395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 949/1878] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:53.777623 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d6403-0c8c-4a66-92e9-fa64ef5e0cb1 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:53.799560 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d6403-0c8c-4a66-92e9-fa64ef5e0cb1 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:53.815827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3665b2c-c673-4863-8b65-8aa9fe2f1a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:53.816875 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665b2c-c673-4863-8b65-8aa9fe2f1a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:53.817411 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665b2c-c673-4863-8b65-8aa9fe2f1a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:53.818023 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3665b2c-c673-4863-8b65-8aa9fe2f1a1f admin admin] PATH_INFO: `/v3/projects/1ae31943d4714073bb52e182182f3873/users/59067a5e17f64ea4ba2c09302775622d/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:53.849768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3665b2c-c673-4863-8b65-8aa9fe2f1a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae31943d4714073bb52e182182f3873, user_id=59067a5e17f64ea4ba2c09302775622d, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:53.853352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3665b2c-c673-4863-8b65-8aa9fe2f1a1f admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:53.864758 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-d879e2df-2737-419b-8470-1177664454ee None None] MFA Rules not processed for user `b3455d2a3c3d4d139544e88e7b04b0d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:53.866410 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d879e2df-2737-419b-8470-1177664454ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:53.890262 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 950/1879] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:53 2022] PUT /identity/v3/projects/1ae31943d4714073bb52e182182f3873/users/59067a5e17f64ea4ba2c09302775622d/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:53.890262 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3665b2c-c673-4863-8b65-8aa9fe2f1a1f admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:54.024740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 930/1880] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:54.026478 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cac255-169e-49cd-9f36-70ebfd7a650d None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:54.027054 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cac255-169e-49cd-9f36-70ebfd7a650d None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:54.027520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cac255-169e-49cd-9f36-70ebfd7a650d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:54.048237 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3665b2c-c673-4863-8b65-8aa9fe2f1a1f admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:54.056868 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be3366-cb86-416c-b0e7-e0ddb15f9784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:54.058699 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be3366-cb86-416c-b0e7-e0ddb15f9784 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:54.059238 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be3366-cb86-416c-b0e7-e0ddb15f9784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:54.059619 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be3366-cb86-416c-b0e7-e0ddb15f9784 admin admin] PATH_INFO: `/v3/projects/65b9b2f0a0284dc7a6a2e909b11ea97d/users/629b59cf353e4eecb31df98ac0ac89d4/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:54.062717 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-14cac255-169e-49cd-9f36-70ebfd7a650d None None] MFA Rules not processed for user `59067a5e17f64ea4ba2c09302775622d`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:54.064328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-14cac255-169e-49cd-9f36-70ebfd7a650d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:54.077841 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be3366-cb86-416c-b0e7-e0ddb15f9784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b9b2f0a0284dc7a6a2e909b11ea97d, user_id=629b59cf353e4eecb31df98ac0ac89d4, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:54.081079 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be3366-cb86-416c-b0e7-e0ddb15f9784 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:54.099587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 951/1881] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:53 2022] PUT /identity/v3/projects/65b9b2f0a0284dc7a6a2e909b11ea97d/users/629b59cf353e4eecb31df98ac0ac89d4/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:54.100710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be3366-cb86-416c-b0e7-e0ddb15f9784 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:54.102523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-21be3366-cb86-416c-b0e7-e0ddb15f9784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:54.144784 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:54.161284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 931/1882] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:54.162835 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d9139-a7da-4e70-9a9e-7ece16ef6093 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:54.163191 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d9139-a7da-4e70-9a9e-7ece16ef6093 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:54.163496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d9139-a7da-4e70-9a9e-7ece16ef6093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:54.199793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-2e1d9139-a7da-4e70-9a9e-7ece16ef6093 None None] MFA Rules not processed for user `629b59cf353e4eecb31df98ac0ac89d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:54.202677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-2e1d9139-a7da-4e70-9a9e-7ece16ef6093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:54.211589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be3366-cb86-416c-b0e7-e0ddb15f9784 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:54.220955 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc9654-7728-496f-a375-281b7d33ad5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:54.222448 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc9654-7728-496f-a375-281b7d33ad5b service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:54.222851 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc9654-7728-496f-a375-281b7d33ad5b service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:54.223289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc9654-7728-496f-a375-281b7d33ad5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:54.271848 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:54.306151 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc9654-7728-496f-a375-281b7d33ad5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:54.307866 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc9654-7728-496f-a375-281b7d33ad5b service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:54.309539 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 932/1883] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:54.311431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d9139-a7da-4e70-9a9e-7ece16ef6093 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:54.314302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-2e1d9139-a7da-4e70-9a9e-7ece16ef6093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:54.325920 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 952/1884] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:54.326814 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc9654-7728-496f-a375-281b7d33ad5b service nova] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:54.463141 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc9654-7728-496f-a375-281b7d33ad5b service nova] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:54.468989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c8331-3ec1-4de4-bb25-e56ab54b47d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:54.469671 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c8331-3ec1-4de4-bb25-e56ab54b47d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:54.469960 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c8331-3ec1-4de4-bb25-e56ab54b47d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:54.470417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c8331-3ec1-4de4-bb25-e56ab54b47d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:54.471270 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c8331-3ec1-4de4-bb25-e56ab54b47d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:54.473181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c8331-3ec1-4de4-bb25-e56ab54b47d9 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:54.516306 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 953/1885] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:36:54 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:36:54.520495 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c8331-3ec1-4de4-bb25-e56ab54b47d9 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:54.558599 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d9139-a7da-4e70-9a9e-7ece16ef6093 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:54.584334 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:54.620860 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c8331-3ec1-4de4-bb25-e56ab54b47d9 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:54.631940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfd933-d600-4151-9b8b-98a9ee4c0d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:54.632588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfd933-d600-4151-9b8b-98a9ee4c0d64 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:54.632874 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfd933-d600-4151-9b8b-98a9ee4c0d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:54.633263 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfd933-d600-4151-9b8b-98a9ee4c0d64 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:54.634003 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfd933-d600-4151-9b8b-98a9ee4c0d64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:54.636327 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfd933-d600-4151-9b8b-98a9ee4c0d64 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:54.689312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86703f09-00a5-4ba9-a658-0166a71094bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d026ec6ed344404a5ebe4352792cc1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:54.690521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86703f09-00a5-4ba9-a658-0166a71094bf service glance] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:54.691128 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86703f09-00a5-4ba9-a658-0166a71094bf service glance] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:54.691550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86703f09-00a5-4ba9-a658-0166a71094bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:54.696197 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 954/1886] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:36:54 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:36:54.697414 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfd933-d600-4151-9b8b-98a9ee4c0d64 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:54.712512 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfd933-d600-4151-9b8b-98a9ee4c0d64 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:54.719951 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfef11-c2b8-453c-9b9b-32d2ccbd1688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:54.720848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfef11-c2b8-453c-9b9b-32d2ccbd1688 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:54.720972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfef11-c2b8-453c-9b9b-32d2ccbd1688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:54.721201 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfef11-c2b8-453c-9b9b-32d2ccbd1688 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:54.722078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfef11-c2b8-453c-9b9b-32d2ccbd1688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:54.724619 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfef11-c2b8-453c-9b9b-32d2ccbd1688 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:54.754046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 955/1887] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:54.759901 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfef11-c2b8-453c-9b9b-32d2ccbd1688 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:54.777370 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfef11-c2b8-453c-9b9b-32d2ccbd1688 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:54.787623 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711f68d-ffa3-44d6-91eb-855dd3691281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:54.789122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f68d-ffa3-44d6-91eb-855dd3691281 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:54.789785 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f68d-ffa3-44d6-91eb-855dd3691281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:54.790092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711f68d-ffa3-44d6-91eb-855dd3691281 admin admin] PATH_INFO: `/v3/projects/b7aa2d8d24b14d8c80e1dbd48ef1d4f8/users/d6fa59f43c6449589fb969989a32cb84/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:54.863859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711f68d-ffa3-44d6-91eb-855dd3691281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7aa2d8d24b14d8c80e1dbd48ef1d4f8, user_id=d6fa59f43c6449589fb969989a32cb84, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:54.875097 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711f68d-ffa3-44d6-91eb-855dd3691281 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:54.875312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86703f09-00a5-4ba9-a658-0166a71094bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:54.876791 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86703f09-00a5-4ba9-a658-0166a71094bf service glance] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:54.919806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 956/1888] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:54 2022] PUT /identity/v3/projects/b7aa2d8d24b14d8c80e1dbd48ef1d4f8/users/d6fa59f43c6449589fb969989a32cb84/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:54.919806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711f68d-ffa3-44d6-91eb-855dd3691281 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:54.920018 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 933/1889] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:55.174568 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711f68d-ffa3-44d6-91eb-855dd3691281 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:55.195772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31b7a1-c607-4695-ad3f-1551ec6346bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:55.198215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b7a1-c607-4695-ad3f-1551ec6346bb admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:55.198694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b7a1-c607-4695-ad3f-1551ec6346bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:55.199163 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31b7a1-c607-4695-ad3f-1551ec6346bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:55.200088 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31b7a1-c607-4695-ad3f-1551ec6346bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:55.201969 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31b7a1-c607-4695-ad3f-1551ec6346bb admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:55.257060 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 957/1890] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:36:55.258396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86703f09-00a5-4ba9-a658-0166a71094bf service glance] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:55.288276 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86703f09-00a5-4ba9-a658-0166a71094bf service glance] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:55.310122 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fd3b3-4793-4a78-903c-725bbd65770c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:55.310827 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fd3b3-4793-4a78-903c-725bbd65770c admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:55.311145 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fd3b3-4793-4a78-903c-725bbd65770c admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:55.311428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fd3b3-4793-4a78-903c-725bbd65770c admin admin] PATH_INFO: `/v3/projects/b7aa2d8d24b14d8c80e1dbd48ef1d4f8/users/d6fa59f43c6449589fb969989a32cb84/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:55.324776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fd3b3-4793-4a78-903c-725bbd65770c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7aa2d8d24b14d8c80e1dbd48ef1d4f8, user_id=d6fa59f43c6449589fb969989a32cb84, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:55.327560 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fd3b3-4793-4a78-903c-725bbd65770c admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:55.404272 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 934/1891] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:36:55 2022] PUT /identity/v3/projects/b7aa2d8d24b14d8c80e1dbd48ef1d4f8/users/d6fa59f43c6449589fb969989a32cb84/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:55.418042 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5549da4-a262-4811-a42f-8c31f9947466 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:55.418336 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5549da4-a262-4811-a42f-8c31f9947466 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:55.418768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5549da4-a262-4811-a42f-8c31f9947466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:55.470667 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-e5549da4-a262-4811-a42f-8c31f9947466 None None] MFA Rules not processed for user `d6fa59f43c6449589fb969989a32cb84`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:55.479426 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e5549da4-a262-4811-a42f-8c31f9947466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:55.642089 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 958/1892] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:36:55.747740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fd3b3-4793-4a78-903c-725bbd65770c admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:55.751631 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-4a0fd3b3-4793-4a78-903c-725bbd65770c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:55.798865 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:55.837513 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fd3b3-4793-4a78-903c-725bbd65770c admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:55.865235 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9c977-0569-43e1-b257-e50e89bca1ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:55.866070 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9c977-0569-43e1-b257-e50e89bca1ff service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:55.866656 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9c977-0569-43e1-b257-e50e89bca1ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:55.867460 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9c977-0569-43e1-b257-e50e89bca1ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:55.888859 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9c977-0569-43e1-b257-e50e89bca1ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:55.892102 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9c977-0569-43e1-b257-e50e89bca1ff service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:55.912263 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 935/1893] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:56.117723 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5549da4-a262-4811-a42f-8c31f9947466 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:56.119692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e5549da4-a262-4811-a42f-8c31f9947466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:56.135800 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5549da4-a262-4811-a42f-8c31f9947466 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:56.142375 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f834a-a18d-4290-b9f5-0f4786bda9a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:56.143573 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f834a-a18d-4290-b9f5-0f4786bda9a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:56.144059 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f834a-a18d-4290-b9f5-0f4786bda9a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:56.144905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f834a-a18d-4290-b9f5-0f4786bda9a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:56.173722 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:56.288328 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f834a-a18d-4290-b9f5-0f4786bda9a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:56.289952 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f834a-a18d-4290-b9f5-0f4786bda9a4 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:56.324169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 959/1894] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:36:56.691716 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b376-23b6-4776-a111-c8dc92cd1f56 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:56.692736 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b376-23b6-4776-a111-c8dc92cd1f56 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:56.693091 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b376-23b6-4776-a111-c8dc92cd1f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:56.725783 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-8a71b376-23b6-4776-a111-c8dc92cd1f56 None None] MFA Rules not processed for user `b3455d2a3c3d4d139544e88e7b04b0d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:56.728058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8a71b376-23b6-4776-a111-c8dc92cd1f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:56.845953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 936/1895] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:56.862077 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f834a-a18d-4290-b9f5-0f4786bda9a4 service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:56.864291 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-918f834a-a18d-4290-b9f5-0f4786bda9a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:57.050009 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f834a-a18d-4290-b9f5-0f4786bda9a4 service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:57.114511 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d2442-8398-4cc7-b906-15bd2d30e1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:57.115227 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d2442-8398-4cc7-b906-15bd2d30e1d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:57.115510 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d2442-8398-4cc7-b906-15bd2d30e1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:57.115784 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d2442-8398-4cc7-b906-15bd2d30e1d0 admin admin] PATH_INFO: `/v3/users/19c4b2a2f39e4781b9c89c26e6250c42` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:57.126444 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d2442-8398-4cc7-b906-15bd2d30e1d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c4b2a2f39e4781b9c89c26e6250c42)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:57.135564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d2442-8398-4cc7-b906-15bd2d30e1d0 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:57.269690 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-774d2442-8398-4cc7-b906-15bd2d30e1d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c4b2a2f39e4781b9c89c26e6250c42'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:57.270817 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-774d2442-8398-4cc7-b906-15bd2d30e1d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c4b2a2f39e4781b9c89c26e6250c42'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:57.288995 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-774d2442-8398-4cc7-b906-15bd2d30e1d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c4b2a2f39e4781b9c89c26e6250c42'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:57.312583 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-774d2442-8398-4cc7-b906-15bd2d30e1d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c4b2a2f39e4781b9c89c26e6250c42'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:57.313316 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-774d2442-8398-4cc7-b906-15bd2d30e1d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c4b2a2f39e4781b9c89c26e6250c42'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:57.330549 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 960/1896] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:56 2022] DELETE /identity/v3/users/19c4b2a2f39e4781b9c89c26e6250c42 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:57.335699 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4fbb1-a06d-4055-a260-ffc064e4a740 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:57.335884 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4fbb1-a06d-4055-a260-ffc064e4a740 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:57.336146 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4fbb1-a06d-4055-a260-ffc064e4a740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:57.369039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-a7b4fbb1-a06d-4055-a260-ffc064e4a740 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:57.371157 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a7b4fbb1-a06d-4055-a260-ffc064e4a740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:57.449781 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 937/1897] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:36:57.492755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d2442-8398-4cc7-b906-15bd2d30e1d0 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:57.495150 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-774d2442-8398-4cc7-b906-15bd2d30e1d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:57.543981 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:57.562454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d2442-8398-4cc7-b906-15bd2d30e1d0 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:57.579997 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5c001-87d2-40df-85df-4a1935a7282d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:57.581343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5c001-87d2-40df-85df-4a1935a7282d service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:57.581985 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5c001-87d2-40df-85df-4a1935a7282d service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:57.582483 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5c001-87d2-40df-85df-4a1935a7282d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:57.599221 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5c001-87d2-40df-85df-4a1935a7282d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:57.602471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5c001-87d2-40df-85df-4a1935a7282d service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:57.624405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 961/1898] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:36:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:36:58.379739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4fbb1-a06d-4055-a260-ffc064e4a740 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:58.381416 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a7b4fbb1-a06d-4055-a260-ffc064e4a740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:58.405137 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4fbb1-a06d-4055-a260-ffc064e4a740 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:58.424356 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb321f2-ba89-4e71-803e-bbf730471f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:58.425170 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb321f2-ba89-4e71-803e-bbf730471f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:58.425440 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb321f2-ba89-4e71-803e-bbf730471f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:58.425711 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb321f2-ba89-4e71-803e-bbf730471f50 admin admin] PATH_INFO: `/v3/projects/91134815e3724c458b4dff6bcf974414` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:58.429734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb321f2-ba89-4e71-803e-bbf730471f50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91134815e3724c458b4dff6bcf974414)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:58.434004 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb321f2-ba89-4e71-803e-bbf730471f50 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:58.555341 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-beb321f2-ba89-4e71-803e-bbf730471f50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91134815e3724c458b4dff6bcf974414', 'request_id': 'req-beb321f2-ba89-4e71-803e-bbf730471f50'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:58.566854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-beb321f2-ba89-4e71-803e-bbf730471f50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91134815e3724c458b4dff6bcf974414', 'request_id': 'req-beb321f2-ba89-4e71-803e-bbf730471f50'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:58.575290 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-beb321f2-ba89-4e71-803e-bbf730471f50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91134815e3724c458b4dff6bcf974414', 'request_id': 'req-beb321f2-ba89-4e71-803e-bbf730471f50'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:58.599484 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:58.606858 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-beb321f2-ba89-4e71-803e-bbf730471f50 admin admin] The token cache is being invalidate because project 91134815e3724c458b4dff6bcf974414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:58.610058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-beb321f2-ba89-4e71-803e-bbf730471f50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:58.611540 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-beb321f2-ba89-4e71-803e-bbf730471f50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:58.615259 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 938/1899] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:58 2022] DELETE /identity/v3/projects/91134815e3724c458b4dff6bcf974414 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:58.619571 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5c001-87d2-40df-85df-4a1935a7282d service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:58.635228 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5c001-87d2-40df-85df-4a1935a7282d service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:58.751564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a1eb4-6ec8-40f8-b802-334b36c6b5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:58.752738 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1eb4-6ec8-40f8-b802-334b36c6b5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:58.753170 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1eb4-6ec8-40f8-b802-334b36c6b5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:58.753710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a1eb4-6ec8-40f8-b802-334b36c6b5aa admin admin] PATH_INFO: `/v3/users/3cf7e71db3204b09bd0fedf5f5ce30b3` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:58.755162 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a1eb4-6ec8-40f8-b802-334b36c6b5aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf7e71db3204b09bd0fedf5f5ce30b3)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:58.758308 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a1eb4-6ec8-40f8-b802-334b36c6b5aa admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:58.839574 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-642a1eb4-6ec8-40f8-b802-334b36c6b5aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf7e71db3204b09bd0fedf5f5ce30b3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:58.840668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-642a1eb4-6ec8-40f8-b802-334b36c6b5aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf7e71db3204b09bd0fedf5f5ce30b3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:58.850861 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-642a1eb4-6ec8-40f8-b802-334b36c6b5aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf7e71db3204b09bd0fedf5f5ce30b3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:58.892593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-642a1eb4-6ec8-40f8-b802-334b36c6b5aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf7e71db3204b09bd0fedf5f5ce30b3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:58.894339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-642a1eb4-6ec8-40f8-b802-334b36c6b5aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf7e71db3204b09bd0fedf5f5ce30b3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:58.932988 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 962/1900] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:58 2022] DELETE /identity/v3/users/3cf7e71db3204b09bd0fedf5f5ce30b3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:59.643120 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb321f2-ba89-4e71-803e-bbf730471f50 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:59.644887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-beb321f2-ba89-4e71-803e-bbf730471f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:59.675669 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb321f2-ba89-4e71-803e-bbf730471f50 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:59.682430 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a1eb4-6ec8-40f8-b802-334b36c6b5aa admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:59.685728 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-642a1eb4-6ec8-40f8-b802-334b36c6b5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:59.779421 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6e10f-ab07-46ee-9afc-2e3460a9f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:59.780096 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6e10f-ab07-46ee-9afc-2e3460a9f5da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:59.780376 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6e10f-ab07-46ee-9afc-2e3460a9f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:59.780804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6e10f-ab07-46ee-9afc-2e3460a9f5da admin admin] PATH_INFO: `/v3/users/629b59cf353e4eecb31df98ac0ac89d4` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:59.782138 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6e10f-ab07-46ee-9afc-2e3460a9f5da admin admin] RBAC: Authorizing `identity:delete_user(user_id=629b59cf353e4eecb31df98ac0ac89d4)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:59.784436 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6e10f-ab07-46ee-9afc-2e3460a9f5da admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:59.826034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a1eb4-6ec8-40f8-b802-334b36c6b5aa admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:36:59.833136 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9d858-35d2-45b7-be10-2f084ddd58ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:36:59.833758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9d858-35d2-45b7-be10-2f084ddd58ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:59.834107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9d858-35d2-45b7-be10-2f084ddd58ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:59.834390 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9d858-35d2-45b7-be10-2f084ddd58ca admin admin] PATH_INFO: `/v3/projects/884268a3c2fb4e13a4090fbedf8fcd84` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:59.835577 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9d858-35d2-45b7-be10-2f084ddd58ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=884268a3c2fb4e13a4090fbedf8fcd84)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:36:59.837636 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9d858-35d2-45b7-be10-2f084ddd58ca admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:36:59.846694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:36:59.867677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-87b6e10f-ab07-46ee-9afc-2e3460a9f5da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '629b59cf353e4eecb31df98ac0ac89d4'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:59.868628 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-87b6e10f-ab07-46ee-9afc-2e3460a9f5da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '629b59cf353e4eecb31df98ac0ac89d4'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:59.881047 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-87b6e10f-ab07-46ee-9afc-2e3460a9f5da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '629b59cf353e4eecb31df98ac0ac89d4'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:59.896229 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-87b6e10f-ab07-46ee-9afc-2e3460a9f5da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '629b59cf353e4eecb31df98ac0ac89d4'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:59.898046 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-87b6e10f-ab07-46ee-9afc-2e3460a9f5da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '629b59cf353e4eecb31df98ac0ac89d4'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:59.916845 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 939/1901] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:59 2022] DELETE /identity/v3/users/629b59cf353e4eecb31df98ac0ac89d4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:36:59.922000 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17fca8-6940-4732-bf5b-8dc1780dc013 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:36:59.922542 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17fca8-6940-4732-bf5b-8dc1780dc013 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:36:59.922824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17fca8-6940-4732-bf5b-8dc1780dc013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:36:59.924577 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-46b9d858-35d2-45b7-be10-2f084ddd58ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884268a3c2fb4e13a4090fbedf8fcd84', 'request_id': 'req-46b9d858-35d2-45b7-be10-2f084ddd58ca'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:59.933796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-46b9d858-35d2-45b7-be10-2f084ddd58ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884268a3c2fb4e13a4090fbedf8fcd84', 'request_id': 'req-46b9d858-35d2-45b7-be10-2f084ddd58ca'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:59.941120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-46b9d858-35d2-45b7-be10-2f084ddd58ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884268a3c2fb4e13a4090fbedf8fcd84', 'request_id': 'req-46b9d858-35d2-45b7-be10-2f084ddd58ca'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:59.942595 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-0f17fca8-6940-4732-bf5b-8dc1780dc013 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:36:59.943853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0f17fca8-6940-4732-bf5b-8dc1780dc013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:36:59.951989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-46b9d858-35d2-45b7-be10-2f084ddd58ca admin admin] The token cache is being invalidate because project 884268a3c2fb4e13a4090fbedf8fcd84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:36:59.952346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-46b9d858-35d2-45b7-be10-2f084ddd58ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:59.953183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-46b9d858-35d2-45b7-be10-2f084ddd58ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:36:59.954758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 963/1902] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:36:59 2022] DELETE /identity/v3/projects/884268a3c2fb4e13a4090fbedf8fcd84 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:36:59.959023 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9d858-35d2-45b7-be10-2f084ddd58ca admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:36:59.960353 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-46b9d858-35d2-45b7-be10-2f084ddd58ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:00.014375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 940/1903] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:37:00.021338 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17fca8-6940-4732-bf5b-8dc1780dc013 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:00.023779 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0f17fca8-6940-4732-bf5b-8dc1780dc013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:00.049872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:00.050576 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9d858-35d2-45b7-be10-2f084ddd58ca admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:00.056502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71398a-f437-4654-bc28-d8aa1e5c341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:00.057161 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71398a-f437-4654-bc28-d8aa1e5c341e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:00.057443 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71398a-f437-4654-bc28-d8aa1e5c341e admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:00.059281 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71398a-f437-4654-bc28-d8aa1e5c341e admin admin] PATH_INFO: `/v3/users/365a366a7a184f6cb3afb9dca21e31f7` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:00.060855 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71398a-f437-4654-bc28-d8aa1e5c341e admin admin] RBAC: Authorizing `identity:delete_user(user_id=365a366a7a184f6cb3afb9dca21e31f7)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:00.062795 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71398a-f437-4654-bc28-d8aa1e5c341e admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:00.110826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17fca8-6940-4732-bf5b-8dc1780dc013 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:00.116097 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553cda6-6fea-44c6-9fd6-03c18d2c185d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:00.116762 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553cda6-6fea-44c6-9fd6-03c18d2c185d service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:00.117296 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553cda6-6fea-44c6-9fd6-03c18d2c185d service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:00.117593 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553cda6-6fea-44c6-9fd6-03c18d2c185d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:00.128888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553cda6-6fea-44c6-9fd6-03c18d2c185d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:00.130226 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553cda6-6fea-44c6-9fd6-03c18d2c185d service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:00.135170 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ea71398a-f437-4654-bc28-d8aa1e5c341e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '365a366a7a184f6cb3afb9dca21e31f7'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:00.136479 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ea71398a-f437-4654-bc28-d8aa1e5c341e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '365a366a7a184f6cb3afb9dca21e31f7'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:00.143492 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 941/1904] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:37:00.144053 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ea71398a-f437-4654-bc28-d8aa1e5c341e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '365a366a7a184f6cb3afb9dca21e31f7'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:00.157493 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ea71398a-f437-4654-bc28-d8aa1e5c341e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '365a366a7a184f6cb3afb9dca21e31f7'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:00.159612 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ea71398a-f437-4654-bc28-d8aa1e5c341e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '365a366a7a184f6cb3afb9dca21e31f7'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:00.182188 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 964/1905] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:36:59 2022] DELETE /identity/v3/users/365a366a7a184f6cb3afb9dca21e31f7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:37:00.519423 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553cda6-6fea-44c6-9fd6-03c18d2c185d service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:00.521024 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-3553cda6-6fea-44c6-9fd6-03c18d2c185d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:00.544837 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553cda6-6fea-44c6-9fd6-03c18d2c185d service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:00.587702 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71398a-f437-4654-bc28-d8aa1e5c341e admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:00.589780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ea71398a-f437-4654-bc28-d8aa1e5c341e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:00.615921 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:00.627485 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748c572-ac3f-4983-9e27-f05aac069b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:00.628256 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748c572-ac3f-4983-9e27-f05aac069b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:00.628610 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748c572-ac3f-4983-9e27-f05aac069b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:00.629080 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748c572-ac3f-4983-9e27-f05aac069b73 admin admin] PATH_INFO: `/v3/projects/65b9b2f0a0284dc7a6a2e909b11ea97d` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:00.630296 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748c572-ac3f-4983-9e27-f05aac069b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b9b2f0a0284dc7a6a2e909b11ea97d)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:00.632549 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748c572-ac3f-4983-9e27-f05aac069b73 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:00.686875 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71398a-f437-4654-bc28-d8aa1e5c341e admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:00.695579 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-4748c572-ac3f-4983-9e27-f05aac069b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b9b2f0a0284dc7a6a2e909b11ea97d', 'request_id': 'req-4748c572-ac3f-4983-9e27-f05aac069b73'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:00.703082 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-4748c572-ac3f-4983-9e27-f05aac069b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b9b2f0a0284dc7a6a2e909b11ea97d', 'request_id': 'req-4748c572-ac3f-4983-9e27-f05aac069b73'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:00.712369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-4748c572-ac3f-4983-9e27-f05aac069b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b9b2f0a0284dc7a6a2e909b11ea97d', 'request_id': 'req-4748c572-ac3f-4983-9e27-f05aac069b73'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:00.735184 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-4748c572-ac3f-4983-9e27-f05aac069b73 admin admin] The token cache is being invalidate because project 65b9b2f0a0284dc7a6a2e909b11ea97d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:00.735622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-4748c572-ac3f-4983-9e27-f05aac069b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:00.736362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-4748c572-ac3f-4983-9e27-f05aac069b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:00.738672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 942/1906] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:00 2022] DELETE /identity/v3/projects/65b9b2f0a0284dc7a6a2e909b11ea97d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:00.741912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748c572-ac3f-4983-9e27-f05aac069b73 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:00.744292 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-4748c572-ac3f-4983-9e27-f05aac069b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:00.768334 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e86494-a81a-421f-95c3-1b5eaea71b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:00.769219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e86494-a81a-421f-95c3-1b5eaea71b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:00.769793 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e86494-a81a-421f-95c3-1b5eaea71b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:00.770164 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e86494-a81a-421f-95c3-1b5eaea71b2a admin admin] PATH_INFO: `/v3/projects/b9570641606c436786daa989839b778b` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:00.771414 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e86494-a81a-421f-95c3-1b5eaea71b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9570641606c436786daa989839b778b)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:00.773545 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e86494-a81a-421f-95c3-1b5eaea71b2a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:00.845546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:00.854495 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-90e86494-a81a-421f-95c3-1b5eaea71b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9570641606c436786daa989839b778b', 'request_id': 'req-90e86494-a81a-421f-95c3-1b5eaea71b2a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:00.867455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748c572-ac3f-4983-9e27-f05aac069b73 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:00.875368 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-90e86494-a81a-421f-95c3-1b5eaea71b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9570641606c436786daa989839b778b', 'request_id': 'req-90e86494-a81a-421f-95c3-1b5eaea71b2a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:00.885045 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-90e86494-a81a-421f-95c3-1b5eaea71b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9570641606c436786daa989839b778b', 'request_id': 'req-90e86494-a81a-421f-95c3-1b5eaea71b2a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:00.919128 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-90e86494-a81a-421f-95c3-1b5eaea71b2a admin admin] The token cache is being invalidate because project b9570641606c436786daa989839b778b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:00.920291 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-90e86494-a81a-421f-95c3-1b5eaea71b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:00.923017 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-90e86494-a81a-421f-95c3-1b5eaea71b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:00.933179 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 965/1907] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:00 2022] DELETE /identity/v3/projects/b9570641606c436786daa989839b778b => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:37:00.935010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8875a-d026-4ea2-864c-4fe2e2ad2d15 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:00.935305 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8875a-d026-4ea2-864c-4fe2e2ad2d15 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:00.935612 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8875a-d026-4ea2-864c-4fe2e2ad2d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:00.992016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5bb8875a-d026-4ea2-864c-4fe2e2ad2d15 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:00.993535 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5bb8875a-d026-4ea2-864c-4fe2e2ad2d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:01.018836 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 966/1908] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:01.025319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3962b0-c537-4ba9-aa7f-2e5a22bd112c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:01.029535 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3962b0-c537-4ba9-aa7f-2e5a22bd112c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:01.029895 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3962b0-c537-4ba9-aa7f-2e5a22bd112c admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:01.030147 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3962b0-c537-4ba9-aa7f-2e5a22bd112c admin admin] PATH_INFO: `/v3/users/d6fa59f43c6449589fb969989a32cb84` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:01.031845 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950edf97-dcd9-4319-92d8-0b3418350428 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:01.031845 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950edf97-dcd9-4319-92d8-0b3418350428 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:01.032055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950edf97-dcd9-4319-92d8-0b3418350428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:01.035397 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3962b0-c537-4ba9-aa7f-2e5a22bd112c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6fa59f43c6449589fb969989a32cb84)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:01.038495 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3962b0-c537-4ba9-aa7f-2e5a22bd112c admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:01.083699 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-950edf97-dcd9-4319-92d8-0b3418350428 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:01.086941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-950edf97-dcd9-4319-92d8-0b3418350428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:01.096298 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 967/1909] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:01.100491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950edf97-dcd9-4319-92d8-0b3418350428 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:01.114509 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1b3962b0-c537-4ba9-aa7f-2e5a22bd112c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6fa59f43c6449589fb969989a32cb84'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:01.115204 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1b3962b0-c537-4ba9-aa7f-2e5a22bd112c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6fa59f43c6449589fb969989a32cb84'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:01.117172 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950edf97-dcd9-4319-92d8-0b3418350428 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:01.124538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871da86-9c1c-4889-bbd9-88a9b8059878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:01.124866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1b3962b0-c537-4ba9-aa7f-2e5a22bd112c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6fa59f43c6449589fb969989a32cb84'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:01.125367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871da86-9c1c-4889-bbd9-88a9b8059878 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:01.125714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871da86-9c1c-4889-bbd9-88a9b8059878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:01.126304 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871da86-9c1c-4889-bbd9-88a9b8059878 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:01.127096 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871da86-9c1c-4889-bbd9-88a9b8059878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:37:01.127409 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871da86-9c1c-4889-bbd9-88a9b8059878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:01.129618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871da86-9c1c-4889-bbd9-88a9b8059878 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:01.151045 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 968/1910] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:37:01.153072 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871da86-9c1c-4889-bbd9-88a9b8059878 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:01.159523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1b3962b0-c537-4ba9-aa7f-2e5a22bd112c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6fa59f43c6449589fb969989a32cb84'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:01.161450 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1b3962b0-c537-4ba9-aa7f-2e5a22bd112c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6fa59f43c6449589fb969989a32cb84'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:01.166185 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871da86-9c1c-4889-bbd9-88a9b8059878 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:01.172889 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d6d9d-0048-4eef-8a88-0dacc93cf8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:01.173707 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d6d9d-0048-4eef-8a88-0dacc93cf8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:01.174261 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d6d9d-0048-4eef-8a88-0dacc93cf8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:01.174584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d6d9d-0048-4eef-8a88-0dacc93cf8d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:01.175633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d6d9d-0048-4eef-8a88-0dacc93cf8d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:01.177856 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d6d9d-0048-4eef-8a88-0dacc93cf8d1 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:01.179875 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 943/1911] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:37:00 2022] DELETE /identity/v3/users/d6fa59f43c6449589fb969989a32cb84 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:37:01.206650 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:01.215217 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 969/1912] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:37:01 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:01.216789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3962b0-c537-4ba9-aa7f-2e5a22bd112c admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:01.218462 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-1b3962b0-c537-4ba9-aa7f-2e5a22bd112c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:01.318596 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3962b0-c537-4ba9-aa7f-2e5a22bd112c admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:01.359695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:01.403163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789a54e-0980-4f14-92c5-bae9d8b31ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:01.404135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789a54e-0980-4f14-92c5-bae9d8b31ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:01.404524 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789a54e-0980-4f14-92c5-bae9d8b31ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:01.404907 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789a54e-0980-4f14-92c5-bae9d8b31ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:01.405691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789a54e-0980-4f14-92c5-bae9d8b31ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:01.407835 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789a54e-0980-4f14-92c5-bae9d8b31ff8 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:01.434983 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 944/1913] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:37:01 2022] POST /identity/v3/users => generated 282 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:01.437047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d6d9d-0048-4eef-8a88-0dacc93cf8d1 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:01.450200 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d6d9d-0048-4eef-8a88-0dacc93cf8d1 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:01.455394 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677effc-e92f-4786-9ab7-00a17da4d192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:01.456267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677effc-e92f-4786-9ab7-00a17da4d192 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:01.463295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677effc-e92f-4786-9ab7-00a17da4d192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:01.463766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677effc-e92f-4786-9ab7-00a17da4d192 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:01.464379 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677effc-e92f-4786-9ab7-00a17da4d192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:01.466044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677effc-e92f-4786-9ab7-00a17da4d192 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:01.478793 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 970/1914] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:01.484300 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789a54e-0980-4f14-92c5-bae9d8b31ff8 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:01.503515 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789a54e-0980-4f14-92c5-bae9d8b31ff8 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:01.508759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab89b2c-fb12-4db1-bbc2-2a406d4ca3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:01.509375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab89b2c-fb12-4db1-bbc2-2a406d4ca3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:01.509658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab89b2c-fb12-4db1-bbc2-2a406d4ca3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:01.509933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab89b2c-fb12-4db1-bbc2-2a406d4ca3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:01.510585 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab89b2c-fb12-4db1-bbc2-2a406d4ca3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:01.512963 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab89b2c-fb12-4db1-bbc2-2a406d4ca3f7 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:01.527766 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 945/1915] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:01.529072 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677effc-e92f-4786-9ab7-00a17da4d192 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:01.539344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677effc-e92f-4786-9ab7-00a17da4d192 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:01.544679 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c7dab-e2f4-482c-9041-8bd1eb09d4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:01.545333 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c7dab-e2f4-482c-9041-8bd1eb09d4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:01.545611 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c7dab-e2f4-482c-9041-8bd1eb09d4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:01.545885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c7dab-e2f4-482c-9041-8bd1eb09d4cd admin admin] PATH_INFO: `/v3/projects/5bf371140b204a0e95f6e9efe34b62cd/users/88462600bad14146ae3d8489e3cdfd5e/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:01.561470 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c7dab-e2f4-482c-9041-8bd1eb09d4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf371140b204a0e95f6e9efe34b62cd, user_id=88462600bad14146ae3d8489e3cdfd5e, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:01.564142 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c7dab-e2f4-482c-9041-8bd1eb09d4cd admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:01.579676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 971/1916] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:37:01 2022] PUT /identity/v3/projects/5bf371140b204a0e95f6e9efe34b62cd/users/88462600bad14146ae3d8489e3cdfd5e/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:01.598908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05581ea-e2bd-43a2-9392-7f31cd03c56f None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:01.599268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05581ea-e2bd-43a2-9392-7f31cd03c56f None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:01.599550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05581ea-e2bd-43a2-9392-7f31cd03c56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:01.617162 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c7dab-e2f4-482c-9041-8bd1eb09d4cd admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:01.619028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7c4c7dab-e2f4-482c-9041-8bd1eb09d4cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:01.640243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-f05581ea-e2bd-43a2-9392-7f31cd03c56f None None] MFA Rules not processed for user `88462600bad14146ae3d8489e3cdfd5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:01.643357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-f05581ea-e2bd-43a2-9392-7f31cd03c56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:01.693208 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c7dab-e2f4-482c-9041-8bd1eb09d4cd admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:01.698198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22783030-1f7d-48ff-83e9-27fb257c3c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:01.698839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22783030-1f7d-48ff-83e9-27fb257c3c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:01.699175 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22783030-1f7d-48ff-83e9-27fb257c3c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:01.699473 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22783030-1f7d-48ff-83e9-27fb257c3c8d admin admin] PATH_INFO: `/v3/projects/b7aa2d8d24b14d8c80e1dbd48ef1d4f8` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:01.700594 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22783030-1f7d-48ff-83e9-27fb257c3c8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7aa2d8d24b14d8c80e1dbd48ef1d4f8)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:01.702549 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22783030-1f7d-48ff-83e9-27fb257c3c8d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:01.716149 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 946/1917] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:01.727182 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05581ea-e2bd-43a2-9392-7f31cd03c56f None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:01.728555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-f05581ea-e2bd-43a2-9392-7f31cd03c56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:01.755985 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-22783030-1f7d-48ff-83e9-27fb257c3c8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7aa2d8d24b14d8c80e1dbd48ef1d4f8', 'request_id': 'req-22783030-1f7d-48ff-83e9-27fb257c3c8d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:01.764257 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-22783030-1f7d-48ff-83e9-27fb257c3c8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7aa2d8d24b14d8c80e1dbd48ef1d4f8', 'request_id': 'req-22783030-1f7d-48ff-83e9-27fb257c3c8d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:01.770537 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-22783030-1f7d-48ff-83e9-27fb257c3c8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7aa2d8d24b14d8c80e1dbd48ef1d4f8', 'request_id': 'req-22783030-1f7d-48ff-83e9-27fb257c3c8d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:01.781531 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-22783030-1f7d-48ff-83e9-27fb257c3c8d admin admin] The token cache is being invalidate because project b7aa2d8d24b14d8c80e1dbd48ef1d4f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:01.781826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-22783030-1f7d-48ff-83e9-27fb257c3c8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:01.782515 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-22783030-1f7d-48ff-83e9-27fb257c3c8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:01.784079 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 972/1918] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:01 2022] DELETE /identity/v3/projects/b7aa2d8d24b14d8c80e1dbd48ef1d4f8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:37:01.788840 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f5f34-c914-4e12-b567-3d7984b25885 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:01.789121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f5f34-c914-4e12-b567-3d7984b25885 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:01.789395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f5f34-c914-4e12-b567-3d7984b25885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:01.797587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05581ea-e2bd-43a2-9392-7f31cd03c56f None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:01.813812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-767f5f34-c914-4e12-b567-3d7984b25885 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:01.815484 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-767f5f34-c914-4e12-b567-3d7984b25885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:01.854054 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49c787-b3be-4efc-b352-c6991b75e29f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:01.855329 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49c787-b3be-4efc-b352-c6991b75e29f service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:01.855608 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49c787-b3be-4efc-b352-c6991b75e29f service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:01.855878 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd49c787-b3be-4efc-b352-c6991b75e29f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:01.857638 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-fd49c787-b3be-4efc-b352-c6991b75e29f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:01.862862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:01.880881 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:01.890167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 973/1919] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:37:01.898477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423e165-9ea0-4583-b4d7-bb0970eb51b0 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:01.899243 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423e165-9ea0-4583-b4d7-bb0970eb51b0 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:01.899598 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423e165-9ea0-4583-b4d7-bb0970eb51b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:01.928893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-6423e165-9ea0-4583-b4d7-bb0970eb51b0 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:01.930399 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6423e165-9ea0-4583-b4d7-bb0970eb51b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:01.942612 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 974/1920] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:37:01.943936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423e165-9ea0-4583-b4d7-bb0970eb51b0 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:01.955773 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423e165-9ea0-4583-b4d7-bb0970eb51b0 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:01.961357 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7881610-3f9b-40a1-879d-e17b988780e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:01.961538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7881610-3f9b-40a1-879d-e17b988780e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:01.961752 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7881610-3f9b-40a1-879d-e17b988780e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:01.962031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7881610-3f9b-40a1-879d-e17b988780e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:01.962710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7881610-3f9b-40a1-879d-e17b988780e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:37:01.963048 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7881610-3f9b-40a1-879d-e17b988780e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:01.966038 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7881610-3f9b-40a1-879d-e17b988780e9 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:01.966207 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49c787-b3be-4efc-b352-c6991b75e29f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:01.967771 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd49c787-b3be-4efc-b352-c6991b75e29f service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:01.978586 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 947/1921] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:37:01.982992 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 975/1922] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:37:01.986145 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49c787-b3be-4efc-b352-c6991b75e29f service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:02.002915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd49c787-b3be-4efc-b352-c6991b75e29f service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:02.007765 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb6e70-381e-449f-bb33-5af74c06cf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:02.008380 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb6e70-381e-449f-bb33-5af74c06cf1e admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:02.008660 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb6e70-381e-449f-bb33-5af74c06cf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:02.008998 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eb6e70-381e-449f-bb33-5af74c06cf1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:02.009647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb6e70-381e-449f-bb33-5af74c06cf1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:02.013127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eb6e70-381e-449f-bb33-5af74c06cf1e admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:02.045570 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 948/1923] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:37:01 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:37:02.046089 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7881610-3f9b-40a1-879d-e17b988780e9 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:02.062751 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7881610-3f9b-40a1-879d-e17b988780e9 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:02.131406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913d358-08bc-402b-86d6-49c8858ddbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:02.132061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913d358-08bc-402b-86d6-49c8858ddbcd admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:02.132416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913d358-08bc-402b-86d6-49c8858ddbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:02.132700 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913d358-08bc-402b-86d6-49c8858ddbcd admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:02.133395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913d358-08bc-402b-86d6-49c8858ddbcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:02.135369 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913d358-08bc-402b-86d6-49c8858ddbcd admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:02.165928 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 976/1924] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:37:02 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:37:02.167254 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb6e70-381e-449f-bb33-5af74c06cf1e admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:02.179739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eb6e70-381e-449f-bb33-5af74c06cf1e admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:02.197084 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879ddf2-6bb3-48f7-b475-ef5992610738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:02.197585 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879ddf2-6bb3-48f7-b475-ef5992610738 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:02.197873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879ddf2-6bb3-48f7-b475-ef5992610738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:02.198740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879ddf2-6bb3-48f7-b475-ef5992610738 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:02.199395 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879ddf2-6bb3-48f7-b475-ef5992610738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:02.201581 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879ddf2-6bb3-48f7-b475-ef5992610738 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:02.222984 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 949/1925] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:02.225711 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913d358-08bc-402b-86d6-49c8858ddbcd admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:02.248680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913d358-08bc-402b-86d6-49c8858ddbcd admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:02.264618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585abce-f5b1-4fb5-80f1-9fe30984a531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:02.265242 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585abce-f5b1-4fb5-80f1-9fe30984a531 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:02.265531 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585abce-f5b1-4fb5-80f1-9fe30984a531 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:02.265803 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585abce-f5b1-4fb5-80f1-9fe30984a531 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:02.266461 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585abce-f5b1-4fb5-80f1-9fe30984a531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:02.268242 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585abce-f5b1-4fb5-80f1-9fe30984a531 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:02.297209 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 977/1926] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:02.301703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879ddf2-6bb3-48f7-b475-ef5992610738 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:02.323605 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879ddf2-6bb3-48f7-b475-ef5992610738 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:02.335776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d947e-386e-4be5-8913-8a4fe588df19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:02.337826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d947e-386e-4be5-8913-8a4fe588df19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:02.338371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d947e-386e-4be5-8913-8a4fe588df19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:02.338726 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d947e-386e-4be5-8913-8a4fe588df19 admin admin] PATH_INFO: `/v3/projects/f6bc7e51c8e44b6c9976148cb1244bdc/users/80c203d0491449f0a66dfc5508b5d3c3/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:02.381952 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d947e-386e-4be5-8913-8a4fe588df19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6bc7e51c8e44b6c9976148cb1244bdc, user_id=80c203d0491449f0a66dfc5508b5d3c3, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:02.385242 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d947e-386e-4be5-8913-8a4fe588df19 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:02.436626 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 950/1927] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:37:02 2022] PUT /identity/v3/projects/f6bc7e51c8e44b6c9976148cb1244bdc/users/80c203d0491449f0a66dfc5508b5d3c3/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:02.453748 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e671db-8a89-454b-9962-82c430958ff9 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:02.454034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e671db-8a89-454b-9962-82c430958ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:02.454335 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e671db-8a89-454b-9962-82c430958ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:02.496867 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-20e671db-8a89-454b-9962-82c430958ff9 None None] MFA Rules not processed for user `80c203d0491449f0a66dfc5508b5d3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:02.498552 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-20e671db-8a89-454b-9962-82c430958ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:02.710652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 978/1928] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:02.723073 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d947e-386e-4be5-8913-8a4fe588df19 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:02.725308 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a08d947e-386e-4be5-8913-8a4fe588df19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:02.800216 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d947e-386e-4be5-8913-8a4fe588df19 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:02.805500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0b2be-fa1a-4d27-875c-d6be08b7ca38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:02.806254 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0b2be-fa1a-4d27-875c-d6be08b7ca38 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:02.806643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0b2be-fa1a-4d27-875c-d6be08b7ca38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:02.807042 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0b2be-fa1a-4d27-875c-d6be08b7ca38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:02.821694 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0b2be-fa1a-4d27-875c-d6be08b7ca38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:02.824464 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0b2be-fa1a-4d27-875c-d6be08b7ca38 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:02.838046 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 951/1929] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:07.702846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7248c28-4327-47ee-938c-2895ba2f0322 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:07.703329 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7248c28-4327-47ee-938c-2895ba2f0322 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:07.703443 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7248c28-4327-47ee-938c-2895ba2f0322 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:07.704942 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 979/1930] 10.222.0.36 () {54 vars in 921 bytes} [Thu Oct 20 13:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:37:07.723593 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b9bd-432f-475b-a359-7e3f7ac45e89 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:07.724052 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b9bd-432f-475b-a359-7e3f7ac45e89 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:07.724527 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b9bd-432f-475b-a359-7e3f7ac45e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:07.752975 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-d574b9bd-432f-475b-a359-7e3f7ac45e89 None None] MFA Rules not processed for user `a00f0b4cee8d49a48a95317aec9f647c`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:07.755285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d574b9bd-432f-475b-a359-7e3f7ac45e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:07.837361 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:07.885410 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 952/1931] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Oct 20 13:37:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:07.924977 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7248c28-4327-47ee-938c-2895ba2f0322 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:07.924977 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c7248c28-4327-47ee-938c-2895ba2f0322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:07.942365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7248c28-4327-47ee-938c-2895ba2f0322 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:07.950907 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d450e93-d29a-4b84-836c-01287a25e1eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a00f0b4cee8d49a48a95317aec9f647c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:07.951597 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450e93-d29a-4b84-836c-01287a25e1eb service placement] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:07.951883 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450e93-d29a-4b84-836c-01287a25e1eb service placement] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:07.952173 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d450e93-d29a-4b84-836c-01287a25e1eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:07.964757 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d450e93-d29a-4b84-836c-01287a25e1eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:07.966589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d450e93-d29a-4b84-836c-01287a25e1eb service placement] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:07.982801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 980/1932] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:08.560755 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574b9bd-432f-475b-a359-7e3f7ac45e89 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:08.562892 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d574b9bd-432f-475b-a359-7e3f7ac45e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:08.675296 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574b9bd-432f-475b-a359-7e3f7ac45e89 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:08.680357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b6e7a-fada-4183-80f1-0f88da6fe15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:08.681721 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b6e7a-fada-4183-80f1-0f88da6fe15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:08.681813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b6e7a-fada-4183-80f1-0f88da6fe15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:08.682079 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b6e7a-fada-4183-80f1-0f88da6fe15a admin admin] PATH_INFO: `/v3/users/956fb85fa00641efb810664a8a4c23e3` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:08.683531 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b6e7a-fada-4183-80f1-0f88da6fe15a admin admin] RBAC: Authorizing `identity:delete_user(user_id=956fb85fa00641efb810664a8a4c23e3)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:08.686772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b6e7a-fada-4183-80f1-0f88da6fe15a admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:08.750399 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a75b6e7a-fada-4183-80f1-0f88da6fe15a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956fb85fa00641efb810664a8a4c23e3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:08.752014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a75b6e7a-fada-4183-80f1-0f88da6fe15a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956fb85fa00641efb810664a8a4c23e3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:08.759721 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a75b6e7a-fada-4183-80f1-0f88da6fe15a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956fb85fa00641efb810664a8a4c23e3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:08.773728 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a75b6e7a-fada-4183-80f1-0f88da6fe15a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956fb85fa00641efb810664a8a4c23e3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:08.774415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a75b6e7a-fada-4183-80f1-0f88da6fe15a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956fb85fa00641efb810664a8a4c23e3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:08.789556 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 953/1933] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:37:08 2022] DELETE /identity/v3/users/956fb85fa00641efb810664a8a4c23e3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:08.982323 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d450e93-d29a-4b84-836c-01287a25e1eb service placement] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:08.995518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d450e93-d29a-4b84-836c-01287a25e1eb service placement] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:09.047826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:09.085794 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd1456-7bd6-4179-848e-9c8078bec299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:09.086436 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd1456-7bd6-4179-848e-9c8078bec299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:09.087084 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd1456-7bd6-4179-848e-9c8078bec299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:09.087504 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd1456-7bd6-4179-848e-9c8078bec299 admin admin] PATH_INFO: `/v3/projects/44eca7f754164f42b4114057eb091727` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:09.089550 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd1456-7bd6-4179-848e-9c8078bec299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44eca7f754164f42b4114057eb091727)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:09.091975 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd1456-7bd6-4179-848e-9c8078bec299 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:09.148192 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-74bd1456-7bd6-4179-848e-9c8078bec299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44eca7f754164f42b4114057eb091727', 'request_id': 'req-74bd1456-7bd6-4179-848e-9c8078bec299'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:09.161705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-74bd1456-7bd6-4179-848e-9c8078bec299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44eca7f754164f42b4114057eb091727', 'request_id': 'req-74bd1456-7bd6-4179-848e-9c8078bec299'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:09.172081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-74bd1456-7bd6-4179-848e-9c8078bec299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44eca7f754164f42b4114057eb091727', 'request_id': 'req-74bd1456-7bd6-4179-848e-9c8078bec299'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:09.187329 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-74bd1456-7bd6-4179-848e-9c8078bec299 admin admin] The token cache is being invalidate because project 44eca7f754164f42b4114057eb091727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:09.187777 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-74bd1456-7bd6-4179-848e-9c8078bec299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:09.188548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-74bd1456-7bd6-4179-848e-9c8078bec299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:09.190289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 981/1934] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:08 2022] DELETE /identity/v3/projects/44eca7f754164f42b4114057eb091727 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:37:09.201666 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b6e7a-fada-4183-80f1-0f88da6fe15a admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:09.203376 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a75b6e7a-fada-4183-80f1-0f88da6fe15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:09.221288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b6e7a-fada-4183-80f1-0f88da6fe15a admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:09.288642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59cec95-1720-4f1b-94fe-8f5ffe9af9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:09.289423 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cec95-1720-4f1b-94fe-8f5ffe9af9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:09.289721 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cec95-1720-4f1b-94fe-8f5ffe9af9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:09.289993 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cec95-1720-4f1b-94fe-8f5ffe9af9f0 admin admin] PATH_INFO: `/v3/users/3914c091fe7d44d2bc4ec16195ffb099` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:09.291136 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59cec95-1720-4f1b-94fe-8f5ffe9af9f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3914c091fe7d44d2bc4ec16195ffb099)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:09.293610 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59cec95-1720-4f1b-94fe-8f5ffe9af9f0 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:09.299512 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:09.348496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c59cec95-1720-4f1b-94fe-8f5ffe9af9f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3914c091fe7d44d2bc4ec16195ffb099'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:09.349304 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c59cec95-1720-4f1b-94fe-8f5ffe9af9f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3914c091fe7d44d2bc4ec16195ffb099'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:09.357832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c59cec95-1720-4f1b-94fe-8f5ffe9af9f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3914c091fe7d44d2bc4ec16195ffb099'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:09.375471 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c59cec95-1720-4f1b-94fe-8f5ffe9af9f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3914c091fe7d44d2bc4ec16195ffb099'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:09.376354 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c59cec95-1720-4f1b-94fe-8f5ffe9af9f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3914c091fe7d44d2bc4ec16195ffb099'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:09.392558 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 954/1935] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:37:09 2022] DELETE /identity/v3/users/3914c091fe7d44d2bc4ec16195ffb099 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:09.691071 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd1456-7bd6-4179-848e-9c8078bec299 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:09.692501 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-74bd1456-7bd6-4179-848e-9c8078bec299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:09.712387 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd1456-7bd6-4179-848e-9c8078bec299 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:09.829445 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48c4fcf-1e3a-4733-b006-60f66f296d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:09.830388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c4fcf-1e3a-4733-b006-60f66f296d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:09.830819 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c4fcf-1e3a-4733-b006-60f66f296d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:09.831141 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c4fcf-1e3a-4733-b006-60f66f296d14 admin admin] PATH_INFO: `/v3/projects/59b59c1e837746d6be1081be98e64740` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:09.832787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c4fcf-1e3a-4733-b006-60f66f296d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59b59c1e837746d6be1081be98e64740)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:09.835461 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48c4fcf-1e3a-4733-b006-60f66f296d14 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:09.923941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d48c4fcf-1e3a-4733-b006-60f66f296d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59b59c1e837746d6be1081be98e64740', 'request_id': 'req-d48c4fcf-1e3a-4733-b006-60f66f296d14'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:09.941265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d48c4fcf-1e3a-4733-b006-60f66f296d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59b59c1e837746d6be1081be98e64740', 'request_id': 'req-d48c4fcf-1e3a-4733-b006-60f66f296d14'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:09.947822 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d48c4fcf-1e3a-4733-b006-60f66f296d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59b59c1e837746d6be1081be98e64740', 'request_id': 'req-d48c4fcf-1e3a-4733-b006-60f66f296d14'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:09.950556 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:09.973085 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d48c4fcf-1e3a-4733-b006-60f66f296d14 admin admin] The token cache is being invalidate because project 59b59c1e837746d6be1081be98e64740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:09.973452 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d48c4fcf-1e3a-4733-b006-60f66f296d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:09.974721 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d48c4fcf-1e3a-4733-b006-60f66f296d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:09.982976 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 982/1936] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:09 2022] DELETE /identity/v3/projects/59b59c1e837746d6be1081be98e64740 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:09.989428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c297805-b2bc-4583-bb64-8f60e47dda7c None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:09.990221 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c297805-b2bc-4583-bb64-8f60e47dda7c None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:09.990576 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c297805-b2bc-4583-bb64-8f60e47dda7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:10.022533 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-8c297805-b2bc-4583-bb64-8f60e47dda7c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:10.024307 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8c297805-b2bc-4583-bb64-8f60e47dda7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:10.123184 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 955/1937] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:10.124849 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebded687-98cc-4184-aff8-22e97a0debc3 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:10.125261 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebded687-98cc-4184-aff8-22e97a0debc3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:10.125688 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebded687-98cc-4184-aff8-22e97a0debc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:10.165092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ebded687-98cc-4184-aff8-22e97a0debc3 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:10.167625 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ebded687-98cc-4184-aff8-22e97a0debc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:10.187177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 983/1938] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:10.191018 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c297805-b2bc-4583-bb64-8f60e47dda7c None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:10.203755 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c297805-b2bc-4583-bb64-8f60e47dda7c None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:10.210203 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938fc40-318c-475f-8d74-dc73d315dcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:10.210939 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938fc40-318c-475f-8d74-dc73d315dcf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:10.211451 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938fc40-318c-475f-8d74-dc73d315dcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:10.211729 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938fc40-318c-475f-8d74-dc73d315dcf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:10.212397 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938fc40-318c-475f-8d74-dc73d315dcf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:37:10.212702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938fc40-318c-475f-8d74-dc73d315dcf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:10.215769 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d938fc40-318c-475f-8d74-dc73d315dcf9 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:10.235400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 956/1939] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:37:10.239871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebded687-98cc-4184-aff8-22e97a0debc3 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:10.251223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebded687-98cc-4184-aff8-22e97a0debc3 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:10.265182 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a21df7-36ce-4c37-ac4a-7203e7cfe71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:10.267039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a21df7-36ce-4c37-ac4a-7203e7cfe71c admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:10.267039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a21df7-36ce-4c37-ac4a-7203e7cfe71c admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:10.267039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a21df7-36ce-4c37-ac4a-7203e7cfe71c admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:10.267039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a21df7-36ce-4c37-ac4a-7203e7cfe71c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:10.269456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a21df7-36ce-4c37-ac4a-7203e7cfe71c admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:10.307289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 984/1940] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:37:10 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:10.312412 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938fc40-318c-475f-8d74-dc73d315dcf9 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:10.332560 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d938fc40-318c-475f-8d74-dc73d315dcf9 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:10.398818 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf834f-77d2-41e1-963c-9b5e7480c5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:10.399520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf834f-77d2-41e1-963c-9b5e7480c5cc admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:10.399803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf834f-77d2-41e1-963c-9b5e7480c5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:10.400076 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf834f-77d2-41e1-963c-9b5e7480c5cc admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:10.400864 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf834f-77d2-41e1-963c-9b5e7480c5cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:10.403341 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddf834f-77d2-41e1-963c-9b5e7480c5cc admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:10.430854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 957/1941] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:37:10 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:37:10.432322 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a21df7-36ce-4c37-ac4a-7203e7cfe71c admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:10.442567 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a21df7-36ce-4c37-ac4a-7203e7cfe71c admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:10.447679 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c331e-6168-47cb-b7bb-83e75f3da3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:10.448564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c331e-6168-47cb-b7bb-83e75f3da3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:10.448784 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c331e-6168-47cb-b7bb-83e75f3da3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:10.449078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c331e-6168-47cb-b7bb-83e75f3da3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:10.449920 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c331e-6168-47cb-b7bb-83e75f3da3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:10.451605 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c331e-6168-47cb-b7bb-83e75f3da3e6 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:10.468041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 985/1942] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:37:10.472027 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf834f-77d2-41e1-963c-9b5e7480c5cc admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:10.477473 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:10.485695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf834f-77d2-41e1-963c-9b5e7480c5cc admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:10.500781 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ed8d7-5db4-42e6-bf26-880d8d46ee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:10.501481 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ed8d7-5db4-42e6-bf26-880d8d46ee39 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:10.501838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ed8d7-5db4-42e6-bf26-880d8d46ee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:10.502225 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ed8d7-5db4-42e6-bf26-880d8d46ee39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:10.502961 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ed8d7-5db4-42e6-bf26-880d8d46ee39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:10.504727 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ed8d7-5db4-42e6-bf26-880d8d46ee39 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:10.519497 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 958/1943] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:37:10.522333 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c331e-6168-47cb-b7bb-83e75f3da3e6 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:10.533523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c331e-6168-47cb-b7bb-83e75f3da3e6 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:10.540567 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b6d7f-6481-47a1-8ecb-44912c0a6c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:10.541377 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b6d7f-6481-47a1-8ecb-44912c0a6c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:10.541720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b6d7f-6481-47a1-8ecb-44912c0a6c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:10.542036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4b6d7f-6481-47a1-8ecb-44912c0a6c51 admin admin] PATH_INFO: `/v3/projects/1211a53fc4674943867f0471ca70abb5/users/b06c43d211b447bfb43653cee0ab92fe/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:10.559318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b6d7f-6481-47a1-8ecb-44912c0a6c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1211a53fc4674943867f0471ca70abb5, user_id=b06c43d211b447bfb43653cee0ab92fe, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:10.562414 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4b6d7f-6481-47a1-8ecb-44912c0a6c51 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:10.576555 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 986/1944] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:37:10 2022] PUT /identity/v3/projects/1211a53fc4674943867f0471ca70abb5/users/b06c43d211b447bfb43653cee0ab92fe/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:10.587512 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfb761-7067-4d82-ac9a-64fa412762ff None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:10.587819 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfb761-7067-4d82-ac9a-64fa412762ff None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:10.588096 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfb761-7067-4d82-ac9a-64fa412762ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:10.621754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-54cfb761-7067-4d82-ac9a-64fa412762ff None None] MFA Rules not processed for user `b06c43d211b447bfb43653cee0ab92fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:10.628557 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-54cfb761-7067-4d82-ac9a-64fa412762ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:10.707270 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 959/1945] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:10.711741 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b6d7f-6481-47a1-8ecb-44912c0a6c51 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:10.778737 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4b6d7f-6481-47a1-8ecb-44912c0a6c51 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:10.784112 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa7894-09ce-4353-9ce0-235e8dddbdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:10.784812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7894-09ce-4353-9ce0-235e8dddbdb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:10.785085 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7894-09ce-4353-9ce0-235e8dddbdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:10.785342 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa7894-09ce-4353-9ce0-235e8dddbdb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:10.786289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa7894-09ce-4353-9ce0-235e8dddbdb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:10.788692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa7894-09ce-4353-9ce0-235e8dddbdb4 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:10.822354 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 987/1946] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:37:10 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:10.824569 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfb761-7067-4d82-ac9a-64fa412762ff None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:10.839830 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cfb761-7067-4d82-ac9a-64fa412762ff None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:10.906643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97ee12-d99d-4d6b-b4b3-eb99d88953ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:10.907292 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97ee12-d99d-4d6b-b4b3-eb99d88953ae admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:10.907577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97ee12-d99d-4d6b-b4b3-eb99d88953ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:10.907855 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97ee12-d99d-4d6b-b4b3-eb99d88953ae admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:10.908488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97ee12-d99d-4d6b-b4b3-eb99d88953ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:10.910510 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97ee12-d99d-4d6b-b4b3-eb99d88953ae admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:10.935428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 960/1947] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:37:10 2022] POST /identity/v3/users => generated 298 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:10.939310 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa7894-09ce-4353-9ce0-235e8dddbdb4 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:10.950838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa7894-09ce-4353-9ce0-235e8dddbdb4 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:10.955876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffb65b-eb31-48ec-9614-a6c3d84c7ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:10.956498 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffb65b-eb31-48ec-9614-a6c3d84c7ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:10.956773 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffb65b-eb31-48ec-9614-a6c3d84c7ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:10.957042 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffb65b-eb31-48ec-9614-a6c3d84c7ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:10.957678 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffb65b-eb31-48ec-9614-a6c3d84c7ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:10.959277 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffb65b-eb31-48ec-9614-a6c3d84c7ca6 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:10.973210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 988/1948] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:37:10.976190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97ee12-d99d-4d6b-b4b3-eb99d88953ae admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:10.987058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97ee12-d99d-4d6b-b4b3-eb99d88953ae admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:10.991780 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc243eb-c716-4a4a-9c81-3591d4b7c1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:10.992442 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc243eb-c716-4a4a-9c81-3591d4b7c1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:10.992724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc243eb-c716-4a4a-9c81-3591d4b7c1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:10.993000 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc243eb-c716-4a4a-9c81-3591d4b7c1c4 admin admin] PATH_INFO: `/v3/projects/cca1f0c9488342cca197f748d4917151/users/90cd9fd2493049318693ed291f4da19b/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:11.009136 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc243eb-c716-4a4a-9c81-3591d4b7c1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca1f0c9488342cca197f748d4917151, user_id=90cd9fd2493049318693ed291f4da19b, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:11.012233 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc243eb-c716-4a4a-9c81-3591d4b7c1c4 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:11.025031 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 961/1949] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:37:10 2022] PUT /identity/v3/projects/cca1f0c9488342cca197f748d4917151/users/90cd9fd2493049318693ed291f4da19b/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:37:11.029545 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffb65b-eb31-48ec-9614-a6c3d84c7ca6 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:11.043931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffb65b-eb31-48ec-9614-a6c3d84c7ca6 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:11.143996 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444530e-7ac6-4b2e-b683-e661f1528dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:11.145106 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444530e-7ac6-4b2e-b683-e661f1528dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:11.145529 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444530e-7ac6-4b2e-b683-e661f1528dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:11.145945 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444530e-7ac6-4b2e-b683-e661f1528dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:11.147033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444530e-7ac6-4b2e-b683-e661f1528dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:11.148959 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444530e-7ac6-4b2e-b683-e661f1528dd4 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:11.153857 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:11.173282 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 989/1950] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:11.175175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc243eb-c716-4a4a-9c81-3591d4b7c1c4 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:11.189499 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc243eb-c716-4a4a-9c81-3591d4b7c1c4 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:11.198530 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb845760-6ae0-4e22-ae42-1bb14a135f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:11.199588 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb845760-6ae0-4e22-ae42-1bb14a135f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:11.200346 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb845760-6ae0-4e22-ae42-1bb14a135f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:11.201013 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb845760-6ae0-4e22-ae42-1bb14a135f41 admin admin] PATH_INFO: `/v3/projects/cca1f0c9488342cca197f748d4917151/users/90cd9fd2493049318693ed291f4da19b/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:11.203643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb845760-6ae0-4e22-ae42-1bb14a135f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca1f0c9488342cca197f748d4917151, user_id=90cd9fd2493049318693ed291f4da19b, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:11.208095 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb845760-6ae0-4e22-ae42-1bb14a135f41 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:11.229010 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 962/1951] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:37:11 2022] PUT /identity/v3/projects/cca1f0c9488342cca197f748d4917151/users/90cd9fd2493049318693ed291f4da19b/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:11.240151 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9d870-c24b-4ed2-b539-0997e26f382f None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:11.240465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9d870-c24b-4ed2-b539-0997e26f382f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:11.240975 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9d870-c24b-4ed2-b539-0997e26f382f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:11.271921 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-a6c9d870-c24b-4ed2-b539-0997e26f382f None None] MFA Rules not processed for user `90cd9fd2493049318693ed291f4da19b`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:11.273212 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a6c9d870-c24b-4ed2-b539-0997e26f382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:11.354984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 990/1952] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:11.365650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb845760-6ae0-4e22-ae42-1bb14a135f41 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:11.367460 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-cb845760-6ae0-4e22-ae42-1bb14a135f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:11.434511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:11.467161 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb845760-6ae0-4e22-ae42-1bb14a135f41 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:11.470805 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d060d87-ae85-46b2-9d2c-c229c0ff9777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:11.471476 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d060d87-ae85-46b2-9d2c-c229c0ff9777 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:11.471751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d060d87-ae85-46b2-9d2c-c229c0ff9777 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:11.472020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d060d87-ae85-46b2-9d2c-c229c0ff9777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:11.540464 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d060d87-ae85-46b2-9d2c-c229c0ff9777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:11.542782 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d060d87-ae85-46b2-9d2c-c229c0ff9777 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:11.556767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 963/1953] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:15.099276 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9d870-c24b-4ed2-b539-0997e26f382f None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:15.100939 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a6c9d870-c24b-4ed2-b539-0997e26f382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:15.184136 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9d870-c24b-4ed2-b539-0997e26f382f None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:15.188587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be90005-3931-4bf7-b14c-e670855923e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:15.189213 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be90005-3931-4bf7-b14c-e670855923e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:15.189487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be90005-3931-4bf7-b14c-e670855923e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:15.189758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be90005-3931-4bf7-b14c-e670855923e6 admin admin] PATH_INFO: `/v3/users/80c203d0491449f0a66dfc5508b5d3c3` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:15.190873 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be90005-3931-4bf7-b14c-e670855923e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c203d0491449f0a66dfc5508b5d3c3)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:15.192805 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be90005-3931-4bf7-b14c-e670855923e6 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:15.245254 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-5be90005-3931-4bf7-b14c-e670855923e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c203d0491449f0a66dfc5508b5d3c3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:15.245975 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-5be90005-3931-4bf7-b14c-e670855923e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c203d0491449f0a66dfc5508b5d3c3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:15.255295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-5be90005-3931-4bf7-b14c-e670855923e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c203d0491449f0a66dfc5508b5d3c3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:15.270024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-5be90005-3931-4bf7-b14c-e670855923e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c203d0491449f0a66dfc5508b5d3c3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:15.270778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-5be90005-3931-4bf7-b14c-e670855923e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c203d0491449f0a66dfc5508b5d3c3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:15.292510 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 991/1954] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:37:15 2022] DELETE /identity/v3/users/80c203d0491449f0a66dfc5508b5d3c3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:15.297438 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e05a1-2280-4259-a3c1-2cf4b4a74459 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:15.297940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e05a1-2280-4259-a3c1-2cf4b4a74459 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:15.298032 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e05a1-2280-4259-a3c1-2cf4b4a74459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:15.329217 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-961e05a1-2280-4259-a3c1-2cf4b4a74459 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:15.330556 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-961e05a1-2280-4259-a3c1-2cf4b4a74459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:15.397641 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 964/1955] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:15.408815 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be90005-3931-4bf7-b14c-e670855923e6 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:15.410468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5be90005-3931-4bf7-b14c-e670855923e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:15.417199 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:15.527348 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be90005-3931-4bf7-b14c-e670855923e6 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:15.533667 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf7e6a-1b82-4c62-8426-660ba5cc35e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:15.541252 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf7e6a-1b82-4c62-8426-660ba5cc35e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:15.542286 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf7e6a-1b82-4c62-8426-660ba5cc35e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:15.543475 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf7e6a-1b82-4c62-8426-660ba5cc35e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:15.556855 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf7e6a-1b82-4c62-8426-660ba5cc35e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:15.559934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf7e6a-1b82-4c62-8426-660ba5cc35e3 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:15.577315 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 992/1956] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:16.047426 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e05a1-2280-4259-a3c1-2cf4b4a74459 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:16.049261 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-961e05a1-2280-4259-a3c1-2cf4b4a74459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:16.127710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e05a1-2280-4259-a3c1-2cf4b4a74459 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:16.131618 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50fea4-3b16-45e3-aadf-937aa3b077e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:16.132613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50fea4-3b16-45e3-aadf-937aa3b077e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:16.133546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50fea4-3b16-45e3-aadf-937aa3b077e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:16.133546 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50fea4-3b16-45e3-aadf-937aa3b077e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:16.138812 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7b50fea4-3b16-45e3-aadf-937aa3b077e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:16.177432 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf7e6a-1b82-4c62-8426-660ba5cc35e3 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:16.178930 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-08bf7e6a-1b82-4c62-8426-660ba5cc35e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:16.200970 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf7e6a-1b82-4c62-8426-660ba5cc35e3 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:16.206077 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955326a0-d200-487b-bcfa-8bfbb217ce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:16.207058 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955326a0-d200-487b-bcfa-8bfbb217ce0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:16.207299 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955326a0-d200-487b-bcfa-8bfbb217ce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:16.207682 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955326a0-d200-487b-bcfa-8bfbb217ce0e admin admin] PATH_INFO: `/v3/projects/f6bc7e51c8e44b6c9976148cb1244bdc` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:16.208895 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955326a0-d200-487b-bcfa-8bfbb217ce0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6bc7e51c8e44b6c9976148cb1244bdc)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:16.211123 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955326a0-d200-487b-bcfa-8bfbb217ce0e admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:16.216216 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:16.247711 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50fea4-3b16-45e3-aadf-937aa3b077e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:16.249429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50fea4-3b16-45e3-aadf-937aa3b077e6 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:16.266800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 965/1957] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:16.281980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-955326a0-d200-487b-bcfa-8bfbb217ce0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6bc7e51c8e44b6c9976148cb1244bdc', 'request_id': 'req-955326a0-d200-487b-bcfa-8bfbb217ce0e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:16.293378 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-955326a0-d200-487b-bcfa-8bfbb217ce0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6bc7e51c8e44b6c9976148cb1244bdc', 'request_id': 'req-955326a0-d200-487b-bcfa-8bfbb217ce0e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:16.303780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-955326a0-d200-487b-bcfa-8bfbb217ce0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6bc7e51c8e44b6c9976148cb1244bdc', 'request_id': 'req-955326a0-d200-487b-bcfa-8bfbb217ce0e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:16.328023 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-955326a0-d200-487b-bcfa-8bfbb217ce0e admin admin] The token cache is being invalidate because project f6bc7e51c8e44b6c9976148cb1244bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:16.328969 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-955326a0-d200-487b-bcfa-8bfbb217ce0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:16.329898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-955326a0-d200-487b-bcfa-8bfbb217ce0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:16.333433 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 993/1958] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:16 2022] DELETE /identity/v3/projects/f6bc7e51c8e44b6c9976148cb1244bdc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:37:16.338716 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c002af-2292-4b5b-ac0a-8b4bc1b39820 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:16.339385 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c002af-2292-4b5b-ac0a-8b4bc1b39820 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:16.339385 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c002af-2292-4b5b-ac0a-8b4bc1b39820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:16.362295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-d9c002af-2292-4b5b-ac0a-8b4bc1b39820 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:16.363831 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d9c002af-2292-4b5b-ac0a-8b4bc1b39820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:16.456017 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 966/1959] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:16.465705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32320073-bd69-4ad1-8ae0-f0332c3e1502 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:16.466482 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32320073-bd69-4ad1-8ae0-f0332c3e1502 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:16.466900 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32320073-bd69-4ad1-8ae0-f0332c3e1502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:16.492986 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-32320073-bd69-4ad1-8ae0-f0332c3e1502 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:16.495365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-32320073-bd69-4ad1-8ae0-f0332c3e1502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:16.509757 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c002af-2292-4b5b-ac0a-8b4bc1b39820 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:16.518100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 994/1960] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:16.523193 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c002af-2292-4b5b-ac0a-8b4bc1b39820 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:16.529941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269379e-d894-4424-a821-ca179e3cbd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:16.531416 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269379e-d894-4424-a821-ca179e3cbd39 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:16.531416 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269379e-d894-4424-a821-ca179e3cbd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:16.531684 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269379e-d894-4424-a821-ca179e3cbd39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:16.532399 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269379e-d894-4424-a821-ca179e3cbd39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:37:16.532971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269379e-d894-4424-a821-ca179e3cbd39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:16.535293 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269379e-d894-4424-a821-ca179e3cbd39 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:16.558290 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 967/1961] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:37:16.560177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32320073-bd69-4ad1-8ae0-f0332c3e1502 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:16.599574 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32320073-bd69-4ad1-8ae0-f0332c3e1502 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:16.612813 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79488a46-6f80-49e7-bc69-a1877af6e4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:16.613769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79488a46-6f80-49e7-bc69-a1877af6e4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:16.615100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79488a46-6f80-49e7-bc69-a1877af6e4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:16.617391 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79488a46-6f80-49e7-bc69-a1877af6e4c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:16.618522 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79488a46-6f80-49e7-bc69-a1877af6e4c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:16.621336 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79488a46-6f80-49e7-bc69-a1877af6e4c3 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:16.698866 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 995/1962] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:37:16 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:16.699804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269379e-d894-4424-a821-ca179e3cbd39 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:16.716153 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269379e-d894-4424-a821-ca179e3cbd39 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:16.802517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f79b68-2184-4652-bdad-f8e450df0890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:16.803278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f79b68-2184-4652-bdad-f8e450df0890 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:16.803805 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f79b68-2184-4652-bdad-f8e450df0890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:16.804182 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f79b68-2184-4652-bdad-f8e450df0890 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:16.805180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f79b68-2184-4652-bdad-f8e450df0890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:16.807529 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f79b68-2184-4652-bdad-f8e450df0890 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:16.842635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 968/1963] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:37:16 2022] POST /identity/v3/users => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:37:16.843915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79488a46-6f80-49e7-bc69-a1877af6e4c3 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:16.861780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79488a46-6f80-49e7-bc69-a1877af6e4c3 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:16.868046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbed7e3-78ae-4055-bfde-0beadc70318d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:16.868921 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbed7e3-78ae-4055-bfde-0beadc70318d admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:16.869204 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbed7e3-78ae-4055-bfde-0beadc70318d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:16.874464 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbed7e3-78ae-4055-bfde-0beadc70318d admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:16.874464 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbed7e3-78ae-4055-bfde-0beadc70318d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:16.874464 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbed7e3-78ae-4055-bfde-0beadc70318d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:16.887638 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 996/1964] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:37:16.892184 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f79b68-2184-4652-bdad-f8e450df0890 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:16.903392 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f79b68-2184-4652-bdad-f8e450df0890 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:16.908697 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05d61f-0bcb-4d4e-9064-e621a2f404d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:16.909390 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05d61f-0bcb-4d4e-9064-e621a2f404d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:16.909676 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05d61f-0bcb-4d4e-9064-e621a2f404d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:16.910027 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05d61f-0bcb-4d4e-9064-e621a2f404d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:16.910909 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05d61f-0bcb-4d4e-9064-e621a2f404d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:16.912817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05d61f-0bcb-4d4e-9064-e621a2f404d4 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:16.937216 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 969/1965] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:16.941500 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbed7e3-78ae-4055-bfde-0beadc70318d admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:16.959414 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbed7e3-78ae-4055-bfde-0beadc70318d admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:16.965147 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69da1f-be98-478d-a099-60752cc37390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:16.965804 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69da1f-be98-478d-a099-60752cc37390 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:16.966078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69da1f-be98-478d-a099-60752cc37390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:16.966350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69da1f-be98-478d-a099-60752cc37390 admin admin] PATH_INFO: `/v3/projects/93acd46ba77d4072b79da1b6b1fb0b29/users/752b46c60d954208b667a28c8d969a65/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:16.983483 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69da1f-be98-478d-a099-60752cc37390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93acd46ba77d4072b79da1b6b1fb0b29, user_id=752b46c60d954208b667a28c8d969a65, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:16.986235 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69da1f-be98-478d-a099-60752cc37390 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:17.006647 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 997/1966] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:37:16 2022] PUT /identity/v3/projects/93acd46ba77d4072b79da1b6b1fb0b29/users/752b46c60d954208b667a28c8d969a65/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:17.017938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b56cf5-dfe2-4000-90ac-d061812dada8 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:17.018255 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b56cf5-dfe2-4000-90ac-d061812dada8 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:17.018527 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b56cf5-dfe2-4000-90ac-d061812dada8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:17.050969 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-93b56cf5-dfe2-4000-90ac-d061812dada8 None None] MFA Rules not processed for user `752b46c60d954208b667a28c8d969a65`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:17.052334 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-93b56cf5-dfe2-4000-90ac-d061812dada8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:17.095720 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:17.135817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 970/1967] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:17.140517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69da1f-be98-478d-a099-60752cc37390 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:17.170475 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:17.214311 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69da1f-be98-478d-a099-60752cc37390 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:17.224295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b03011-7e90-4827-95b1-aa1bb3fd6c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:17.225561 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b03011-7e90-4827-95b1-aa1bb3fd6c51 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:17.226319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b03011-7e90-4827-95b1-aa1bb3fd6c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:17.226678 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b03011-7e90-4827-95b1-aa1bb3fd6c51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:17.227475 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b03011-7e90-4827-95b1-aa1bb3fd6c51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:17.229892 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b03011-7e90-4827-95b1-aa1bb3fd6c51 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:17.266761 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 998/1968] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:37:17 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:17.270510 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b56cf5-dfe2-4000-90ac-d061812dada8 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:17.282856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b56cf5-dfe2-4000-90ac-d061812dada8 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:17.350226 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176ce09-2399-424c-a7cc-b58c65872954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:17.350916 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176ce09-2399-424c-a7cc-b58c65872954 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:17.351148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176ce09-2399-424c-a7cc-b58c65872954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:17.351426 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176ce09-2399-424c-a7cc-b58c65872954 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:17.352078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176ce09-2399-424c-a7cc-b58c65872954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:17.354456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176ce09-2399-424c-a7cc-b58c65872954 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:17.386750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 971/1969] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:37:17 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:17.387874 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b03011-7e90-4827-95b1-aa1bb3fd6c51 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:17.398244 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b03011-7e90-4827-95b1-aa1bb3fd6c51 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:17.403447 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c788c-beb4-4f01-bf0c-80a48b75684d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:17.404181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c788c-beb4-4f01-bf0c-80a48b75684d admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:17.404456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c788c-beb4-4f01-bf0c-80a48b75684d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:17.404726 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c788c-beb4-4f01-bf0c-80a48b75684d admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:17.405439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c788c-beb4-4f01-bf0c-80a48b75684d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:17.408751 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c788c-beb4-4f01-bf0c-80a48b75684d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:17.419372 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 999/1970] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:17.423540 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176ce09-2399-424c-a7cc-b58c65872954 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:17.435774 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176ce09-2399-424c-a7cc-b58c65872954 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:17.440988 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdcbbb-0182-4649-b906-4a38fcde5664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:17.441662 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdcbbb-0182-4649-b906-4a38fcde5664 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:17.441956 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdcbbb-0182-4649-b906-4a38fcde5664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:17.442259 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdcbbb-0182-4649-b906-4a38fcde5664 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:17.442903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdcbbb-0182-4649-b906-4a38fcde5664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:17.444551 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdcbbb-0182-4649-b906-4a38fcde5664 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:17.458859 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 972/1971] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:17.463060 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c788c-beb4-4f01-bf0c-80a48b75684d admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:17.473833 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c788c-beb4-4f01-bf0c-80a48b75684d admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:17.478839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d02d73-f6d3-467a-a65c-15edbf4b725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:17.480058 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d02d73-f6d3-467a-a65c-15edbf4b725e admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:17.480351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d02d73-f6d3-467a-a65c-15edbf4b725e admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:17.480585 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d02d73-f6d3-467a-a65c-15edbf4b725e admin admin] PATH_INFO: `/v3/projects/97463e0d89ac4c4d9ecba36eb6ed386b/users/a5aedb25cd3240dbb0662d8ef8390d18/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:17.496778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d02d73-f6d3-467a-a65c-15edbf4b725e admin admin] RBAC: Authorizing `identity:create_grant(project_id=97463e0d89ac4c4d9ecba36eb6ed386b, user_id=a5aedb25cd3240dbb0662d8ef8390d18, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:17.499882 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d02d73-f6d3-467a-a65c-15edbf4b725e admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:17.517360 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1000/1972] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:37:17 2022] PUT /identity/v3/projects/97463e0d89ac4c4d9ecba36eb6ed386b/users/a5aedb25cd3240dbb0662d8ef8390d18/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:17.528153 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f2c72-3965-4779-85ae-7ebc0c1932d6 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:17.528447 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f2c72-3965-4779-85ae-7ebc0c1932d6 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:17.528730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f2c72-3965-4779-85ae-7ebc0c1932d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:17.560963 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-610f2c72-3965-4779-85ae-7ebc0c1932d6 None None] MFA Rules not processed for user `a5aedb25cd3240dbb0662d8ef8390d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:17.562520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-610f2c72-3965-4779-85ae-7ebc0c1932d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:17.655357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 973/1973] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:17.662714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d02d73-f6d3-467a-a65c-15edbf4b725e admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:17.741983 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d02d73-f6d3-467a-a65c-15edbf4b725e admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:17.747211 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24d539-5303-406f-9c60-6efde86491fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:17.747808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24d539-5303-406f-9c60-6efde86491fc admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:17.748112 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24d539-5303-406f-9c60-6efde86491fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:17.748380 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24d539-5303-406f-9c60-6efde86491fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:17.749004 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24d539-5303-406f-9c60-6efde86491fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:17.750871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24d539-5303-406f-9c60-6efde86491fc admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:17.780986 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1001/1974] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:37:17 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:17.782082 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f2c72-3965-4779-85ae-7ebc0c1932d6 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:17.795787 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f2c72-3965-4779-85ae-7ebc0c1932d6 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:17.837131 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:17.855443 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675f23e-c6fd-40c5-be2c-4fc62afa1873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:17.856033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675f23e-c6fd-40c5-be2c-4fc62afa1873 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:17.856334 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675f23e-c6fd-40c5-be2c-4fc62afa1873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:17.856604 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675f23e-c6fd-40c5-be2c-4fc62afa1873 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:17.857243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675f23e-c6fd-40c5-be2c-4fc62afa1873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:17.859168 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675f23e-c6fd-40c5-be2c-4fc62afa1873 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:17.891158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 974/1975] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:37:17 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:17.894443 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24d539-5303-406f-9c60-6efde86491fc admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:17.905301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24d539-5303-406f-9c60-6efde86491fc admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:17.911786 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a4422-47c6-4f5b-8014-25279c80c81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:17.912341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a4422-47c6-4f5b-8014-25279c80c81a admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:17.912735 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a4422-47c6-4f5b-8014-25279c80c81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:17.913016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3a4422-47c6-4f5b-8014-25279c80c81a admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:17.913729 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a4422-47c6-4f5b-8014-25279c80c81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:17.915465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3a4422-47c6-4f5b-8014-25279c80c81a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:17.927361 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1002/1976] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:37:17.932045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675f23e-c6fd-40c5-be2c-4fc62afa1873 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:17.942357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675f23e-c6fd-40c5-be2c-4fc62afa1873 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:17.947237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531ca1b-e22f-4472-85db-d84217f869d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:17.948037 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531ca1b-e22f-4472-85db-d84217f869d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:17.948376 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531ca1b-e22f-4472-85db-d84217f869d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:17.948656 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1531ca1b-e22f-4472-85db-d84217f869d4 admin admin] PATH_INFO: `/v3/projects/a74ec7a38f2d4096bb368e469bb4631e/users/b0d73347f7294c6abe9dd0e431bb3033/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:17.969322 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531ca1b-e22f-4472-85db-d84217f869d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74ec7a38f2d4096bb368e469bb4631e, user_id=b0d73347f7294c6abe9dd0e431bb3033, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:17.972044 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1531ca1b-e22f-4472-85db-d84217f869d4 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:17.988151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 975/1977] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:37:17 2022] PUT /identity/v3/projects/a74ec7a38f2d4096bb368e469bb4631e/users/b0d73347f7294c6abe9dd0e431bb3033/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:17.992472 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a4422-47c6-4f5b-8014-25279c80c81a admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:18.004079 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3a4422-47c6-4f5b-8014-25279c80c81a admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:18.052877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:18.067905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d425f2-9d01-41d6-844e-91c7b5267e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:18.068519 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d425f2-9d01-41d6-844e-91c7b5267e97 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:18.068801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d425f2-9d01-41d6-844e-91c7b5267e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:18.069114 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d425f2-9d01-41d6-844e-91c7b5267e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:18.069763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d425f2-9d01-41d6-844e-91c7b5267e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:18.071400 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d425f2-9d01-41d6-844e-91c7b5267e97 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:18.082360 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1003/1978] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:18.086433 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531ca1b-e22f-4472-85db-d84217f869d4 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:18.098199 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1531ca1b-e22f-4472-85db-d84217f869d4 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:18.103507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a0dcf-2b37-4e1a-9096-aef8664918aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:18.104317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a0dcf-2b37-4e1a-9096-aef8664918aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:18.105063 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a0dcf-2b37-4e1a-9096-aef8664918aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:18.105363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a0dcf-2b37-4e1a-9096-aef8664918aa admin admin] PATH_INFO: `/v3/projects/a74ec7a38f2d4096bb368e469bb4631e/users/b0d73347f7294c6abe9dd0e431bb3033/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:18.107699 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a0dcf-2b37-4e1a-9096-aef8664918aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74ec7a38f2d4096bb368e469bb4631e, user_id=b0d73347f7294c6abe9dd0e431bb3033, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:18.110393 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a0dcf-2b37-4e1a-9096-aef8664918aa admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:18.123056 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 976/1979] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:37:18 2022] PUT /identity/v3/projects/a74ec7a38f2d4096bb368e469bb4631e/users/b0d73347f7294c6abe9dd0e431bb3033/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:37:18.133301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e539b7c-f4e7-431c-9141-940dff8d9076 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:18.133607 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e539b7c-f4e7-431c-9141-940dff8d9076 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:18.133881 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e539b7c-f4e7-431c-9141-940dff8d9076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:18.173970 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-9e539b7c-f4e7-431c-9141-940dff8d9076 None None] MFA Rules not processed for user `b0d73347f7294c6abe9dd0e431bb3033`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:18.175419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9e539b7c-f4e7-431c-9141-940dff8d9076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:18.256989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1004/1980] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:18.312234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a0dcf-2b37-4e1a-9096-aef8664918aa admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:18.314431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-288a0dcf-2b37-4e1a-9096-aef8664918aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:18.382521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a0dcf-2b37-4e1a-9096-aef8664918aa admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:18.387748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe17bac-759c-4d85-b467-33cacb19f07d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:18.388621 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe17bac-759c-4d85-b467-33cacb19f07d service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:18.388852 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe17bac-759c-4d85-b467-33cacb19f07d service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:18.389248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe17bac-759c-4d85-b467-33cacb19f07d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:18.468487 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe17bac-759c-4d85-b467-33cacb19f07d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:18.469969 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe17bac-759c-4d85-b467-33cacb19f07d service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:18.482131 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 977/1981] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:20.075223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e539b7c-f4e7-431c-9141-940dff8d9076 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:20.076783 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9e539b7c-f4e7-431c-9141-940dff8d9076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:20.090154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e539b7c-f4e7-431c-9141-940dff8d9076 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:20.093648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf180f-7c4f-4a46-a72b-41328ff856ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:20.094251 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf180f-7c4f-4a46-a72b-41328ff856ec service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:20.094526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf180f-7c4f-4a46-a72b-41328ff856ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:20.094800 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf180f-7c4f-4a46-a72b-41328ff856ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:20.154285 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf180f-7c4f-4a46-a72b-41328ff856ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:20.155731 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaf180f-7c4f-4a46-a72b-41328ff856ec service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:20.165795 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1005/1982] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:20.800353 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe17bac-759c-4d85-b467-33cacb19f07d service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:20.809811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe17bac-759c-4d85-b467-33cacb19f07d service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:20.813458 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ba9de-f084-4dcf-ad23-d02128b20b41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:20.814087 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ba9de-f084-4dcf-ad23-d02128b20b41 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:20.814367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ba9de-f084-4dcf-ad23-d02128b20b41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:20.814640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ba9de-f084-4dcf-ad23-d02128b20b41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:20.824325 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ba9de-f084-4dcf-ad23-d02128b20b41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:20.825752 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ba9de-f084-4dcf-ad23-d02128b20b41 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:20.836410 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 978/1983] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:21.339239 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf180f-7c4f-4a46-a72b-41328ff856ec service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:21.340811 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-efaf180f-7c4f-4a46-a72b-41328ff856ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:21.423869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf180f-7c4f-4a46-a72b-41328ff856ec service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:21.429866 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba9834-c9f0-4947-a3f4-dc7f2d57d91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:21.430604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba9834-c9f0-4947-a3f4-dc7f2d57d91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:21.430923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba9834-c9f0-4947-a3f4-dc7f2d57d91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:21.431510 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba9834-c9f0-4947-a3f4-dc7f2d57d91a admin admin] PATH_INFO: `/v3/users/b06c43d211b447bfb43653cee0ab92fe` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:21.433684 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba9834-c9f0-4947-a3f4-dc7f2d57d91a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b06c43d211b447bfb43653cee0ab92fe)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:21.435969 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba9834-c9f0-4947-a3f4-dc7f2d57d91a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:21.449945 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:21.508169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-04ba9834-c9f0-4947-a3f4-dc7f2d57d91a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b06c43d211b447bfb43653cee0ab92fe'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:21.508589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-04ba9834-c9f0-4947-a3f4-dc7f2d57d91a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b06c43d211b447bfb43653cee0ab92fe'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:21.517985 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-04ba9834-c9f0-4947-a3f4-dc7f2d57d91a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b06c43d211b447bfb43653cee0ab92fe'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:21.533189 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-04ba9834-c9f0-4947-a3f4-dc7f2d57d91a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b06c43d211b447bfb43653cee0ab92fe'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:21.533951 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-04ba9834-c9f0-4947-a3f4-dc7f2d57d91a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b06c43d211b447bfb43653cee0ab92fe'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:21.549936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1006/1984] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:37:21 2022] DELETE /identity/v3/users/b06c43d211b447bfb43653cee0ab92fe => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:21.555305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb87749-0fe5-4198-82b7-720823644cc7 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:21.555596 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb87749-0fe5-4198-82b7-720823644cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:21.555935 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb87749-0fe5-4198-82b7-720823644cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:21.577070 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-bbb87749-0fe5-4198-82b7-720823644cc7 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:21.578409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-bbb87749-0fe5-4198-82b7-720823644cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:21.613204 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:21.650218 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 979/1985] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:21.662808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba9834-c9f0-4947-a3f4-dc7f2d57d91a admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:21.665675 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-04ba9834-c9f0-4947-a3f4-dc7f2d57d91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:21.729954 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba9834-c9f0-4947-a3f4-dc7f2d57d91a admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:21.734170 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287adad-d5db-4486-b54d-eb1182a9ce43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:21.734811 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287adad-d5db-4486-b54d-eb1182a9ce43 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:21.735277 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287adad-d5db-4486-b54d-eb1182a9ce43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:21.735541 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287adad-d5db-4486-b54d-eb1182a9ce43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:21.746334 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287adad-d5db-4486-b54d-eb1182a9ce43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:21.747794 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287adad-d5db-4486-b54d-eb1182a9ce43 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:21.763603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1007/1986] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:22.048811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb87749-0fe5-4198-82b7-720823644cc7 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:22.050291 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-bbb87749-0fe5-4198-82b7-720823644cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:22.063926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb87749-0fe5-4198-82b7-720823644cc7 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:22.071122 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385fe17-d52b-488d-b351-9319d28615e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:22.071122 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385fe17-d52b-488d-b351-9319d28615e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:22.071122 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385fe17-d52b-488d-b351-9319d28615e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:22.071122 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385fe17-d52b-488d-b351-9319d28615e3 admin admin] PATH_INFO: `/v3/projects/1211a53fc4674943867f0471ca70abb5` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:22.071418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385fe17-d52b-488d-b351-9319d28615e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1211a53fc4674943867f0471ca70abb5)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:22.074641 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385fe17-d52b-488d-b351-9319d28615e3 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:22.128364 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-0385fe17-d52b-488d-b351-9319d28615e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1211a53fc4674943867f0471ca70abb5', 'request_id': 'req-0385fe17-d52b-488d-b351-9319d28615e3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:22.138926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-0385fe17-d52b-488d-b351-9319d28615e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1211a53fc4674943867f0471ca70abb5', 'request_id': 'req-0385fe17-d52b-488d-b351-9319d28615e3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:22.145302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-0385fe17-d52b-488d-b351-9319d28615e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1211a53fc4674943867f0471ca70abb5', 'request_id': 'req-0385fe17-d52b-488d-b351-9319d28615e3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:22.158183 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-0385fe17-d52b-488d-b351-9319d28615e3 admin admin] The token cache is being invalidate because project 1211a53fc4674943867f0471ca70abb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:22.158436 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-0385fe17-d52b-488d-b351-9319d28615e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:22.159066 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-0385fe17-d52b-488d-b351-9319d28615e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:22.160581 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 980/1987] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:22 2022] DELETE /identity/v3/projects/1211a53fc4674943867f0471ca70abb5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:22.164733 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287adad-d5db-4486-b54d-eb1182a9ce43 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:22.174794 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287adad-d5db-4486-b54d-eb1182a9ce43 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:22.272863 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07a87a-1359-46d1-a1c6-329347315808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:22.273660 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07a87a-1359-46d1-a1c6-329347315808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:22.273896 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07a87a-1359-46d1-a1c6-329347315808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:22.274271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07a87a-1359-46d1-a1c6-329347315808 admin admin] PATH_INFO: `/v3/users/90cd9fd2493049318693ed291f4da19b` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:22.275428 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07a87a-1359-46d1-a1c6-329347315808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90cd9fd2493049318693ed291f4da19b)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:22.278030 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07a87a-1359-46d1-a1c6-329347315808 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:22.340049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:22.361691 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-1b07a87a-1359-46d1-a1c6-329347315808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90cd9fd2493049318693ed291f4da19b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:22.362367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-1b07a87a-1359-46d1-a1c6-329347315808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90cd9fd2493049318693ed291f4da19b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:22.369295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-1b07a87a-1359-46d1-a1c6-329347315808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90cd9fd2493049318693ed291f4da19b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:22.381685 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-1b07a87a-1359-46d1-a1c6-329347315808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90cd9fd2493049318693ed291f4da19b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:22.382348 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-1b07a87a-1359-46d1-a1c6-329347315808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90cd9fd2493049318693ed291f4da19b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:22.395273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1008/1988] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:37:22 2022] DELETE /identity/v3/users/90cd9fd2493049318693ed291f4da19b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:22.679434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385fe17-d52b-488d-b351-9319d28615e3 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:22.681168 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0385fe17-d52b-488d-b351-9319d28615e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:22.696225 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385fe17-d52b-488d-b351-9319d28615e3 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:22.757792 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f05afe-5484-4f9b-804c-59ceda068887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:22.758459 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f05afe-5484-4f9b-804c-59ceda068887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:22.758736 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f05afe-5484-4f9b-804c-59ceda068887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:22.759030 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f05afe-5484-4f9b-804c-59ceda068887 admin admin] PATH_INFO: `/v3/projects/cca1f0c9488342cca197f748d4917151` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:22.760236 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f05afe-5484-4f9b-804c-59ceda068887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cca1f0c9488342cca197f748d4917151)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:22.762648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f05afe-5484-4f9b-804c-59ceda068887 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:22.815486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f5f05afe-5484-4f9b-804c-59ceda068887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cca1f0c9488342cca197f748d4917151', 'request_id': 'req-f5f05afe-5484-4f9b-804c-59ceda068887'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:22.822025 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f5f05afe-5484-4f9b-804c-59ceda068887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cca1f0c9488342cca197f748d4917151', 'request_id': 'req-f5f05afe-5484-4f9b-804c-59ceda068887'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:22.827622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:22.828841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f5f05afe-5484-4f9b-804c-59ceda068887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cca1f0c9488342cca197f748d4917151', 'request_id': 'req-f5f05afe-5484-4f9b-804c-59ceda068887'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:22.843320 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f5f05afe-5484-4f9b-804c-59ceda068887 admin admin] The token cache is being invalidate because project cca1f0c9488342cca197f748d4917151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:22.843620 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f5f05afe-5484-4f9b-804c-59ceda068887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:22.844487 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f5f05afe-5484-4f9b-804c-59ceda068887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:22.846964 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 981/1989] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:22 2022] DELETE /identity/v3/projects/cca1f0c9488342cca197f748d4917151 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:37:22.853551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bca19-7136-4a50-aac1-25fb4ed88c22 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:22.853551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bca19-7136-4a50-aac1-25fb4ed88c22 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:22.853551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bca19-7136-4a50-aac1-25fb4ed88c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:22.875774 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-678bca19-7136-4a50-aac1-25fb4ed88c22 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:22.877864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-678bca19-7136-4a50-aac1-25fb4ed88c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:22.948691 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1009/1990] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:22.958086 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85393685-2c9b-4a2f-8987-3afb7cfcf114 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:22.958379 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85393685-2c9b-4a2f-8987-3afb7cfcf114 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:22.958659 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85393685-2c9b-4a2f-8987-3afb7cfcf114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:22.986384 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-85393685-2c9b-4a2f-8987-3afb7cfcf114 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:22.987640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-85393685-2c9b-4a2f-8987-3afb7cfcf114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:23.001567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 982/1991] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:23.006599 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bca19-7136-4a50-aac1-25fb4ed88c22 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:23.021066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bca19-7136-4a50-aac1-25fb4ed88c22 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:23.028256 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514190d-8c2b-414d-bfa9-e40107385aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:23.028961 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514190d-8c2b-414d-bfa9-e40107385aea admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:23.029238 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514190d-8c2b-414d-bfa9-e40107385aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:23.029504 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b514190d-8c2b-414d-bfa9-e40107385aea admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:23.030149 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514190d-8c2b-414d-bfa9-e40107385aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:37:23.030451 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514190d-8c2b-414d-bfa9-e40107385aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:23.032198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b514190d-8c2b-414d-bfa9-e40107385aea admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:23.045341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1010/1992] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:37:23.050001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85393685-2c9b-4a2f-8987-3afb7cfcf114 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:23.061861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85393685-2c9b-4a2f-8987-3afb7cfcf114 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:23.067476 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a66cb1-2b22-412e-983c-dd0234e0d094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:23.068158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a66cb1-2b22-412e-983c-dd0234e0d094 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:23.068505 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a66cb1-2b22-412e-983c-dd0234e0d094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:23.068959 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a66cb1-2b22-412e-983c-dd0234e0d094 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:23.069652 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a66cb1-2b22-412e-983c-dd0234e0d094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:23.071804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a66cb1-2b22-412e-983c-dd0234e0d094 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:23.102348 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 983/1993] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:37:23 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:23.107449 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514190d-8c2b-414d-bfa9-e40107385aea admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:23.117354 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b514190d-8c2b-414d-bfa9-e40107385aea admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:23.176981 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a783298-ed83-4775-9abe-82457178522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:23.177595 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a783298-ed83-4775-9abe-82457178522e admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:23.177870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a783298-ed83-4775-9abe-82457178522e admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:23.178138 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a783298-ed83-4775-9abe-82457178522e admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:23.178896 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a783298-ed83-4775-9abe-82457178522e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:23.181482 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a783298-ed83-4775-9abe-82457178522e admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:23.203347 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1011/1994] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:37:23 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:23.207372 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a66cb1-2b22-412e-983c-dd0234e0d094 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:23.218816 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a66cb1-2b22-412e-983c-dd0234e0d094 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:23.223496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d9077-4b86-4a18-adbe-0866fd25dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:23.224114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d9077-4b86-4a18-adbe-0866fd25dff1 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:23.224397 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d9077-4b86-4a18-adbe-0866fd25dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:23.224672 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d9077-4b86-4a18-adbe-0866fd25dff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:23.225343 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d9077-4b86-4a18-adbe-0866fd25dff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:23.226938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d9077-4b86-4a18-adbe-0866fd25dff1 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:23.238216 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 984/1995] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:23.242734 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a783298-ed83-4775-9abe-82457178522e admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:23.253068 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a783298-ed83-4775-9abe-82457178522e admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:23.257876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86751faf-18bd-428a-aae9-1b993b2c3a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:23.258479 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86751faf-18bd-428a-aae9-1b993b2c3a87 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:23.258776 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86751faf-18bd-428a-aae9-1b993b2c3a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:23.259068 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86751faf-18bd-428a-aae9-1b993b2c3a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:23.259708 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86751faf-18bd-428a-aae9-1b993b2c3a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:23.261832 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86751faf-18bd-428a-aae9-1b993b2c3a87 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:23.272462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1012/1996] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:23.277351 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d9077-4b86-4a18-adbe-0866fd25dff1 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:23.287905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d9077-4b86-4a18-adbe-0866fd25dff1 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:23.292527 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cc94c-4cd1-44b8-b03e-92c8233068a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:23.293187 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cc94c-4cd1-44b8-b03e-92c8233068a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:23.293448 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cc94c-4cd1-44b8-b03e-92c8233068a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:23.293716 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cc94c-4cd1-44b8-b03e-92c8233068a6 admin admin] PATH_INFO: `/v3/projects/0222ebb15613444d8eac847109953eaf/users/386b3a63639443b1926f97122450f9b3/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:23.311122 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365cc94c-4cd1-44b8-b03e-92c8233068a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0222ebb15613444d8eac847109953eaf, user_id=386b3a63639443b1926f97122450f9b3, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:23.314043 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365cc94c-4cd1-44b8-b03e-92c8233068a6 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:23.328329 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 985/1997] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:37:23 2022] PUT /identity/v3/projects/0222ebb15613444d8eac847109953eaf/users/386b3a63639443b1926f97122450f9b3/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:37:23.340177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e065a-e7a9-4df6-aff6-f1e02937763e None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:23.340673 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e065a-e7a9-4df6-aff6-f1e02937763e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:23.341043 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e065a-e7a9-4df6-aff6-f1e02937763e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:23.371001 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-2e1e065a-e7a9-4df6-aff6-f1e02937763e None None] MFA Rules not processed for user `386b3a63639443b1926f97122450f9b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:23.372460 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2e1e065a-e7a9-4df6-aff6-f1e02937763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:23.378095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:23.475893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1013/1998] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:23.499742 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cc94c-4cd1-44b8-b03e-92c8233068a6 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:23.501619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-365cc94c-4cd1-44b8-b03e-92c8233068a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:23.576003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cc94c-4cd1-44b8-b03e-92c8233068a6 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:23.579860 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4621337-b6bc-4405-b92f-5af9b85732bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:23.580472 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4621337-b6bc-4405-b92f-5af9b85732bb service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:23.580750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4621337-b6bc-4405-b92f-5af9b85732bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:23.581021 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4621337-b6bc-4405-b92f-5af9b85732bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:23.590393 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4621337-b6bc-4405-b92f-5af9b85732bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:23.591951 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4621337-b6bc-4405-b92f-5af9b85732bb service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:23.601421 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 986/1999] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:23.637188 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e065a-e7a9-4df6-aff6-f1e02937763e None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:23.706479 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e065a-e7a9-4df6-aff6-f1e02937763e None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:23.711418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef64df-774b-4d8a-b92b-083d6815fc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:23.712154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef64df-774b-4d8a-b92b-083d6815fc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:23.712440 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef64df-774b-4d8a-b92b-083d6815fc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:23.712714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef64df-774b-4d8a-b92b-083d6815fc48 admin admin] PATH_INFO: `/v3/users/386b3a63639443b1926f97122450f9b3` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:23.713911 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef64df-774b-4d8a-b92b-083d6815fc48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=386b3a63639443b1926f97122450f9b3)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:23.715865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef64df-774b-4d8a-b92b-083d6815fc48 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:23.764586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-2fef64df-774b-4d8a-b92b-083d6815fc48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '386b3a63639443b1926f97122450f9b3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:23.765237 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-2fef64df-774b-4d8a-b92b-083d6815fc48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '386b3a63639443b1926f97122450f9b3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:23.772091 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-2fef64df-774b-4d8a-b92b-083d6815fc48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '386b3a63639443b1926f97122450f9b3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:23.784371 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-2fef64df-774b-4d8a-b92b-083d6815fc48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '386b3a63639443b1926f97122450f9b3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:23.785008 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-2fef64df-774b-4d8a-b92b-083d6815fc48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '386b3a63639443b1926f97122450f9b3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:23.798023 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1014/2000] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:37:23 2022] DELETE /identity/v3/users/386b3a63639443b1926f97122450f9b3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:23.802389 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c11c31-d412-49bd-98af-62cf54abefe8 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:23.802678 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c11c31-d412-49bd-98af-62cf54abefe8 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:23.802968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c11c31-d412-49bd-98af-62cf54abefe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:23.822765 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-e3c11c31-d412-49bd-98af-62cf54abefe8 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:23.824959 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e3c11c31-d412-49bd-98af-62cf54abefe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:23.892254 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 987/2001] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:23.902876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef64df-774b-4d8a-b92b-083d6815fc48 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:23.904341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2fef64df-774b-4d8a-b92b-083d6815fc48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:23.932514 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:23.964656 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef64df-774b-4d8a-b92b-083d6815fc48 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:23.968225 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033c201-e17c-4b93-9092-677269a06c99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:23.968832 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c201-e17c-4b93-9092-677269a06c99 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:23.969107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c201-e17c-4b93-9092-677269a06c99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:23.969375 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033c201-e17c-4b93-9092-677269a06c99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:23.978236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033c201-e17c-4b93-9092-677269a06c99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:23.980279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033c201-e17c-4b93-9092-677269a06c99 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:23.989553 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1015/2002] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:24.330470 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c11c31-d412-49bd-98af-62cf54abefe8 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:24.331982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e3c11c31-d412-49bd-98af-62cf54abefe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:24.347825 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c11c31-d412-49bd-98af-62cf54abefe8 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:24.352510 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e4f8e-325d-4f80-b564-bf6bc1b77f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:24.353150 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e4f8e-325d-4f80-b564-bf6bc1b77f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:24.353429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e4f8e-325d-4f80-b564-bf6bc1b77f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:24.353713 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e4f8e-325d-4f80-b564-bf6bc1b77f7d admin admin] PATH_INFO: `/v3/projects/0222ebb15613444d8eac847109953eaf` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:24.355808 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e4f8e-325d-4f80-b564-bf6bc1b77f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0222ebb15613444d8eac847109953eaf)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:24.357738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e4f8e-325d-4f80-b564-bf6bc1b77f7d admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:24.385420 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:24.410090 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9a7e4f8e-325d-4f80-b564-bf6bc1b77f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0222ebb15613444d8eac847109953eaf', 'request_id': 'req-9a7e4f8e-325d-4f80-b564-bf6bc1b77f7d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:24.416234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9a7e4f8e-325d-4f80-b564-bf6bc1b77f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0222ebb15613444d8eac847109953eaf', 'request_id': 'req-9a7e4f8e-325d-4f80-b564-bf6bc1b77f7d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:24.422335 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9a7e4f8e-325d-4f80-b564-bf6bc1b77f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0222ebb15613444d8eac847109953eaf', 'request_id': 'req-9a7e4f8e-325d-4f80-b564-bf6bc1b77f7d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:24.434737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9a7e4f8e-325d-4f80-b564-bf6bc1b77f7d admin admin] The token cache is being invalidate because project 0222ebb15613444d8eac847109953eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:24.435054 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9a7e4f8e-325d-4f80-b564-bf6bc1b77f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:24.435671 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-9a7e4f8e-325d-4f80-b564-bf6bc1b77f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:24.437171 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 988/2003] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:24 2022] DELETE /identity/v3/projects/0222ebb15613444d8eac847109953eaf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:24.442212 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0ed27-1dce-44aa-9ee4-3dddf083f7a6 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:24.442662 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0ed27-1dce-44aa-9ee4-3dddf083f7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:24.442763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0ed27-1dce-44aa-9ee4-3dddf083f7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:24.462392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-08b0ed27-1dce-44aa-9ee4-3dddf083f7a6 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:24.464231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-08b0ed27-1dce-44aa-9ee4-3dddf083f7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:24.535036 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1016/2004] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:24.543805 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571cf7d-7301-4f63-bb0e-f1cf38c84ade None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:24.544348 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571cf7d-7301-4f63-bb0e-f1cf38c84ade None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:24.544630 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571cf7d-7301-4f63-bb0e-f1cf38c84ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:24.565248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-a571cf7d-7301-4f63-bb0e-f1cf38c84ade None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:24.566439 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a571cf7d-7301-4f63-bb0e-f1cf38c84ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:24.575402 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 989/2005] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:37:24.579699 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0ed27-1dce-44aa-9ee4-3dddf083f7a6 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:24.596083 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0ed27-1dce-44aa-9ee4-3dddf083f7a6 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:24.601444 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492bac8-3bd9-4766-825b-8ac64c96b3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:24.602141 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492bac8-3bd9-4766-825b-8ac64c96b3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:24.602813 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492bac8-3bd9-4766-825b-8ac64c96b3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:24.603162 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492bac8-3bd9-4766-825b-8ac64c96b3b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:24.604584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492bac8-3bd9-4766-825b-8ac64c96b3b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:37:24.605145 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492bac8-3bd9-4766-825b-8ac64c96b3b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:24.607218 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492bac8-3bd9-4766-825b-8ac64c96b3b6 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:24.620841 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1017/2006] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:37:24.625478 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571cf7d-7301-4f63-bb0e-f1cf38c84ade None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:24.635740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571cf7d-7301-4f63-bb0e-f1cf38c84ade None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:24.642507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36797e-f228-415c-8d04-a23b6297a023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:24.643108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36797e-f228-415c-8d04-a23b6297a023 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:24.643400 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36797e-f228-415c-8d04-a23b6297a023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:24.643694 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36797e-f228-415c-8d04-a23b6297a023 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:24.644542 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36797e-f228-415c-8d04-a23b6297a023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:24.646584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36797e-f228-415c-8d04-a23b6297a023 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:24.683558 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 990/2007] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:37:24 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:24.687634 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492bac8-3bd9-4766-825b-8ac64c96b3b6 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:24.698128 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492bac8-3bd9-4766-825b-8ac64c96b3b6 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:24.753185 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea46b1-2b18-4413-9cef-7ae8f4b6e09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:24.753785 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea46b1-2b18-4413-9cef-7ae8f4b6e09a admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:24.754062 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea46b1-2b18-4413-9cef-7ae8f4b6e09a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:24.754334 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea46b1-2b18-4413-9cef-7ae8f4b6e09a admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:24.754989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea46b1-2b18-4413-9cef-7ae8f4b6e09a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:24.756880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea46b1-2b18-4413-9cef-7ae8f4b6e09a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:24.779037 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1018/2008] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:37:24 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:24.783170 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36797e-f228-415c-8d04-a23b6297a023 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:24.795427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36797e-f228-415c-8d04-a23b6297a023 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:24.800090 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86018e1b-84c9-419b-8441-6418045215d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:24.800703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86018e1b-84c9-419b-8441-6418045215d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:24.801012 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86018e1b-84c9-419b-8441-6418045215d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:24.801292 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86018e1b-84c9-419b-8441-6418045215d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:24.801966 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86018e1b-84c9-419b-8441-6418045215d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:24.804456 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86018e1b-84c9-419b-8441-6418045215d2 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:24.814591 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 991/2009] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:24.818231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea46b1-2b18-4413-9cef-7ae8f4b6e09a admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:24.831711 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea46b1-2b18-4413-9cef-7ae8f4b6e09a admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:24.836483 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac77f7-3442-442d-9809-844735cb594c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:24.837095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac77f7-3442-442d-9809-844735cb594c admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:24.837374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac77f7-3442-442d-9809-844735cb594c admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:24.837648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac77f7-3442-442d-9809-844735cb594c admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:24.838918 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac77f7-3442-442d-9809-844735cb594c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:24.840624 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac77f7-3442-442d-9809-844735cb594c admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:24.841821 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86018e1b-84c9-419b-8441-6418045215d2 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:24.843951 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-86018e1b-84c9-419b-8441-6418045215d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:24.854703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1019/2010] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:24.855722 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac77f7-3442-442d-9809-844735cb594c admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:24.858206 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86018e1b-84c9-419b-8441-6418045215d2 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:24.863062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb41cf-da96-46de-ba1a-fc505f965667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:24.863855 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb41cf-da96-46de-ba1a-fc505f965667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:24.864157 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb41cf-da96-46de-ba1a-fc505f965667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:24.864432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb41cf-da96-46de-ba1a-fc505f965667 admin admin] PATH_INFO: `/v3/users/752b46c60d954208b667a28c8d969a65` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:24.865450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac77f7-3442-442d-9809-844735cb594c admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:24.865805 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb41cf-da96-46de-ba1a-fc505f965667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=752b46c60d954208b667a28c8d969a65)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:24.867827 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb41cf-da96-46de-ba1a-fc505f965667 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:24.880949 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf12c1a-35e3-4b8c-89b9-2b377b3acbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:24.881680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf12c1a-35e3-4b8c-89b9-2b377b3acbe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:24.881955 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf12c1a-35e3-4b8c-89b9-2b377b3acbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:24.882277 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf12c1a-35e3-4b8c-89b9-2b377b3acbe7 admin admin] PATH_INFO: `/v3/projects/9ca3922325c44b7a835df8c232373237/users/136c682beb26448690e26e8b71d7793c/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:24.902655 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf12c1a-35e3-4b8c-89b9-2b377b3acbe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca3922325c44b7a835df8c232373237, user_id=136c682beb26448690e26e8b71d7793c, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:24.905445 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf12c1a-35e3-4b8c-89b9-2b377b3acbe7 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:24.919518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1020/2011] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:37:24 2022] PUT /identity/v3/projects/9ca3922325c44b7a835df8c232373237/users/136c682beb26448690e26e8b71d7793c/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:37:24.924181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-89cb41cf-da96-46de-ba1a-fc505f965667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '752b46c60d954208b667a28c8d969a65'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:24.924977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-89cb41cf-da96-46de-ba1a-fc505f965667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '752b46c60d954208b667a28c8d969a65'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:24.930640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76ee73-5330-46ed-8ac0-9423dab153a4 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:24.930925 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76ee73-5330-46ed-8ac0-9423dab153a4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:24.931228 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76ee73-5330-46ed-8ac0-9423dab153a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:24.935228 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-89cb41cf-da96-46de-ba1a-fc505f965667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '752b46c60d954208b667a28c8d969a65'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:24.949269 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-89cb41cf-da96-46de-ba1a-fc505f965667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '752b46c60d954208b667a28c8d969a65'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:24.949984 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-89cb41cf-da96-46de-ba1a-fc505f965667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '752b46c60d954208b667a28c8d969a65'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:24.951682 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:24.963254 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0b76ee73-5330-46ed-8ac0-9423dab153a4 None None] MFA Rules not processed for user `136c682beb26448690e26e8b71d7793c`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:24.964326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 992/2012] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:37:24 2022] DELETE /identity/v3/users/752b46c60d954208b667a28c8d969a65 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:37:24.967168 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0b76ee73-5330-46ed-8ac0-9423dab153a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:24.968902 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a00af5-c360-41f2-a622-4920160e123c None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:24.969343 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a00af5-c360-41f2-a622-4920160e123c None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:24.969614 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a00af5-c360-41f2-a622-4920160e123c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:24.989767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-65a00af5-c360-41f2-a622-4920160e123c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:24.991067 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-65a00af5-c360-41f2-a622-4920160e123c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:25.037592 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:25.038594 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1021/2013] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:37:25.043546 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76ee73-5330-46ed-8ac0-9423dab153a4 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:25.044869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0b76ee73-5330-46ed-8ac0-9423dab153a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:25.060365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 993/2014] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:37:25.069961 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a00af5-c360-41f2-a622-4920160e123c None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:25.072019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-65a00af5-c360-41f2-a622-4920160e123c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:25.131549 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76ee73-5330-46ed-8ac0-9423dab153a4 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:25.135475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a00af5-c360-41f2-a622-4920160e123c None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:25.137450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5f298-99b1-4413-bde4-993cca7b180f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:25.138065 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5f298-99b1-4413-bde4-993cca7b180f admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:25.138343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5f298-99b1-4413-bde4-993cca7b180f admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:25.138613 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5f298-99b1-4413-bde4-993cca7b180f admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:25.139373 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5f298-99b1-4413-bde4-993cca7b180f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:25.139477 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f1338-3e93-4600-8d65-9d49e2ff744e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:25.140104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f1338-3e93-4600-8d65-9d49e2ff744e service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:25.140447 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f1338-3e93-4600-8d65-9d49e2ff744e service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:25.140781 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f1338-3e93-4600-8d65-9d49e2ff744e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:25.141370 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5f298-99b1-4413-bde4-993cca7b180f admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:25.154934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f1338-3e93-4600-8d65-9d49e2ff744e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:25.154934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f1338-3e93-4600-8d65-9d49e2ff744e service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:25.167652 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 994/2015] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:37:25.176279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1022/2016] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:37:25 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:37:25.180588 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f1338-3e93-4600-8d65-9d49e2ff744e service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:25.190575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f1338-3e93-4600-8d65-9d49e2ff744e service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:25.257859 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d8d26-5be3-4b3a-8681-133d06142963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:25.258509 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d8d26-5be3-4b3a-8681-133d06142963 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:25.258783 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d8d26-5be3-4b3a-8681-133d06142963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:25.259080 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d8d26-5be3-4b3a-8681-133d06142963 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:25.259786 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d8d26-5be3-4b3a-8681-133d06142963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:25.261968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d8d26-5be3-4b3a-8681-133d06142963 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:25.286836 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 995/2017] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:37:25 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:25.290686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5f298-99b1-4413-bde4-993cca7b180f admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:25.303061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5f298-99b1-4413-bde4-993cca7b180f admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:25.308607 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86566d62-ef1a-480c-9d73-499754db341b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:25.309219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86566d62-ef1a-480c-9d73-499754db341b admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:25.309498 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86566d62-ef1a-480c-9d73-499754db341b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:25.309767 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86566d62-ef1a-480c-9d73-499754db341b admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:25.310504 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86566d62-ef1a-480c-9d73-499754db341b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:25.312445 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86566d62-ef1a-480c-9d73-499754db341b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:25.327711 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d8d26-5be3-4b3a-8681-133d06142963 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:25.335725 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1023/2018] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:25.347742 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d8d26-5be3-4b3a-8681-133d06142963 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:25.353031 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af30d6-9c0d-4fe8-8b62-35ae7dea79c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:25.353650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af30d6-9c0d-4fe8-8b62-35ae7dea79c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:25.354789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af30d6-9c0d-4fe8-8b62-35ae7dea79c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:25.355245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af30d6-9c0d-4fe8-8b62-35ae7dea79c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:25.356167 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af30d6-9c0d-4fe8-8b62-35ae7dea79c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:25.357782 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af30d6-9c0d-4fe8-8b62-35ae7dea79c5 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:25.370280 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 996/2019] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:25.375251 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86566d62-ef1a-480c-9d73-499754db341b admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:25.390374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86566d62-ef1a-480c-9d73-499754db341b admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:25.395403 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526be842-1bd0-4347-86f0-eae65c570504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:25.396079 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526be842-1bd0-4347-86f0-eae65c570504 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:25.396363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526be842-1bd0-4347-86f0-eae65c570504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:25.396644 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526be842-1bd0-4347-86f0-eae65c570504 admin admin] PATH_INFO: `/v3/projects/b201a2152c7f4e3ab46688cbb6a57506/users/e41ba34cab4645269d43694b56f1bf1d/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:25.415016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526be842-1bd0-4347-86f0-eae65c570504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b201a2152c7f4e3ab46688cbb6a57506, user_id=e41ba34cab4645269d43694b56f1bf1d, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:25.418300 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526be842-1bd0-4347-86f0-eae65c570504 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:25.432517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1024/2020] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:37:25 2022] PUT /identity/v3/projects/b201a2152c7f4e3ab46688cbb6a57506/users/e41ba34cab4645269d43694b56f1bf1d/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:25.445108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbdf64-fc04-4d12-b27b-1bac0ca4c027 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:25.445108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbdf64-fc04-4d12-b27b-1bac0ca4c027 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:25.445108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbdf64-fc04-4d12-b27b-1bac0ca4c027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:25.474493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-fefbdf64-fc04-4d12-b27b-1bac0ca4c027 None None] MFA Rules not processed for user `e41ba34cab4645269d43694b56f1bf1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:25.476074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-fefbdf64-fc04-4d12-b27b-1bac0ca4c027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:25.545191 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:25.557763 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 997/2021] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:25.562336 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526be842-1bd0-4347-86f0-eae65c570504 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:25.625782 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:25.643409 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526be842-1bd0-4347-86f0-eae65c570504 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:25.650100 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ebe37-f088-425d-8345-be433e1cc33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:25.651784 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ebe37-f088-425d-8345-be433e1cc33f admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:25.652282 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ebe37-f088-425d-8345-be433e1cc33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:25.652553 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ebe37-f088-425d-8345-be433e1cc33f admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:25.653400 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ebe37-f088-425d-8345-be433e1cc33f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:25.655691 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15ebe37-f088-425d-8345-be433e1cc33f admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:25.663526 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbdf64-fc04-4d12-b27b-1bac0ca4c027 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:25.665215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-fefbdf64-fc04-4d12-b27b-1bac0ca4c027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:25.707878 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbdf64-fc04-4d12-b27b-1bac0ca4c027 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:25.716957 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1025/2022] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:37:25 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:25.716957 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ebe37-f088-425d-8345-be433e1cc33f admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:25.718230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2edbf8a-d16d-4db0-9789-8bad075c2199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:25.718859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a15ebe37-f088-425d-8345-be433e1cc33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:25.719279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edbf8a-d16d-4db0-9789-8bad075c2199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:25.719652 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edbf8a-d16d-4db0-9789-8bad075c2199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:25.720053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2edbf8a-d16d-4db0-9789-8bad075c2199 admin admin] PATH_INFO: `/v3/projects/93acd46ba77d4072b79da1b6b1fb0b29` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:25.721368 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2edbf8a-d16d-4db0-9789-8bad075c2199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93acd46ba77d4072b79da1b6b1fb0b29)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:25.725008 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2edbf8a-d16d-4db0-9789-8bad075c2199 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:25.783036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d2edbf8a-d16d-4db0-9789-8bad075c2199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93acd46ba77d4072b79da1b6b1fb0b29', 'request_id': 'req-d2edbf8a-d16d-4db0-9789-8bad075c2199'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:25.789648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d2edbf8a-d16d-4db0-9789-8bad075c2199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93acd46ba77d4072b79da1b6b1fb0b29', 'request_id': 'req-d2edbf8a-d16d-4db0-9789-8bad075c2199'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:25.799199 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d2edbf8a-d16d-4db0-9789-8bad075c2199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93acd46ba77d4072b79da1b6b1fb0b29', 'request_id': 'req-d2edbf8a-d16d-4db0-9789-8bad075c2199'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:25.800122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ebe37-f088-425d-8345-be433e1cc33f admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:25.813910 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d2edbf8a-d16d-4db0-9789-8bad075c2199 admin admin] The token cache is being invalidate because project 93acd46ba77d4072b79da1b6b1fb0b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:25.814185 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d2edbf8a-d16d-4db0-9789-8bad075c2199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:25.814827 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d2edbf8a-d16d-4db0-9789-8bad075c2199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:25.816373 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 998/2023] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:25 2022] DELETE /identity/v3/projects/93acd46ba77d4072b79da1b6b1fb0b29 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:37:25.819887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2edbf8a-d16d-4db0-9789-8bad075c2199 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:25.821358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d2edbf8a-d16d-4db0-9789-8bad075c2199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:25.878674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74573cb-fb46-4756-81ca-4e57ca19348d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:25.879855 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74573cb-fb46-4756-81ca-4e57ca19348d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:25.880134 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74573cb-fb46-4756-81ca-4e57ca19348d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:25.880405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74573cb-fb46-4756-81ca-4e57ca19348d admin admin] PATH_INFO: `/v3/users/59067a5e17f64ea4ba2c09302775622d` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:25.882911 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74573cb-fb46-4756-81ca-4e57ca19348d admin admin] RBAC: Authorizing `identity:delete_user(user_id=59067a5e17f64ea4ba2c09302775622d)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:25.886994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74573cb-fb46-4756-81ca-4e57ca19348d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:25.904775 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2edbf8a-d16d-4db0-9789-8bad075c2199 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:25.911233 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751b45a-d4e5-4c91-aca4-db542c707cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:25.911866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751b45a-d4e5-4c91-aca4-db542c707cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:25.912146 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751b45a-d4e5-4c91-aca4-db542c707cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:25.912419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751b45a-d4e5-4c91-aca4-db542c707cb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:25.913057 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751b45a-d4e5-4c91-aca4-db542c707cb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:25.915046 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751b45a-d4e5-4c91-aca4-db542c707cb1 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:25.942528 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 999/2024] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:37:25 2022] POST /identity/v3/users => generated 299 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:25.944138 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751b45a-d4e5-4c91-aca4-db542c707cb1 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:25.946991 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-3751b45a-d4e5-4c91-aca4-db542c707cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:25.956261 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b74573cb-fb46-4756-81ca-4e57ca19348d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59067a5e17f64ea4ba2c09302775622d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:25.957238 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b74573cb-fb46-4756-81ca-4e57ca19348d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59067a5e17f64ea4ba2c09302775622d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:25.964891 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751b45a-d4e5-4c91-aca4-db542c707cb1 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:25.965821 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b74573cb-fb46-4756-81ca-4e57ca19348d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59067a5e17f64ea4ba2c09302775622d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:25.971145 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49557f82-fd89-40c9-b6c0-53025dd3562f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:25.972091 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49557f82-fd89-40c9-b6c0-53025dd3562f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:25.972570 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49557f82-fd89-40c9-b6c0-53025dd3562f admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:25.972922 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49557f82-fd89-40c9-b6c0-53025dd3562f admin admin] PATH_INFO: `/v3/users/a5aedb25cd3240dbb0662d8ef8390d18` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:25.974184 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49557f82-fd89-40c9-b6c0-53025dd3562f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5aedb25cd3240dbb0662d8ef8390d18)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:25.976693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49557f82-fd89-40c9-b6c0-53025dd3562f admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:25.983121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b74573cb-fb46-4756-81ca-4e57ca19348d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59067a5e17f64ea4ba2c09302775622d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:25.983862 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b74573cb-fb46-4756-81ca-4e57ca19348d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59067a5e17f64ea4ba2c09302775622d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:25.994230 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:25.998925 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1026/2025] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:37:25 2022] DELETE /identity/v3/users/59067a5e17f64ea4ba2c09302775622d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:26.000439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74573cb-fb46-4756-81ca-4e57ca19348d admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:26.002640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b74573cb-fb46-4756-81ca-4e57ca19348d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:26.043083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-49557f82-fd89-40c9-b6c0-53025dd3562f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5aedb25cd3240dbb0662d8ef8390d18'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:26.043838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-49557f82-fd89-40c9-b6c0-53025dd3562f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5aedb25cd3240dbb0662d8ef8390d18'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:26.051689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-49557f82-fd89-40c9-b6c0-53025dd3562f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5aedb25cd3240dbb0662d8ef8390d18'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:26.058603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=81,keystone:DELETE=15,keystone:INSERT=4 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:26.067216 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-49557f82-fd89-40c9-b6c0-53025dd3562f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5aedb25cd3240dbb0662d8ef8390d18'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:26.068104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-49557f82-fd89-40c9-b6c0-53025dd3562f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5aedb25cd3240dbb0662d8ef8390d18'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:26.077011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74573cb-fb46-4756-81ca-4e57ca19348d admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:26.080915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1000/2026] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:37:25 2022] DELETE /identity/v3/users/a5aedb25cd3240dbb0662d8ef8390d18 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:26.081662 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6f7b3-7ed9-4e00-9f96-89ee6e2aa9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:26.082145 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8e229-52e2-49eb-9da6-c16f1dd479d0 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:26.082246 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6f7b3-7ed9-4e00-9f96-89ee6e2aa9a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:26.082430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8e229-52e2-49eb-9da6-c16f1dd479d0 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:26.082517 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6f7b3-7ed9-4e00-9f96-89ee6e2aa9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:26.082704 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8e229-52e2-49eb-9da6-c16f1dd479d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:26.082801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6f7b3-7ed9-4e00-9f96-89ee6e2aa9a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:26.083640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6f7b3-7ed9-4e00-9f96-89ee6e2aa9a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:26.085266 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6f7b3-7ed9-4e00-9f96-89ee6e2aa9a0 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:26.106450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1027/2027] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:26.107546 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6f7b3-7ed9-4e00-9f96-89ee6e2aa9a0 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:26.108289 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-cdf8e229-52e2-49eb-9da6-c16f1dd479d0 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:26.109215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a5e6f7b3-7ed9-4e00-9f96-89ee6e2aa9a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:26.109650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-cdf8e229-52e2-49eb-9da6-c16f1dd479d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:26.122039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6f7b3-7ed9-4e00-9f96-89ee6e2aa9a0 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:26.187180 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1001/2028] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:26.211029 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8e229-52e2-49eb-9da6-c16f1dd479d0 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:26.215069 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-cdf8e229-52e2-49eb-9da6-c16f1dd479d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:26.221038 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fcfd2-3864-473e-bf51-96c747b4c5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:26.221861 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fcfd2-3864-473e-bf51-96c747b4c5b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:26.222180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fcfd2-3864-473e-bf51-96c747b4c5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:26.222461 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fcfd2-3864-473e-bf51-96c747b4c5b1 admin admin] PATH_INFO: `/v3/projects/3fab155b2b384fd6baa225d204977208/users/c5a57f5922a543ca9c3a791bf4eef92d/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:26.239127 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fcfd2-3864-473e-bf51-96c747b4c5b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fab155b2b384fd6baa225d204977208, user_id=c5a57f5922a543ca9c3a791bf4eef92d, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:26.242879 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fcfd2-3864-473e-bf51-96c747b4c5b1 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:26.259328 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1028/2029] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:37:26 2022] PUT /identity/v3/projects/3fab155b2b384fd6baa225d204977208/users/c5a57f5922a543ca9c3a791bf4eef92d/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:37:26.266040 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fcfd2-3864-473e-bf51-96c747b4c5b1 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:26.313344 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8e229-52e2-49eb-9da6-c16f1dd479d0 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:26.348974 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fcfd2-3864-473e-bf51-96c747b4c5b1 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:26.355569 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9554ae-b941-4f5b-8adb-8a2e3cb75488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:26.356185 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9554ae-b941-4f5b-8adb-8a2e3cb75488 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:26.356467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9554ae-b941-4f5b-8adb-8a2e3cb75488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:26.356744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9554ae-b941-4f5b-8adb-8a2e3cb75488 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:26.357391 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9554ae-b941-4f5b-8adb-8a2e3cb75488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:26.359295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9554ae-b941-4f5b-8adb-8a2e3cb75488 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:26.375110 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1029/2030] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:26.375305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993f0df-e573-48bb-a7e3-dd2ba4734e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:26.375305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993f0df-e573-48bb-a7e3-dd2ba4734e62 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:26.375305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993f0df-e573-48bb-a7e3-dd2ba4734e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:26.375305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993f0df-e573-48bb-a7e3-dd2ba4734e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:26.384618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9554ae-b941-4f5b-8adb-8a2e3cb75488 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:26.391460 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993f0df-e573-48bb-a7e3-dd2ba4734e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:26.393097 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993f0df-e573-48bb-a7e3-dd2ba4734e62 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:26.401829 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9554ae-b941-4f5b-8adb-8a2e3cb75488 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:26.403624 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1002/2031] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:26.407461 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f206585-3262-4f83-9b34-c7ba6e02e741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:26.408387 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f206585-3262-4f83-9b34-c7ba6e02e741 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:26.408741 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f206585-3262-4f83-9b34-c7ba6e02e741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:26.409052 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f206585-3262-4f83-9b34-c7ba6e02e741 admin admin] PATH_INFO: `/v3/projects/3fab155b2b384fd6baa225d204977208/users/c5a57f5922a543ca9c3a791bf4eef92d/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:26.413887 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f206585-3262-4f83-9b34-c7ba6e02e741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fab155b2b384fd6baa225d204977208, user_id=c5a57f5922a543ca9c3a791bf4eef92d, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:26.419506 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993f0df-e573-48bb-a7e3-dd2ba4734e62 service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:26.421260 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f206585-3262-4f83-9b34-c7ba6e02e741 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:26.424619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6993f0df-e573-48bb-a7e3-dd2ba4734e62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:26.438318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1030/2032] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:37:26 2022] PUT /identity/v3/projects/3fab155b2b384fd6baa225d204977208/users/c5a57f5922a543ca9c3a791bf4eef92d/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:26.441232 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993f0df-e573-48bb-a7e3-dd2ba4734e62 service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:26.451812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a0dab-4ae5-40f9-a3fe-d168cd00daaf None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:26.452242 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a0dab-4ae5-40f9-a3fe-d168cd00daaf None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:26.452620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7a0dab-4ae5-40f9-a3fe-d168cd00daaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:26.466586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:26.498726 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-fd7a0dab-4ae5-40f9-a3fe-d168cd00daaf None None] MFA Rules not processed for user `c5a57f5922a543ca9c3a791bf4eef92d`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:26.500155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-fd7a0dab-4ae5-40f9-a3fe-d168cd00daaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:26.501970 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:26.527121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:26.528277 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:26.528556 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:26.528922 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253 admin admin] PATH_INFO: `/v3/projects/97463e0d89ac4c4d9ecba36eb6ed386b` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:26.530648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97463e0d89ac4c4d9ecba36eb6ed386b)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:26.533576 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:26.584066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1031/2033] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:26.592712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97463e0d89ac4c4d9ecba36eb6ed386b', 'request_id': 'req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:26.600665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97463e0d89ac4c4d9ecba36eb6ed386b', 'request_id': 'req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:26.615198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a0dab-4ae5-40f9-a3fe-d168cd00daaf None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:26.615775 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97463e0d89ac4c4d9ecba36eb6ed386b', 'request_id': 'req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:26.617012 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-fd7a0dab-4ae5-40f9-a3fe-d168cd00daaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:26.635773 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253 admin admin] The token cache is being invalidate because project 97463e0d89ac4c4d9ecba36eb6ed386b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:26.636156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:26.636974 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:26.638716 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1003/2034] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:26 2022] DELETE /identity/v3/projects/97463e0d89ac4c4d9ecba36eb6ed386b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:37:26.643288 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:26.645335 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:26.701852 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7a0dab-4ae5-40f9-a3fe-d168cd00daaf None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:26.736918 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c97c1c-f586-4ddd-84fa-43fe78c8a253 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:26.745038 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112451b-8ae5-467a-b43c-a56db4e2099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:26.745817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112451b-8ae5-467a-b43c-a56db4e2099d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:26.746396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112451b-8ae5-467a-b43c-a56db4e2099d admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:26.746676 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112451b-8ae5-467a-b43c-a56db4e2099d admin admin] PATH_INFO: `/v3/users/b0d73347f7294c6abe9dd0e431bb3033` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:26.747951 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112451b-8ae5-467a-b43c-a56db4e2099d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d73347f7294c6abe9dd0e431bb3033)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:26.751531 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112451b-8ae5-467a-b43c-a56db4e2099d admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:26.793930 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b8655-98c0-4aa5-af28-c3745b2144ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:26.795552 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b8655-98c0-4aa5-af28-c3745b2144ad service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:26.795958 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b8655-98c0-4aa5-af28-c3745b2144ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:26.796276 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b8655-98c0-4aa5-af28-c3745b2144ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:26.798425 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-217b8655-98c0-4aa5-af28-c3745b2144ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:26.826421 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7112451b-8ae5-467a-b43c-a56db4e2099d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d73347f7294c6abe9dd0e431bb3033'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:26.827147 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7112451b-8ae5-467a-b43c-a56db4e2099d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d73347f7294c6abe9dd0e431bb3033'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:26.841451 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7112451b-8ae5-467a-b43c-a56db4e2099d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d73347f7294c6abe9dd0e431bb3033'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:26.858386 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:26.861315 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7112451b-8ae5-467a-b43c-a56db4e2099d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d73347f7294c6abe9dd0e431bb3033'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:26.862621 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-7112451b-8ae5-467a-b43c-a56db4e2099d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d73347f7294c6abe9dd0e431bb3033'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:26.899002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1004/2035] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:37:26 2022] DELETE /identity/v3/users/b0d73347f7294c6abe9dd0e431bb3033 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:26.900373 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112451b-8ae5-467a-b43c-a56db4e2099d admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:26.903115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7112451b-8ae5-467a-b43c-a56db4e2099d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:26.912808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b8655-98c0-4aa5-af28-c3745b2144ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:26.914625 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b8655-98c0-4aa5-af28-c3745b2144ad service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:26.919787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:26.931788 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1032/2036] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:27.010788 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112451b-8ae5-467a-b43c-a56db4e2099d admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:27.021706 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff54fc-f95b-4060-ab6a-1aa4565603c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:27.022968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff54fc-f95b-4060-ab6a-1aa4565603c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:27.023269 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff54fc-f95b-4060-ab6a-1aa4565603c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:27.023620 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff54fc-f95b-4060-ab6a-1aa4565603c9 admin admin] PATH_INFO: `/v3/projects/1ae31943d4714073bb52e182182f3873` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:27.024989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff54fc-f95b-4060-ab6a-1aa4565603c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ae31943d4714073bb52e182182f3873)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:27.027211 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff54fc-f95b-4060-ab6a-1aa4565603c9 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:27.086680 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-cfff54fc-f95b-4060-ab6a-1aa4565603c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae31943d4714073bb52e182182f3873', 'request_id': 'req-cfff54fc-f95b-4060-ab6a-1aa4565603c9'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:27.096223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-cfff54fc-f95b-4060-ab6a-1aa4565603c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae31943d4714073bb52e182182f3873', 'request_id': 'req-cfff54fc-f95b-4060-ab6a-1aa4565603c9'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:27.107677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-cfff54fc-f95b-4060-ab6a-1aa4565603c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae31943d4714073bb52e182182f3873', 'request_id': 'req-cfff54fc-f95b-4060-ab6a-1aa4565603c9'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:27.126568 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-cfff54fc-f95b-4060-ab6a-1aa4565603c9 admin admin] The token cache is being invalidate because project 1ae31943d4714073bb52e182182f3873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:27.127251 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-cfff54fc-f95b-4060-ab6a-1aa4565603c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:27.128161 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-cfff54fc-f95b-4060-ab6a-1aa4565603c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:27.130277 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1005/2037] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:26 2022] DELETE /identity/v3/projects/1ae31943d4714073bb52e182182f3873 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:27.388065 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b8655-98c0-4aa5-af28-c3745b2144ad service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:27.398829 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b8655-98c0-4aa5-af28-c3745b2144ad service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:27.471929 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f85b60-ff13-4255-a34d-baa894c5326b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:27.472567 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f85b60-ff13-4255-a34d-baa894c5326b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:27.472844 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f85b60-ff13-4255-a34d-baa894c5326b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:27.473117 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f85b60-ff13-4255-a34d-baa894c5326b admin admin] PATH_INFO: `/v3/projects/a74ec7a38f2d4096bb368e469bb4631e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:27.474259 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f85b60-ff13-4255-a34d-baa894c5326b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74ec7a38f2d4096bb368e469bb4631e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:27.476260 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f85b60-ff13-4255-a34d-baa894c5326b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:27.524122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f0f85b60-ff13-4255-a34d-baa894c5326b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74ec7a38f2d4096bb368e469bb4631e', 'request_id': 'req-f0f85b60-ff13-4255-a34d-baa894c5326b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:27.532397 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f0f85b60-ff13-4255-a34d-baa894c5326b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74ec7a38f2d4096bb368e469bb4631e', 'request_id': 'req-f0f85b60-ff13-4255-a34d-baa894c5326b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:27.538617 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f0f85b60-ff13-4255-a34d-baa894c5326b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74ec7a38f2d4096bb368e469bb4631e', 'request_id': 'req-f0f85b60-ff13-4255-a34d-baa894c5326b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:27.549302 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f0f85b60-ff13-4255-a34d-baa894c5326b admin admin] The token cache is being invalidate because project a74ec7a38f2d4096bb368e469bb4631e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:27.549591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f0f85b60-ff13-4255-a34d-baa894c5326b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:27.550206 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f0f85b60-ff13-4255-a34d-baa894c5326b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:27.551779 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1033/2038] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:27 2022] DELETE /identity/v3/projects/a74ec7a38f2d4096bb368e469bb4631e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:27.556790 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5602c-bc76-45e9-b319-8b0355333c87 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:27.557458 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5602c-bc76-45e9-b319-8b0355333c87 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:27.557458 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5602c-bc76-45e9-b319-8b0355333c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:27.577644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-03a5602c-bc76-45e9-b319-8b0355333c87 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:27.578856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-03a5602c-bc76-45e9-b319-8b0355333c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:27.638783 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1006/2039] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:27.646672 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f33397-77c9-4b07-90d8-10f688749db8 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:27.647238 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f33397-77c9-4b07-90d8-10f688749db8 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:27.647238 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f33397-77c9-4b07-90d8-10f688749db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:27.668590 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-16f33397-77c9-4b07-90d8-10f688749db8 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:27.669786 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-16f33397-77c9-4b07-90d8-10f688749db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:27.677691 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1034/2040] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:27.682482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5602c-bc76-45e9-b319-8b0355333c87 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:27.692982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5602c-bc76-45e9-b319-8b0355333c87 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:27.697639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e60279-3b79-4264-a5e6-f8114951a2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:27.698239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60279-3b79-4264-a5e6-f8114951a2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:27.698543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60279-3b79-4264-a5e6-f8114951a2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:27.698813 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e60279-3b79-4264-a5e6-f8114951a2b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:27.699485 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e60279-3b79-4264-a5e6-f8114951a2b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:37:27.699788 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e60279-3b79-4264-a5e6-f8114951a2b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:27.701372 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e60279-3b79-4264-a5e6-f8114951a2b1 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:27.712928 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1007/2041] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:37:27.718188 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f33397-77c9-4b07-90d8-10f688749db8 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:27.727204 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f33397-77c9-4b07-90d8-10f688749db8 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:27.732417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c751e2-8438-4915-bcaa-35f192bffe1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:27.733005 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c751e2-8438-4915-bcaa-35f192bffe1a admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:27.733306 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c751e2-8438-4915-bcaa-35f192bffe1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:27.733568 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c751e2-8438-4915-bcaa-35f192bffe1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:27.734196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c751e2-8438-4915-bcaa-35f192bffe1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:27.736295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c751e2-8438-4915-bcaa-35f192bffe1a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:27.767498 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1035/2042] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:37:27 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:27.771998 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e60279-3b79-4264-a5e6-f8114951a2b1 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:27.782035 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e60279-3b79-4264-a5e6-f8114951a2b1 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:27.785665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:27.842044 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619eb09-0e1e-4a3a-a411-5dae011e72c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:27.842656 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619eb09-0e1e-4a3a-a411-5dae011e72c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:27.842936 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619eb09-0e1e-4a3a-a411-5dae011e72c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:27.843240 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619eb09-0e1e-4a3a-a411-5dae011e72c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:27.843885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619eb09-0e1e-4a3a-a411-5dae011e72c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:27.845793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619eb09-0e1e-4a3a-a411-5dae011e72c2 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:27.868364 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1008/2043] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:37:27 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:37:27.877313 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c751e2-8438-4915-bcaa-35f192bffe1a admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:27.887918 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c751e2-8438-4915-bcaa-35f192bffe1a admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:27.892610 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c67afa-e50a-431d-8b4c-c71bc8131727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:27.893151 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c67afa-e50a-431d-8b4c-c71bc8131727 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:27.893429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c67afa-e50a-431d-8b4c-c71bc8131727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:27.893698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c67afa-e50a-431d-8b4c-c71bc8131727 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:27.894333 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c67afa-e50a-431d-8b4c-c71bc8131727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:27.895956 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c67afa-e50a-431d-8b4c-c71bc8131727 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:27.906468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1036/2044] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:37:27.910470 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619eb09-0e1e-4a3a-a411-5dae011e72c2 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:27.920908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619eb09-0e1e-4a3a-a411-5dae011e72c2 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:27.925740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9535a-5a07-49aa-b4b8-0dde7789a89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:27.926357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9535a-5a07-49aa-b4b8-0dde7789a89e admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:27.926708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9535a-5a07-49aa-b4b8-0dde7789a89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:27.927002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9535a-5a07-49aa-b4b8-0dde7789a89e admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:27.927693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9535a-5a07-49aa-b4b8-0dde7789a89e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:27.929401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9535a-5a07-49aa-b4b8-0dde7789a89e admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:27.941584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1009/2045] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:27.945767 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c67afa-e50a-431d-8b4c-c71bc8131727 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:27.955869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c67afa-e50a-431d-8b4c-c71bc8131727 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:27.960395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f90365-0cf9-4d95-a83e-f34cbd023731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:27.961094 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f90365-0cf9-4d95-a83e-f34cbd023731 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:27.961298 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f90365-0cf9-4d95-a83e-f34cbd023731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:27.961602 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f90365-0cf9-4d95-a83e-f34cbd023731 admin admin] PATH_INFO: `/v3/projects/08a96a5efb65404399abe261ce6bbda2/users/98f913ee9623467fbeafd39b15b211e2/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:27.976864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f90365-0cf9-4d95-a83e-f34cbd023731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08a96a5efb65404399abe261ce6bbda2, user_id=98f913ee9623467fbeafd39b15b211e2, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:27.982396 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f90365-0cf9-4d95-a83e-f34cbd023731 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:27.993970 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1037/2046] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:37:27 2022] PUT /identity/v3/projects/08a96a5efb65404399abe261ce6bbda2/users/98f913ee9623467fbeafd39b15b211e2/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:28.064975 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492d43b-f4ce-497c-9585-15df8bc13e79 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:28.065264 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492d43b-f4ce-497c-9585-15df8bc13e79 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:28.065534 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492d43b-f4ce-497c-9585-15df8bc13e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:28.096789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-6492d43b-f4ce-497c-9585-15df8bc13e79 None None] MFA Rules not processed for user `98f913ee9623467fbeafd39b15b211e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:28.098048 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6492d43b-f4ce-497c-9585-15df8bc13e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:28.178338 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1010/2047] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:28.190048 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f90365-0cf9-4d95-a83e-f34cbd023731 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:28.191839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-87f90365-0cf9-4d95-a83e-f34cbd023731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:28.221323 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:28.287863 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f90365-0cf9-4d95-a83e-f34cbd023731 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:28.292660 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8664527a-060d-4579-a84b-13a09f11d487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:28.293390 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664527a-060d-4579-a84b-13a09f11d487 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:28.293633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664527a-060d-4579-a84b-13a09f11d487 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:28.293902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8664527a-060d-4579-a84b-13a09f11d487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:28.303474 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664527a-060d-4579-a84b-13a09f11d487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:28.305223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8664527a-060d-4579-a84b-13a09f11d487 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:28.314307 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1038/2048] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:28.340834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492d43b-f4ce-497c-9585-15df8bc13e79 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:28.412404 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492d43b-f4ce-497c-9585-15df8bc13e79 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:28.418437 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31433f8-0eb0-42c5-81dc-3ac18e6946f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:28.419196 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31433f8-0eb0-42c5-81dc-3ac18e6946f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:28.419479 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31433f8-0eb0-42c5-81dc-3ac18e6946f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:28.419929 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31433f8-0eb0-42c5-81dc-3ac18e6946f0 admin admin] PATH_INFO: `/v3/users/98f913ee9623467fbeafd39b15b211e2` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:28.421406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31433f8-0eb0-42c5-81dc-3ac18e6946f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f913ee9623467fbeafd39b15b211e2)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:28.423627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31433f8-0eb0-42c5-81dc-3ac18e6946f0 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:28.442501 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:28.485143 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f31433f8-0eb0-42c5-81dc-3ac18e6946f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f913ee9623467fbeafd39b15b211e2'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:28.486192 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f31433f8-0eb0-42c5-81dc-3ac18e6946f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f913ee9623467fbeafd39b15b211e2'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:28.501367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f31433f8-0eb0-42c5-81dc-3ac18e6946f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f913ee9623467fbeafd39b15b211e2'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:28.515633 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f31433f8-0eb0-42c5-81dc-3ac18e6946f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f913ee9623467fbeafd39b15b211e2'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:28.516366 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-f31433f8-0eb0-42c5-81dc-3ac18e6946f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f913ee9623467fbeafd39b15b211e2'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:28.538921 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1011/2049] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:37:28 2022] DELETE /identity/v3/users/98f913ee9623467fbeafd39b15b211e2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:28.545269 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645019f6-7f2c-474e-916e-a726497c2a53 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:28.545561 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645019f6-7f2c-474e-916e-a726497c2a53 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:28.546028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645019f6-7f2c-474e-916e-a726497c2a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:28.577828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-645019f6-7f2c-474e-916e-a726497c2a53 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:28.579060 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-645019f6-7f2c-474e-916e-a726497c2a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:28.644184 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31433f8-0eb0-42c5-81dc-3ac18e6946f0 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:28.645784 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-f31433f8-0eb0-42c5-81dc-3ac18e6946f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:28.663470 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1039/2050] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:28.674090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645019f6-7f2c-474e-916e-a726497c2a53 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:28.675562 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-645019f6-7f2c-474e-916e-a726497c2a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:28.719980 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31433f8-0eb0-42c5-81dc-3ac18e6946f0 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:28.729807 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25531611-bf71-4586-8cd4-eaafdd90aba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:28.730431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25531611-bf71-4586-8cd4-eaafdd90aba8 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:28.730709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25531611-bf71-4586-8cd4-eaafdd90aba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:28.731001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25531611-bf71-4586-8cd4-eaafdd90aba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:28.733429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-25531611-bf71-4586-8cd4-eaafdd90aba8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:28.746995 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645019f6-7f2c-474e-916e-a726497c2a53 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:28.750987 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac3c06-72ac-40e0-860e-fbb015fdc5b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:28.751605 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac3c06-72ac-40e0-860e-fbb015fdc5b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:28.751887 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac3c06-72ac-40e0-860e-fbb015fdc5b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:28.752160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac3c06-72ac-40e0-860e-fbb015fdc5b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:28.763495 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac3c06-72ac-40e0-860e-fbb015fdc5b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:28.764936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac3c06-72ac-40e0-860e-fbb015fdc5b7 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:28.776649 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1040/2051] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:37:28.811726 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25531611-bf71-4586-8cd4-eaafdd90aba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:28.814049 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25531611-bf71-4586-8cd4-eaafdd90aba8 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:28.828488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1012/2052] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:37:29.139298 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac3c06-72ac-40e0-860e-fbb015fdc5b7 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:29.140732 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b4ac3c06-72ac-40e0-860e-fbb015fdc5b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:29.159884 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac3c06-72ac-40e0-860e-fbb015fdc5b7 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:29.164843 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:29.165674 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:29.166016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:29.166322 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58 admin admin] PATH_INFO: `/v3/projects/08a96a5efb65404399abe261ce6bbda2` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:29.167568 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08a96a5efb65404399abe261ce6bbda2)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:29.169713 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:29.220001 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08a96a5efb65404399abe261ce6bbda2', 'request_id': 'req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:29.233285 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08a96a5efb65404399abe261ce6bbda2', 'request_id': 'req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:29.235824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08a96a5efb65404399abe261ce6bbda2', 'request_id': 'req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:29.240229 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:29.251006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58 admin admin] The token cache is being invalidate because project 08a96a5efb65404399abe261ce6bbda2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:29.251341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:29.252390 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:29.254006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1041/2053] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:29 2022] DELETE /identity/v3/projects/08a96a5efb65404399abe261ce6bbda2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:37:29.572074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25531611-bf71-4586-8cd4-eaafdd90aba8 service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:29.574331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-25531611-bf71-4586-8cd4-eaafdd90aba8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:29.588477 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25531611-bf71-4586-8cd4-eaafdd90aba8 service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:29.638904 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:29.644107 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54d3f7-f550-49fe-853b-a8b9d639ef0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:29.644889 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d3f7-f550-49fe-853b-a8b9d639ef0b service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:29.645438 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d3f7-f550-49fe-853b-a8b9d639ef0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:29.645590 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54d3f7-f550-49fe-853b-a8b9d639ef0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:29.648352 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-fa54d3f7-f550-49fe-853b-a8b9d639ef0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:29.711927 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54d3f7-f550-49fe-853b-a8b9d639ef0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:29.713837 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54d3f7-f550-49fe-853b-a8b9d639ef0b service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:29.724323 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1013/2054] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:33.618449 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:33.619850 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:33.684729 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d4a1e-fdd7-420c-ba4d-bae20d6f8a58 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:33.689270 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005de7c-6979-42e7-a00f-a940a19aaaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:33.689892 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005de7c-6979-42e7-a00f-a940a19aaaeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:33.690167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005de7c-6979-42e7-a00f-a940a19aaaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:33.690437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d005de7c-6979-42e7-a00f-a940a19aaaeb admin admin] PATH_INFO: `/v3/users/136c682beb26448690e26e8b71d7793c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:33.691550 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005de7c-6979-42e7-a00f-a940a19aaaeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=136c682beb26448690e26e8b71d7793c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:33.693438 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d005de7c-6979-42e7-a00f-a940a19aaaeb admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:33.738380 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d005de7c-6979-42e7-a00f-a940a19aaaeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136c682beb26448690e26e8b71d7793c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:33.739219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d005de7c-6979-42e7-a00f-a940a19aaaeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136c682beb26448690e26e8b71d7793c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:33.746620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d005de7c-6979-42e7-a00f-a940a19aaaeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136c682beb26448690e26e8b71d7793c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:33.758236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d005de7c-6979-42e7-a00f-a940a19aaaeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136c682beb26448690e26e8b71d7793c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:33.758933 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d005de7c-6979-42e7-a00f-a940a19aaaeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136c682beb26448690e26e8b71d7793c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:33.772974 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1042/2055] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:37:33 2022] DELETE /identity/v3/users/136c682beb26448690e26e8b71d7793c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:33.778248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ecdbb-d462-4de4-ba5f-95220080cf92 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:33.778762 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ecdbb-d462-4de4-ba5f-95220080cf92 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:33.778852 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ecdbb-d462-4de4-ba5f-95220080cf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:33.799103 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-369ecdbb-d462-4de4-ba5f-95220080cf92 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:33.800317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-369ecdbb-d462-4de4-ba5f-95220080cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:33.861234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1014/2056] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:37:33.872321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005de7c-6979-42e7-a00f-a940a19aaaeb admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:33.873770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d005de7c-6979-42e7-a00f-a940a19aaaeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:33.932482 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d005de7c-6979-42e7-a00f-a940a19aaaeb admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:33.936630 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663450b-bc44-4939-9684-453bd3f4a3eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:33.937226 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663450b-bc44-4939-9684-453bd3f4a3eb service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:33.937505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663450b-bc44-4939-9684-453bd3f4a3eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:33.937774 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9663450b-bc44-4939-9684-453bd3f4a3eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:33.947300 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663450b-bc44-4939-9684-453bd3f4a3eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:33.948811 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9663450b-bc44-4939-9684-453bd3f4a3eb service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:33.958032 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1043/2057] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:34.236607 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ecdbb-d462-4de4-ba5f-95220080cf92 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:34.238204 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-369ecdbb-d462-4de4-ba5f-95220080cf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:34.271032 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ecdbb-d462-4de4-ba5f-95220080cf92 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:34.275743 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:34.278040 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:34.278376 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:34.278719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0 admin admin] PATH_INFO: `/v3/projects/9ca3922325c44b7a835df8c232373237` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:34.280006 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca3922325c44b7a835df8c232373237)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:34.282114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:34.342644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca3922325c44b7a835df8c232373237', 'request_id': 'req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:34.350099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca3922325c44b7a835df8c232373237', 'request_id': 'req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:34.360661 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca3922325c44b7a835df8c232373237', 'request_id': 'req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:34.376399 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0 admin admin] The token cache is being invalidate because project 9ca3922325c44b7a835df8c232373237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:34.377362 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:34.378872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:34.384965 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1015/2058] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:34 2022] DELETE /identity/v3/projects/9ca3922325c44b7a835df8c232373237 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:34.385761 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663450b-bc44-4939-9684-453bd3f4a3eb service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:34.397596 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9663450b-bc44-4939-9684-453bd3f4a3eb service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:34.413419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:34.464888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c8439-41a0-46cb-982d-34da01057abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:34.465527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c8439-41a0-46cb-982d-34da01057abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:34.465806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c8439-41a0-46cb-982d-34da01057abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:34.466081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c8439-41a0-46cb-982d-34da01057abb admin admin] PATH_INFO: `/v3/users/e41ba34cab4645269d43694b56f1bf1d` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:34.467270 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c8439-41a0-46cb-982d-34da01057abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41ba34cab4645269d43694b56f1bf1d)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:34.469295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c8439-41a0-46cb-982d-34da01057abb admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:34.520651 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6b5c8439-41a0-46cb-982d-34da01057abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41ba34cab4645269d43694b56f1bf1d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:34.521975 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6b5c8439-41a0-46cb-982d-34da01057abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41ba34cab4645269d43694b56f1bf1d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:34.530357 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6b5c8439-41a0-46cb-982d-34da01057abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41ba34cab4645269d43694b56f1bf1d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:34.543309 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6b5c8439-41a0-46cb-982d-34da01057abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41ba34cab4645269d43694b56f1bf1d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:34.545920 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6b5c8439-41a0-46cb-982d-34da01057abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41ba34cab4645269d43694b56f1bf1d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:34.564635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1044/2059] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:37:34 2022] DELETE /identity/v3/users/e41ba34cab4645269d43694b56f1bf1d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:37:34.852439 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:34.853939 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:34.874877 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd3e1b-648b-4ced-89d4-d2f80e872ed0 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:34.894587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:34.936912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:34.937545 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:34.937824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:34.938094 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1 admin admin] PATH_INFO: `/v3/projects/b201a2152c7f4e3ab46688cbb6a57506` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:34.939217 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b201a2152c7f4e3ab46688cbb6a57506)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:34.941109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:34.988369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b201a2152c7f4e3ab46688cbb6a57506', 'request_id': 'req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:34.994480 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b201a2152c7f4e3ab46688cbb6a57506', 'request_id': 'req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:34.999977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b201a2152c7f4e3ab46688cbb6a57506', 'request_id': 'req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:35.012939 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1 admin admin] The token cache is being invalidate because project b201a2152c7f4e3ab46688cbb6a57506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:35.013232 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:35.013858 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:35.015375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1016/2060] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:34 2022] DELETE /identity/v3/projects/b201a2152c7f4e3ab46688cbb6a57506 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:35.019366 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c8439-41a0-46cb-982d-34da01057abb admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:35.020799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6b5c8439-41a0-46cb-982d-34da01057abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:35.033956 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c8439-41a0-46cb-982d-34da01057abb admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:35.090246 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af8649-30b0-4acb-ad2d-d993b2c55185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:35.090874 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af8649-30b0-4acb-ad2d-d993b2c55185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:35.091180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af8649-30b0-4acb-ad2d-d993b2c55185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:35.091455 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af8649-30b0-4acb-ad2d-d993b2c55185 admin admin] PATH_INFO: `/v3/users/c5a57f5922a543ca9c3a791bf4eef92d` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:35.092589 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af8649-30b0-4acb-ad2d-d993b2c55185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a57f5922a543ca9c3a791bf4eef92d)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:35.094543 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af8649-30b0-4acb-ad2d-d993b2c55185 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:35.132539 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:35.142267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-18af8649-30b0-4acb-ad2d-d993b2c55185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a57f5922a543ca9c3a791bf4eef92d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:35.143198 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-18af8649-30b0-4acb-ad2d-d993b2c55185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a57f5922a543ca9c3a791bf4eef92d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:35.150109 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-18af8649-30b0-4acb-ad2d-d993b2c55185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a57f5922a543ca9c3a791bf4eef92d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:35.162387 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-18af8649-30b0-4acb-ad2d-d993b2c55185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a57f5922a543ca9c3a791bf4eef92d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:35.163120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-18af8649-30b0-4acb-ad2d-d993b2c55185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a57f5922a543ca9c3a791bf4eef92d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:35.180896 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1045/2061] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:37:35 2022] DELETE /identity/v3/users/c5a57f5922a543ca9c3a791bf4eef92d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:35.451944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:35.453596 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:35.468843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b9e7e-7b3c-4c11-81e8-bfbab90e85b1 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:35.535428 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68600c48-b145-410a-bd43-2b0671b471b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:35.536188 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68600c48-b145-410a-bd43-2b0671b471b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:35.536531 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68600c48-b145-410a-bd43-2b0671b471b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:35.536815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68600c48-b145-410a-bd43-2b0671b471b8 admin admin] PATH_INFO: `/v3/projects/3fab155b2b384fd6baa225d204977208` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:35.537992 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68600c48-b145-410a-bd43-2b0671b471b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fab155b2b384fd6baa225d204977208)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:35.539968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68600c48-b145-410a-bd43-2b0671b471b8 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:35.587935 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-68600c48-b145-410a-bd43-2b0671b471b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fab155b2b384fd6baa225d204977208', 'request_id': 'req-68600c48-b145-410a-bd43-2b0671b471b8'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:35.594396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-68600c48-b145-410a-bd43-2b0671b471b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fab155b2b384fd6baa225d204977208', 'request_id': 'req-68600c48-b145-410a-bd43-2b0671b471b8'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:35.595822 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:35.603214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-68600c48-b145-410a-bd43-2b0671b471b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fab155b2b384fd6baa225d204977208', 'request_id': 'req-68600c48-b145-410a-bd43-2b0671b471b8'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:35.620619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-68600c48-b145-410a-bd43-2b0671b471b8 admin admin] The token cache is being invalidate because project 3fab155b2b384fd6baa225d204977208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:35.620950 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-68600c48-b145-410a-bd43-2b0671b471b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:35.621699 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-68600c48-b145-410a-bd43-2b0671b471b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:35.623609 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1017/2062] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:35 2022] DELETE /identity/v3/projects/3fab155b2b384fd6baa225d204977208 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:35.628331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93b41a-7e9d-455d-915a-fde73f73cb15 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:35.628613 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93b41a-7e9d-455d-915a-fde73f73cb15 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:35.628882 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93b41a-7e9d-455d-915a-fde73f73cb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:35.650186 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-6f93b41a-7e9d-455d-915a-fde73f73cb15 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:35.651934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6f93b41a-7e9d-455d-915a-fde73f73cb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:35.724850 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1046/2063] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:37:35.733305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31061e-83ad-4377-ac50-fdc7fcc7eda7 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:35.733917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31061e-83ad-4377-ac50-fdc7fcc7eda7 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:35.734414 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31061e-83ad-4377-ac50-fdc7fcc7eda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:35.756865 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-5c31061e-83ad-4377-ac50-fdc7fcc7eda7 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:35.761078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-5c31061e-83ad-4377-ac50-fdc7fcc7eda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:35.775023 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1018/2064] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:35.780411 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93b41a-7e9d-455d-915a-fde73f73cb15 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:35.791385 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93b41a-7e9d-455d-915a-fde73f73cb15 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:35.797043 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99edb7-71c0-446c-b4ce-efb64decf454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:35.798184 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99edb7-71c0-446c-b4ce-efb64decf454 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:35.798184 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99edb7-71c0-446c-b4ce-efb64decf454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:35.798376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99edb7-71c0-446c-b4ce-efb64decf454 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:35.799102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99edb7-71c0-446c-b4ce-efb64decf454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:37:35.799471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99edb7-71c0-446c-b4ce-efb64decf454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:35.801172 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99edb7-71c0-446c-b4ce-efb64decf454 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:35.817452 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1047/2065] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:37:35.822272 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31061e-83ad-4377-ac50-fdc7fcc7eda7 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:35.836838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c31061e-83ad-4377-ac50-fdc7fcc7eda7 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:35.842070 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1263837-ea2c-4048-bab9-2d34522f5166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:35.842686 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1263837-ea2c-4048-bab9-2d34522f5166 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:35.842987 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1263837-ea2c-4048-bab9-2d34522f5166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:35.843263 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1263837-ea2c-4048-bab9-2d34522f5166 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:35.843894 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1263837-ea2c-4048-bab9-2d34522f5166 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:35.845898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1263837-ea2c-4048-bab9-2d34522f5166 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:35.874109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1019/2066] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:37:35 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:35.878349 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99edb7-71c0-446c-b4ce-efb64decf454 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:35.888858 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99edb7-71c0-446c-b4ce-efb64decf454 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:35.945666 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e9189-293c-4e3b-a1a8-72436ff1e02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:35.946269 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e9189-293c-4e3b-a1a8-72436ff1e02b admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:35.946550 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e9189-293c-4e3b-a1a8-72436ff1e02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:35.946824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e9189-293c-4e3b-a1a8-72436ff1e02b admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:35.947498 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e9189-293c-4e3b-a1a8-72436ff1e02b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:35.949659 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e9189-293c-4e3b-a1a8-72436ff1e02b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:35.970673 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1048/2067] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:37:35 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:37:35.975171 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1263837-ea2c-4048-bab9-2d34522f5166 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:35.986344 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1263837-ea2c-4048-bab9-2d34522f5166 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:35.990885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda1f4d-7b52-4ddd-bfd7-5de5fdc07cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:35.991544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda1f4d-7b52-4ddd-bfd7-5de5fdc07cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:35.991829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda1f4d-7b52-4ddd-bfd7-5de5fdc07cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:35.992102 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda1f4d-7b52-4ddd-bfd7-5de5fdc07cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:35.992735 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda1f4d-7b52-4ddd-bfd7-5de5fdc07cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:35.994317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda1f4d-7b52-4ddd-bfd7-5de5fdc07cb6 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:36.004504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1020/2068] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:36.008540 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e9189-293c-4e3b-a1a8-72436ff1e02b admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:36.018646 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e9189-293c-4e3b-a1a8-72436ff1e02b admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:36.023216 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1d3570-811d-4209-98c5-39a325f7e74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:36.023802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d3570-811d-4209-98c5-39a325f7e74b admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:36.024077 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d3570-811d-4209-98c5-39a325f7e74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:36.024346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1d3570-811d-4209-98c5-39a325f7e74b admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:36.024974 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d3570-811d-4209-98c5-39a325f7e74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:36.027211 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1d3570-811d-4209-98c5-39a325f7e74b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:36.037603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1049/2069] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:37:36.041554 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda1f4d-7b52-4ddd-bfd7-5de5fdc07cb6 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:36.051801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda1f4d-7b52-4ddd-bfd7-5de5fdc07cb6 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:36.057249 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadde6d9-e98b-462f-88fe-31e0768f831c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:36.057905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadde6d9-e98b-462f-88fe-31e0768f831c admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:36.058232 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadde6d9-e98b-462f-88fe-31e0768f831c admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:36.058572 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadde6d9-e98b-462f-88fe-31e0768f831c admin admin] PATH_INFO: `/v3/projects/8725a99bef5e4ab0914fb1563d5feb92/users/86d435031c40469082c61107f634a43a/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:36.074810 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadde6d9-e98b-462f-88fe-31e0768f831c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8725a99bef5e4ab0914fb1563d5feb92, user_id=86d435031c40469082c61107f634a43a, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:36.077494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadde6d9-e98b-462f-88fe-31e0768f831c admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:36.090732 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1021/2070] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:37:36 2022] PUT /identity/v3/projects/8725a99bef5e4ab0914fb1563d5feb92/users/86d435031c40469082c61107f634a43a/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:36.095878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d992a-4168-42f7-933e-42f7826a5f6e None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:36.096183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d992a-4168-42f7-933e-42f7826a5f6e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:36.096480 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d992a-4168-42f7-933e-42f7826a5f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:36.115491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5b4d992a-4168-42f7-933e-42f7826a5f6e None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:36.116709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5b4d992a-4168-42f7-933e-42f7826a5f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:36.129753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:36.179552 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1050/2071] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:36.189978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadde6d9-e98b-462f-88fe-31e0768f831c admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:36.191732 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-aadde6d9-e98b-462f-88fe-31e0768f831c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:36.250990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadde6d9-e98b-462f-88fe-31e0768f831c admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:36.254723 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779043e1-a93a-44af-a8a2-56b49dfc754b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:36.255368 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779043e1-a93a-44af-a8a2-56b49dfc754b service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:36.255650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779043e1-a93a-44af-a8a2-56b49dfc754b service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:36.255924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779043e1-a93a-44af-a8a2-56b49dfc754b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:36.265280 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779043e1-a93a-44af-a8a2-56b49dfc754b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:36.266744 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779043e1-a93a-44af-a8a2-56b49dfc754b service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:36.276544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1022/2072] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:36.968960 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ff593-029e-4f30-81a0-c6271851e396 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:36.969239 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ff593-029e-4f30-81a0-c6271851e396 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:36.969510 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ff593-029e-4f30-81a0-c6271851e396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:37.013267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c73ff593-029e-4f30-81a0-c6271851e396 None None] MFA Rules not processed for user `86d435031c40469082c61107f634a43a`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:37.014576 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c73ff593-029e-4f30-81a0-c6271851e396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:37.119689 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1051/2073] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:37.132185 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779043e1-a93a-44af-a8a2-56b49dfc754b service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:37.133527 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-779043e1-a93a-44af-a8a2-56b49dfc754b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:37.205081 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779043e1-a93a-44af-a8a2-56b49dfc754b service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:37.211614 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4545e3b0-e75c-4b02-bd6d-f70357a0d9cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:37.212215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545e3b0-e75c-4b02-bd6d-f70357a0d9cf service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:37.212502 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545e3b0-e75c-4b02-bd6d-f70357a0d9cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:37.212914 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545e3b0-e75c-4b02-bd6d-f70357a0d9cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:37.224137 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545e3b0-e75c-4b02-bd6d-f70357a0d9cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:37.227075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4545e3b0-e75c-4b02-bd6d-f70357a0d9cf service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:37.240879 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1023/2074] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:38.751960 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164a963-8900-425a-9f64-895a5d61de10 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:38.752558 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164a963-8900-425a-9f64-895a5d61de10 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:38.752558 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164a963-8900-425a-9f64-895a5d61de10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:38.772632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d164a963-8900-425a-9f64-895a5d61de10 None None] MFA Rules not processed for user `86d435031c40469082c61107f634a43a`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:38.773842 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d164a963-8900-425a-9f64-895a5d61de10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:38.781577 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1052/2075] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:43.322103 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f9bb-d6fd-4cda-a327-ddf94a372df8 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:43.323052 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f9bb-d6fd-4cda-a327-ddf94a372df8 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:43.323426 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f9bb-d6fd-4cda-a327-ddf94a372df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:43.348995 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-fac1f9bb-d6fd-4cda-a327-ddf94a372df8 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:43.352750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-fac1f9bb-d6fd-4cda-a327-ddf94a372df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:43.364645 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1024/2076] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 20 13:37:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:43.379949 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164a963-8900-425a-9f64-895a5d61de10 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:43.381965 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d164a963-8900-425a-9f64-895a5d61de10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:43.517372 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164a963-8900-425a-9f64-895a5d61de10 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:43.523493 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd8d69-d344-4263-919d-ad50ac131ad2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:43.524183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd8d69-d344-4263-919d-ad50ac131ad2 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:43.524529 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd8d69-d344-4263-919d-ad50ac131ad2 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:43.524869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd8d69-d344-4263-919d-ad50ac131ad2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:43.535049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd8d69-d344-4263-919d-ad50ac131ad2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:43.536726 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd8d69-d344-4263-919d-ad50ac131ad2 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:43.549312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1053/2077] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:44.876500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f212f-2437-445f-8021-8dd9070f72d4 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:44.876934 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f212f-2437-445f-8021-8dd9070f72d4 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:44.877118 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f212f-2437-445f-8021-8dd9070f72d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:44.912998 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-315f212f-2437-445f-8021-8dd9070f72d4 None None] MFA Rules not processed for user `4019f657541a4c2ab6e6cdf2bb82a99e`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:44.914489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-315f212f-2437-445f-8021-8dd9070f72d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:44.933629 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:45.000789 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1025/2078] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:46.055526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd8d69-d344-4263-919d-ad50ac131ad2 service nova] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:46.057095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8fcd8d69-d344-4263-919d-ad50ac131ad2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:46.070814 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd8d69-d344-4263-919d-ad50ac131ad2 service nova] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:46.076500 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530c532-d5e7-4ad8-9e6b-21b5de4c2d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:46.077571 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530c532-d5e7-4ad8-9e6b-21b5de4c2d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:46.078044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530c532-d5e7-4ad8-9e6b-21b5de4c2d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:46.078505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530c532-d5e7-4ad8-9e6b-21b5de4c2d92 admin admin] PATH_INFO: `/v3/users/88462600bad14146ae3d8489e3cdfd5e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:46.080042 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530c532-d5e7-4ad8-9e6b-21b5de4c2d92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88462600bad14146ae3d8489e3cdfd5e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:46.082301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530c532-d5e7-4ad8-9e6b-21b5de4c2d92 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:46.110456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:46.139167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-2530c532-d5e7-4ad8-9e6b-21b5de4c2d92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88462600bad14146ae3d8489e3cdfd5e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:46.140038 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-2530c532-d5e7-4ad8-9e6b-21b5de4c2d92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88462600bad14146ae3d8489e3cdfd5e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:46.149648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-2530c532-d5e7-4ad8-9e6b-21b5de4c2d92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88462600bad14146ae3d8489e3cdfd5e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:46.164196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-2530c532-d5e7-4ad8-9e6b-21b5de4c2d92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88462600bad14146ae3d8489e3cdfd5e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:46.164954 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-2530c532-d5e7-4ad8-9e6b-21b5de4c2d92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88462600bad14146ae3d8489e3cdfd5e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:46.184502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1054/2079] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:37:46 2022] DELETE /identity/v3/users/88462600bad14146ae3d8489e3cdfd5e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:46.188911 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494608f-d7bf-409d-8521-a70741d02950 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:46.189719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494608f-d7bf-409d-8521-a70741d02950 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:46.190000 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494608f-d7bf-409d-8521-a70741d02950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:46.210641 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-9494608f-d7bf-409d-8521-a70741d02950 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:46.212205 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9494608f-d7bf-409d-8521-a70741d02950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:46.345415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1026/2080] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:46.357524 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530c532-d5e7-4ad8-9e6b-21b5de4c2d92 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:46.359220 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2530c532-d5e7-4ad8-9e6b-21b5de4c2d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:46.432728 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530c532-d5e7-4ad8-9e6b-21b5de4c2d92 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:46.437127 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7a835-dfe1-4333-b7c3-7a38ca351890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:46.437742 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7a835-dfe1-4333-b7c3-7a38ca351890 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:46.438772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7a835-dfe1-4333-b7c3-7a38ca351890 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:46.439095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7a835-dfe1-4333-b7c3-7a38ca351890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:46.450027 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7a835-dfe1-4333-b7c3-7a38ca351890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:46.451450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7a835-dfe1-4333-b7c3-7a38ca351890 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:46.462554 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1055/2081] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:46.498528 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360bd19-7112-4199-a6bf-16b71b4d9652 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:46.499037 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360bd19-7112-4199-a6bf-16b71b4d9652 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:46.499455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360bd19-7112-4199-a6bf-16b71b4d9652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:46.530487 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-2360bd19-7112-4199-a6bf-16b71b4d9652 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:46.532463 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-2360bd19-7112-4199-a6bf-16b71b4d9652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:46.547189 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1027/2082] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 20 13:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:46.576642 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7a835-dfe1-4333-b7c3-7a38ca351890 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:46.583477 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ace7a835-dfe1-4333-b7c3-7a38ca351890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:46.713830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7a835-dfe1-4333-b7c3-7a38ca351890 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:46.720778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b12d0-15a8-4249-997d-4b39e0a206a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:46.722089 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b12d0-15a8-4249-997d-4b39e0a206a1 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:46.722089 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b12d0-15a8-4249-997d-4b39e0a206a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:46.722089 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b12d0-15a8-4249-997d-4b39e0a206a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:46.734226 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b12d0-15a8-4249-997d-4b39e0a206a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:46.736492 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b12d0-15a8-4249-997d-4b39e0a206a1 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:46.748431 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1056/2083] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:46.913782 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360bd19-7112-4199-a6bf-16b71b4d9652 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:46.915667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-2360bd19-7112-4199-a6bf-16b71b4d9652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:46.931600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360bd19-7112-4199-a6bf-16b71b4d9652 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:46.939243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa716e0-549a-4c0a-8a12-78c82f789118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:46.940192 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa716e0-549a-4c0a-8a12-78c82f789118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:46.940653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa716e0-549a-4c0a-8a12-78c82f789118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:46.941131 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa716e0-549a-4c0a-8a12-78c82f789118 admin admin] PATH_INFO: `/v3/projects/5bf371140b204a0e95f6e9efe34b62cd` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:46.942646 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa716e0-549a-4c0a-8a12-78c82f789118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf371140b204a0e95f6e9efe34b62cd)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:46.944896 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa716e0-549a-4c0a-8a12-78c82f789118 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:47.014443 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-afa716e0-549a-4c0a-8a12-78c82f789118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf371140b204a0e95f6e9efe34b62cd', 'request_id': 'req-afa716e0-549a-4c0a-8a12-78c82f789118'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:47.020704 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-afa716e0-549a-4c0a-8a12-78c82f789118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf371140b204a0e95f6e9efe34b62cd', 'request_id': 'req-afa716e0-549a-4c0a-8a12-78c82f789118'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:47.026502 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-afa716e0-549a-4c0a-8a12-78c82f789118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf371140b204a0e95f6e9efe34b62cd', 'request_id': 'req-afa716e0-549a-4c0a-8a12-78c82f789118'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:47.038870 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-afa716e0-549a-4c0a-8a12-78c82f789118 admin admin] The token cache is being invalidate because project 5bf371140b204a0e95f6e9efe34b62cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:37:47.039186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-afa716e0-549a-4c0a-8a12-78c82f789118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:47.039801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-afa716e0-549a-4c0a-8a12-78c82f789118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:37:47.041582 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1028/2084] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:37:46 2022] DELETE /identity/v3/projects/5bf371140b204a0e95f6e9efe34b62cd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:37:50.778981 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da5216-67f0-4632-b643-0c5fdf943361 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:50.778981 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da5216-67f0-4632-b643-0c5fdf943361 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:50.778981 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da5216-67f0-4632-b643-0c5fdf943361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:50.792020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-05da5216-67f0-4632-b643-0c5fdf943361 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:50.793960 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-05da5216-67f0-4632-b643-0c5fdf943361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:50.819055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:50.858470 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1057/2085] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 20 13:37:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:50.873537 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa716e0-549a-4c0a-8a12-78c82f789118 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:50.875580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-afa716e0-549a-4c0a-8a12-78c82f789118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:50.923446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:37:50.956280 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa716e0-549a-4c0a-8a12-78c82f789118 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:50.961651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2d022-943f-4999-8ed4-1a00c9a0499c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:50.962260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2d022-943f-4999-8ed4-1a00c9a0499c service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:50.962536 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2d022-943f-4999-8ed4-1a00c9a0499c service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:50.962803 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2d022-943f-4999-8ed4-1a00c9a0499c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:50.971932 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2d022-943f-4999-8ed4-1a00c9a0499c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:50.973701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2d022-943f-4999-8ed4-1a00c9a0499c service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:50.985069 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1029/2086] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:53.842345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd0780-d9ee-4777-bee7-699c1aa65d4f None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:53.842818 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd0780-d9ee-4777-bee7-699c1aa65d4f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:53.843062 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd0780-d9ee-4777-bee7-699c1aa65d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:53.863454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-8bbd0780-d9ee-4777-bee7-699c1aa65d4f None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:53.864681 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8bbd0780-d9ee-4777-bee7-699c1aa65d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:53.878810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1058/2087] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 20 13:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:53.896814 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2d022-943f-4999-8ed4-1a00c9a0499c service nova] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:53.898318 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-23c2d022-943f-4999-8ed4-1a00c9a0499c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:53.913956 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2d022-943f-4999-8ed4-1a00c9a0499c service nova] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:53.919685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419f1a3-a434-4f72-a58d-ce637ce54c5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:53.920647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419f1a3-a434-4f72-a58d-ce637ce54c5d service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:53.920647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419f1a3-a434-4f72-a58d-ce637ce54c5d service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:53.920926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1419f1a3-a434-4f72-a58d-ce637ce54c5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:53.930690 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419f1a3-a434-4f72-a58d-ce637ce54c5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:53.932618 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1419f1a3-a434-4f72-a58d-ce637ce54c5d service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:53.943221 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1030/2088] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:37:58.043281 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321327d-cf2b-4e84-bc3e-3dbb935002e4 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:58.043716 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321327d-cf2b-4e84-bc3e-3dbb935002e4 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:58.043812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321327d-cf2b-4e84-bc3e-3dbb935002e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:58.064020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c321327d-cf2b-4e84-bc3e-3dbb935002e4 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:37:58.065214 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c321327d-cf2b-4e84-bc3e-3dbb935002e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:37:58.073026 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1059/2089] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 20 13:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:37:58.097652 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419f1a3-a434-4f72-a58d-ce637ce54c5d service nova] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:37:58.109712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1419f1a3-a434-4f72-a58d-ce637ce54c5d service nova] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:37:58.115186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5bd21-ec2a-469b-a366-09416f3f7fa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:37:58.115776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5bd21-ec2a-469b-a366-09416f3f7fa8 service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:37:58.116055 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5bd21-ec2a-469b-a366-09416f3f7fa8 service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:37:58.116329 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5bd21-ec2a-469b-a366-09416f3f7fa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:37:58.124630 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5bd21-ec2a-469b-a366-09416f3f7fa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:37:58.126199 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5bd21-ec2a-469b-a366-09416f3f7fa8 service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:37:58.135524 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1031/2090] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:38:02.232394 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2a9dc-3cec-4566-b64d-5f9269bbac00 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:02.232900 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2a9dc-3cec-4566-b64d-5f9269bbac00 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:02.233017 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2a9dc-3cec-4566-b64d-5f9269bbac00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:02.256461 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-9ed2a9dc-3cec-4566-b64d-5f9269bbac00 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:38:02.257898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9ed2a9dc-3cec-4566-b64d-5f9269bbac00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:02.266786 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1060/2091] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 20 13:38:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:38:02.281503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5bd21-ec2a-469b-a366-09416f3f7fa8 service nova] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:02.292668 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5bd21-ec2a-469b-a366-09416f3f7fa8 service nova] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:02.298903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cda723-dba3-4b49-aecd-d5ba6887dac8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:02.299549 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda723-dba3-4b49-aecd-d5ba6887dac8 service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:02.299850 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda723-dba3-4b49-aecd-d5ba6887dac8 service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:02.300106 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cda723-dba3-4b49-aecd-d5ba6887dac8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:02.310157 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cda723-dba3-4b49-aecd-d5ba6887dac8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:02.311796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cda723-dba3-4b49-aecd-d5ba6887dac8 service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:02.322033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1032/2092] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:38:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:38:06.529254 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075db7b-503a-428f-946a-75bbff953732 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:06.529737 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075db7b-503a-428f-946a-75bbff953732 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:06.529830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075db7b-503a-428f-946a-75bbff953732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:06.550110 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-f075db7b-503a-428f-946a-75bbff953732 None None] MFA Rules not processed for user `86d435031c40469082c61107f634a43a`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:38:06.551489 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f075db7b-503a-428f-946a-75bbff953732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:06.619115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1061/2093] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:38:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:38:12.317624 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=34 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:16.607276 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=48 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:17.102268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6426f4-e726-4930-adc3-d8f1be68d489 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:17.102750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6426f4-e726-4930-adc3-d8f1be68d489 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:17.102886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6426f4-e726-4930-adc3-d8f1be68d489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:17.123235 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-3d6426f4-e726-4930-adc3-d8f1be68d489 None None] MFA Rules not processed for user `b3455d2a3c3d4d139544e88e7b04b0d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:38:17.124462 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-3d6426f4-e726-4930-adc3-d8f1be68d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:17.180888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1033/2094] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:38:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:38:19.960297 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661a737-16c3-4058-876f-6a99cad5ed76 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:19.960990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661a737-16c3-4058-876f-6a99cad5ed76 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:19.960990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661a737-16c3-4058-876f-6a99cad5ed76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:19.999531 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-2661a737-16c3-4058-876f-6a99cad5ed76 None None] MFA Rules not processed for user `534a714eb912475fb8cc8e5008b63a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:38:20.000839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2661a737-16c3-4058-876f-6a99cad5ed76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:20.098390 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1062/2095] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:38:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:38:27.173483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=25 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:30.090629 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=25 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:31.843478 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87166f-e77f-43f4-9082-e040cf4c7784 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:31.843974 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87166f-e77f-43f4-9082-e040cf4c7784 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:31.844163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87166f-e77f-43f4-9082-e040cf4c7784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:31.865540 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-ec87166f-e77f-43f4-9082-e040cf4c7784 None None] MFA Rules not processed for user `44342daa668c4516ae131d9f0160261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:38:31.866737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-ec87166f-e77f-43f4-9082-e040cf4c7784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:31.925218 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1034/2096] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Oct 20 13:38:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:38:31.968850 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661a737-16c3-4058-876f-6a99cad5ed76 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:31.970247 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2661a737-16c3-4058-876f-6a99cad5ed76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:32.043902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661a737-16c3-4058-876f-6a99cad5ed76 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:32.050242 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428fa10-3df7-46f8-8cf7-ed3a47bf544a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c893e6388ed340eca17da2e279ca34a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:32.050242 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428fa10-3df7-46f8-8cf7-ed3a47bf544a service swift] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:32.050242 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428fa10-3df7-46f8-8cf7-ed3a47bf544a service swift] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:32.050242 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428fa10-3df7-46f8-8cf7-ed3a47bf544a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:32.059381 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428fa10-3df7-46f8-8cf7-ed3a47bf544a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:32.061257 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428fa10-3df7-46f8-8cf7-ed3a47bf544a service swift] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:32.071725 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1063/2097] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Oct 20 13:38:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 13:38:39.575431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b5908-4241-4a60-9b32-75abcafd3eb8 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:39.576375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b5908-4241-4a60-9b32-75abcafd3eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:39.576683 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b5908-4241-4a60-9b32-75abcafd3eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:39.598293 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-7c3b5908-4241-4a60-9b32-75abcafd3eb8 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:38:39.599526 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7c3b5908-4241-4a60-9b32-75abcafd3eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:39.609494 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1035/2098] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 20 13:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:38:39.626827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428fa10-3df7-46f8-8cf7-ed3a47bf544a service swift] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:39.640915 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428fa10-3df7-46f8-8cf7-ed3a47bf544a service swift] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:39.649335 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc722b6e-b09d-49af-b327-fc966c3a49ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:39.650214 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc722b6e-b09d-49af-b327-fc966c3a49ed service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:39.650634 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc722b6e-b09d-49af-b327-fc966c3a49ed service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:39.651106 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc722b6e-b09d-49af-b327-fc966c3a49ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:39.669559 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc722b6e-b09d-49af-b327-fc966c3a49ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:39.672650 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc722b6e-b09d-49af-b327-fc966c3a49ed service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:39.696094 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1064/2099] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:38:43.969114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89de9f-bb04-4f3a-8aa7-e3a5a81c4fc0 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:43.969718 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89de9f-bb04-4f3a-8aa7-e3a5a81c4fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:43.969718 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89de9f-bb04-4f3a-8aa7-e3a5a81c4fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:43.990925 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-4e89de9f-bb04-4f3a-8aa7-e3a5a81c4fc0 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:38:43.992726 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-4e89de9f-bb04-4f3a-8aa7-e3a5a81c4fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:44.003687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1036/2100] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 20 13:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:38:44.018918 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc722b6e-b09d-49af-b327-fc966c3a49ed service nova] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:44.032880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc722b6e-b09d-49af-b327-fc966c3a49ed service nova] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:44.039422 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c867bd6-8400-4760-bca5-5fd889a0d57d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:44.040051 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c867bd6-8400-4760-bca5-5fd889a0d57d service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:44.040544 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c867bd6-8400-4760-bca5-5fd889a0d57d service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:44.040846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c867bd6-8400-4760-bca5-5fd889a0d57d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:44.050587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c867bd6-8400-4760-bca5-5fd889a0d57d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:44.052655 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c867bd6-8400-4760-bca5-5fd889a0d57d service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:44.066164 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1065/2101] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:38:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:38:47.060578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28a891-d08a-42c5-a94a-6fbb88106612 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:47.061035 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28a891-d08a-42c5-a94a-6fbb88106612 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:47.061246 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28a891-d08a-42c5-a94a-6fbb88106612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:47.081718 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-8f28a891-d08a-42c5-a94a-6fbb88106612 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:38:47.083065 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8f28a891-d08a-42c5-a94a-6fbb88106612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:47.091766 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1037/2102] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 20 13:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:38:47.112208 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c867bd6-8400-4760-bca5-5fd889a0d57d service nova] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:47.123708 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c867bd6-8400-4760-bca5-5fd889a0d57d service nova] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:47.129424 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d7400-b841-4916-aba3-e8293db247cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:47.130141 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d7400-b841-4916-aba3-e8293db247cf service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:47.130424 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d7400-b841-4916-aba3-e8293db247cf service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:47.130759 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d7400-b841-4916-aba3-e8293db247cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:47.139528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d7400-b841-4916-aba3-e8293db247cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:47.141106 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d7400-b841-4916-aba3-e8293db247cf service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:47.150716 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1066/2103] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:38:47.603652 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22d05f-0d6f-41ce-87bb-4e93c0d25901 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:47.603937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22d05f-0d6f-41ce-87bb-4e93c0d25901 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:47.604210 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22d05f-0d6f-41ce-87bb-4e93c0d25901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:47.625196 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-ca22d05f-0d6f-41ce-87bb-4e93c0d25901 None None] MFA Rules not processed for user `44342daa668c4516ae131d9f0160261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:38:47.626391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-ca22d05f-0d6f-41ce-87bb-4e93c0d25901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:47.634137 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1038/2104] 10.222.0.36 () {58 vars in 967 bytes} [Thu Oct 20 13:38:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:38:47.647178 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d7400-b841-4916-aba3-e8293db247cf service nova] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:47.658845 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d7400-b841-4916-aba3-e8293db247cf service nova] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:47.663763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7257c68-5bf2-4cda-83b3-889833785fb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c893e6388ed340eca17da2e279ca34a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:47.664350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7257c68-5bf2-4cda-83b3-889833785fb5 service swift] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:47.664623 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7257c68-5bf2-4cda-83b3-889833785fb5 service swift] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:47.664892 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7257c68-5bf2-4cda-83b3-889833785fb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:47.672874 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7257c68-5bf2-4cda-83b3-889833785fb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:47.674431 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7257c68-5bf2-4cda-83b3-889833785fb5 service swift] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:47.682476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1067/2105] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Oct 20 13:38:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 20 13:38:49.655878 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22d05f-0d6f-41ce-87bb-4e93c0d25901 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:49.657351 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-ca22d05f-0d6f-41ce-87bb-4e93c0d25901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:49.675359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22d05f-0d6f-41ce-87bb-4e93c0d25901 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:49.682429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809f66b-4518-40a7-b3a8-f443032509f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:49.683225 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809f66b-4518-40a7-b3a8-f443032509f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:49.683496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809f66b-4518-40a7-b3a8-f443032509f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:49.683815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809f66b-4518-40a7-b3a8-f443032509f2 admin admin] PATH_INFO: `/v3/users/86d435031c40469082c61107f634a43a` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:49.685090 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809f66b-4518-40a7-b3a8-f443032509f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86d435031c40469082c61107f634a43a)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:49.687889 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809f66b-4518-40a7-b3a8-f443032509f2 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:49.740220 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1809f66b-4518-40a7-b3a8-f443032509f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86d435031c40469082c61107f634a43a'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:49.740883 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1809f66b-4518-40a7-b3a8-f443032509f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86d435031c40469082c61107f634a43a'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:49.748131 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1809f66b-4518-40a7-b3a8-f443032509f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86d435031c40469082c61107f634a43a'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:49.760239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1809f66b-4518-40a7-b3a8-f443032509f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86d435031c40469082c61107f634a43a'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:49.760960 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1809f66b-4518-40a7-b3a8-f443032509f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86d435031c40469082c61107f634a43a'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:49.775407 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1039/2106] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:38:49 2022] DELETE /identity/v3/users/86d435031c40469082c61107f634a43a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:38:49.951224 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7257c68-5bf2-4cda-83b3-889833785fb5 service swift] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:49.961645 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7257c68-5bf2-4cda-83b3-889833785fb5 service swift] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:50.029247 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef9174-21e7-4d70-a1be-a9b413b64fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:50.029886 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef9174-21e7-4d70-a1be-a9b413b64fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:50.030168 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef9174-21e7-4d70-a1be-a9b413b64fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:50.030442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef9174-21e7-4d70-a1be-a9b413b64fc8 admin admin] PATH_INFO: `/v3/projects/8725a99bef5e4ab0914fb1563d5feb92` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:50.031571 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef9174-21e7-4d70-a1be-a9b413b64fc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8725a99bef5e4ab0914fb1563d5feb92)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:50.033506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ef9174-21e7-4d70-a1be-a9b413b64fc8 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:50.075336 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:50.083210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-75ef9174-21e7-4d70-a1be-a9b413b64fc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8725a99bef5e4ab0914fb1563d5feb92', 'request_id': 'req-75ef9174-21e7-4d70-a1be-a9b413b64fc8'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:50.092113 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-75ef9174-21e7-4d70-a1be-a9b413b64fc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8725a99bef5e4ab0914fb1563d5feb92', 'request_id': 'req-75ef9174-21e7-4d70-a1be-a9b413b64fc8'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:50.099696 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-75ef9174-21e7-4d70-a1be-a9b413b64fc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8725a99bef5e4ab0914fb1563d5feb92', 'request_id': 'req-75ef9174-21e7-4d70-a1be-a9b413b64fc8'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:50.111818 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-75ef9174-21e7-4d70-a1be-a9b413b64fc8 admin admin] The token cache is being invalidate because project 8725a99bef5e4ab0914fb1563d5feb92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:38:50.112124 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-75ef9174-21e7-4d70-a1be-a9b413b64fc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:50.112882 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-75ef9174-21e7-4d70-a1be-a9b413b64fc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:50.114275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1068/2107] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:38:49 2022] DELETE /identity/v3/projects/8725a99bef5e4ab0914fb1563d5feb92 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:38:50.120507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a854320-6a89-48cf-b088-e3d6749e1215 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:50.121191 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a854320-6a89-48cf-b088-e3d6749e1215 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:50.121472 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a854320-6a89-48cf-b088-e3d6749e1215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:50.141136 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-7a854320-6a89-48cf-b088-e3d6749e1215 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:38:50.142333 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7a854320-6a89-48cf-b088-e3d6749e1215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:50.193819 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:50.201219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d6ed0-7df7-4f60-8418-b92041c90725 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:50.201507 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d6ed0-7df7-4f60-8418-b92041c90725 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:50.201792 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d6ed0-7df7-4f60-8418-b92041c90725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:50.211093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1040/2108] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:38:50.222643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-f62d6ed0-7df7-4f60-8418-b92041c90725 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:38:50.223930 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f62d6ed0-7df7-4f60-8418-b92041c90725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:50.232640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1069/2109] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 20 13:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:38:50.249031 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a854320-6a89-48cf-b088-e3d6749e1215 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:50.250534 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7a854320-6a89-48cf-b088-e3d6749e1215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:50.278669 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29b19e-f80e-4a49-b1cc-0fed5972ab1c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:50.278959 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29b19e-f80e-4a49-b1cc-0fed5972ab1c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:50.279258 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29b19e-f80e-4a49-b1cc-0fed5972ab1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:50.299792 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-2d29b19e-f80e-4a49-b1cc-0fed5972ab1c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:38:50.301028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2d29b19e-f80e-4a49-b1cc-0fed5972ab1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:50.309531 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1070/2110] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:38:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:38:50.313597 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29b19e-f80e-4a49-b1cc-0fed5972ab1c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:50.322632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29b19e-f80e-4a49-b1cc-0fed5972ab1c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:50.327942 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a854320-6a89-48cf-b088-e3d6749e1215 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:50.328276 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5ef3a-92a2-4feb-9c96-092c71c0fe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:50.328869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5ef3a-92a2-4feb-9c96-092c71c0fe60 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:50.329149 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5ef3a-92a2-4feb-9c96-092c71c0fe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:50.329428 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5ef3a-92a2-4feb-9c96-092c71c0fe60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:50.330076 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5ef3a-92a2-4feb-9c96-092c71c0fe60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:38:50.330382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5ef3a-92a2-4feb-9c96-092c71c0fe60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:50.332010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5ef3a-92a2-4feb-9c96-092c71c0fe60 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:50.333423 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b26f1-240e-4f41-90e9-8aa7cf14a99d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:50.334029 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b26f1-240e-4f41-90e9-8aa7cf14a99d service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:50.334317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b26f1-240e-4f41-90e9-8aa7cf14a99d service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:50.334592 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b26f1-240e-4f41-90e9-8aa7cf14a99d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:50.343501 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b26f1-240e-4f41-90e9-8aa7cf14a99d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:50.347235 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1071/2111] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:38:50.347371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b26f1-240e-4f41-90e9-8aa7cf14a99d service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:50.348201 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5ef3a-92a2-4feb-9c96-092c71c0fe60 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:50.354826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1041/2112] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:38:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:38:50.358397 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5ef3a-92a2-4feb-9c96-092c71c0fe60 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:50.363034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55ba97-08c1-4477-ac76-b292448ff843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:50.363625 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55ba97-08c1-4477-ac76-b292448ff843 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:50.363907 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55ba97-08c1-4477-ac76-b292448ff843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:50.364181 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55ba97-08c1-4477-ac76-b292448ff843 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:50.364816 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef55ba97-08c1-4477-ac76-b292448ff843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:50.366689 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef55ba97-08c1-4477-ac76-b292448ff843 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:50.395345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1072/2113] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:38:50 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:38:50.399739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b26f1-240e-4f41-90e9-8aa7cf14a99d service nova] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:50.410104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b26f1-240e-4f41-90e9-8aa7cf14a99d service nova] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:50.470384 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4966a1-ac1f-42d8-b2c0-38e50f0abfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:50.471027 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4966a1-ac1f-42d8-b2c0-38e50f0abfca admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:50.471311 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4966a1-ac1f-42d8-b2c0-38e50f0abfca admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:50.471585 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4966a1-ac1f-42d8-b2c0-38e50f0abfca admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:50.472214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4966a1-ac1f-42d8-b2c0-38e50f0abfca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:50.474150 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4966a1-ac1f-42d8-b2c0-38e50f0abfca admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:50.497890 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1042/2114] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:38:50 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:38:50.499140 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55ba97-08c1-4477-ac76-b292448ff843 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:50.510067 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55ba97-08c1-4477-ac76-b292448ff843 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:50.515372 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54852b43-f4e2-4656-a186-92fa95ff7999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:50.515973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54852b43-f4e2-4656-a186-92fa95ff7999 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:50.516251 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54852b43-f4e2-4656-a186-92fa95ff7999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:50.516522 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54852b43-f4e2-4656-a186-92fa95ff7999 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:50.517260 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54852b43-f4e2-4656-a186-92fa95ff7999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:50.519450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54852b43-f4e2-4656-a186-92fa95ff7999 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:50.537376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1073/2115] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:38:50.538893 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4966a1-ac1f-42d8-b2c0-38e50f0abfca admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:50.550208 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4966a1-ac1f-42d8-b2c0-38e50f0abfca admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:50.556630 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230818e7-eba4-4ec6-b55d-59e63b946822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:50.557245 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230818e7-eba4-4ec6-b55d-59e63b946822 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:50.557559 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230818e7-eba4-4ec6-b55d-59e63b946822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:50.557831 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230818e7-eba4-4ec6-b55d-59e63b946822 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:50.559134 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230818e7-eba4-4ec6-b55d-59e63b946822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:50.560804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230818e7-eba4-4ec6-b55d-59e63b946822 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:50.576659 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1043/2116] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:38:50.581614 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54852b43-f4e2-4656-a186-92fa95ff7999 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:50.591920 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54852b43-f4e2-4656-a186-92fa95ff7999 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:50.596559 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f745f-a23f-4452-8daf-386162897e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:50.597236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f745f-a23f-4452-8daf-386162897e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:50.597629 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f745f-a23f-4452-8daf-386162897e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:50.597828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f745f-a23f-4452-8daf-386162897e3e admin admin] PATH_INFO: `/v3/projects/664964fad3044920a90060fc6ddc81bc/users/d107fe5ec166401597f58630d487fc38/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:50.612476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f745f-a23f-4452-8daf-386162897e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=664964fad3044920a90060fc6ddc81bc, user_id=d107fe5ec166401597f58630d487fc38, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:50.615115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f745f-a23f-4452-8daf-386162897e3e admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:50.627842 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1074/2117] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:38:50 2022] PUT /identity/v3/projects/664964fad3044920a90060fc6ddc81bc/users/d107fe5ec166401597f58630d487fc38/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:38:50.638440 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c31be-a4f4-4303-9017-f138d384f559 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:50.638759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c31be-a4f4-4303-9017-f138d384f559 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:50.639067 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c31be-a4f4-4303-9017-f138d384f559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:50.666454 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-a47c31be-a4f4-4303-9017-f138d384f559 None None] MFA Rules not processed for user `d107fe5ec166401597f58630d487fc38`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:38:50.667725 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a47c31be-a4f4-4303-9017-f138d384f559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:50.712366 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:50.732961 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1044/2118] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:38:50 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:38:50.744147 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f745f-a23f-4452-8daf-386162897e3e admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:50.746351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-909f745f-a23f-4452-8daf-386162897e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:50.801794 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f745f-a23f-4452-8daf-386162897e3e admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:50.806004 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390bcf2-d2e2-4aea-8c18-bf12b9be33be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:50.806606 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390bcf2-d2e2-4aea-8c18-bf12b9be33be service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:50.806916 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390bcf2-d2e2-4aea-8c18-bf12b9be33be service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:50.807225 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390bcf2-d2e2-4aea-8c18-bf12b9be33be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:50.816402 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390bcf2-d2e2-4aea-8c18-bf12b9be33be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:50.817852 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390bcf2-d2e2-4aea-8c18-bf12b9be33be service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:50.826985 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1075/2119] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:38:50 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:38:53.403337 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b947445-ff94-478e-bd0f-53e1976edeef None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:53.403834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b947445-ff94-478e-bd0f-53e1976edeef None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:53.403947 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b947445-ff94-478e-bd0f-53e1976edeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:53.423613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-1b947445-ff94-478e-bd0f-53e1976edeef None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:38:53.424825 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-1b947445-ff94-478e-bd0f-53e1976edeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:53.484611 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1045/2120] 10.222.0.26 () {58 vars in 1016 bytes} [Thu Oct 20 13:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:38:53.504841 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390bcf2-d2e2-4aea-8c18-bf12b9be33be service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:53.506221 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c390bcf2-d2e2-4aea-8c18-bf12b9be33be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:53.557811 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:53.585245 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390bcf2-d2e2-4aea-8c18-bf12b9be33be service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:53.590629 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e330b793-859a-4b2c-b61c-f281f777a9c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:53.591294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330b793-859a-4b2c-b61c-f281f777a9c9 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:53.591570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330b793-859a-4b2c-b61c-f281f777a9c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:53.591839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e330b793-859a-4b2c-b61c-f281f777a9c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:53.599881 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330b793-859a-4b2c-b61c-f281f777a9c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:53.601954 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e330b793-859a-4b2c-b61c-f281f777a9c9 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:53.613080 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1076/2121] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:38:55.867521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b947445-ff94-478e-bd0f-53e1976edeef None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:55.879784 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b947445-ff94-478e-bd0f-53e1976edeef None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:55.884630 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18695eb5-d7a4-4da1-b2fa-6614ed558326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:55.885284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18695eb5-d7a4-4da1-b2fa-6614ed558326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:55.885558 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18695eb5-d7a4-4da1-b2fa-6614ed558326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:55.885827 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18695eb5-d7a4-4da1-b2fa-6614ed558326 admin admin] PATH_INFO: `/v3/users/d107fe5ec166401597f58630d487fc38` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:55.888194 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18695eb5-d7a4-4da1-b2fa-6614ed558326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d107fe5ec166401597f58630d487fc38)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:55.890155 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18695eb5-d7a4-4da1-b2fa-6614ed558326 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:55.936961 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-18695eb5-d7a4-4da1-b2fa-6614ed558326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd107fe5ec166401597f58630d487fc38'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:55.937619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-18695eb5-d7a4-4da1-b2fa-6614ed558326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd107fe5ec166401597f58630d487fc38'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:55.944664 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-18695eb5-d7a4-4da1-b2fa-6614ed558326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd107fe5ec166401597f58630d487fc38'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:55.958349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-18695eb5-d7a4-4da1-b2fa-6614ed558326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd107fe5ec166401597f58630d487fc38'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:55.959075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-18695eb5-d7a4-4da1-b2fa-6614ed558326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd107fe5ec166401597f58630d487fc38'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:55.972228 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1046/2122] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:38:55 2022] DELETE /identity/v3/users/d107fe5ec166401597f58630d487fc38 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:38:55.976746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e05d18-1a52-405c-aa5d-feb5209dff8c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:55.977234 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e05d18-1a52-405c-aa5d-feb5209dff8c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:55.977342 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e05d18-1a52-405c-aa5d-feb5209dff8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:55.997007 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-24e05d18-1a52-405c-aa5d-feb5209dff8c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:38:55.998220 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-24e05d18-1a52-405c-aa5d-feb5209dff8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:56.060140 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1077/2123] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:38:56.070730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18695eb5-d7a4-4da1-b2fa-6614ed558326 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:56.072190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-18695eb5-d7a4-4da1-b2fa-6614ed558326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:56.134995 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18695eb5-d7a4-4da1-b2fa-6614ed558326 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:56.138899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e430a-8bfd-4384-963b-62819a8a4c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:56.139533 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e430a-8bfd-4384-963b-62819a8a4c4e service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:56.139815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e430a-8bfd-4384-963b-62819a8a4c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:56.140090 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e430a-8bfd-4384-963b-62819a8a4c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:56.148976 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e430a-8bfd-4384-963b-62819a8a4c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:56.150401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e430a-8bfd-4384-963b-62819a8a4c4e service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:56.155987 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:38:56.161086 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1047/2124] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:38:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:38:56.423137 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e05d18-1a52-405c-aa5d-feb5209dff8c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:38:56.424697 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-24e05d18-1a52-405c-aa5d-feb5209dff8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:38:56.442810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e05d18-1a52-405c-aa5d-feb5209dff8c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:38:56.447602 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d72a63-963a-49d8-bd1b-6aa2bc2e5f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:38:56.448230 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d72a63-963a-49d8-bd1b-6aa2bc2e5f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:38:56.448515 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d72a63-963a-49d8-bd1b-6aa2bc2e5f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:38:56.448796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d72a63-963a-49d8-bd1b-6aa2bc2e5f92 admin admin] PATH_INFO: `/v3/projects/664964fad3044920a90060fc6ddc81bc` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:38:56.449993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d72a63-963a-49d8-bd1b-6aa2bc2e5f92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=664964fad3044920a90060fc6ddc81bc)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:38:56.451909 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d72a63-963a-49d8-bd1b-6aa2bc2e5f92 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:38:56.501695 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-c0d72a63-963a-49d8-bd1b-6aa2bc2e5f92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '664964fad3044920a90060fc6ddc81bc', 'request_id': 'req-c0d72a63-963a-49d8-bd1b-6aa2bc2e5f92'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:56.509651 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-c0d72a63-963a-49d8-bd1b-6aa2bc2e5f92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '664964fad3044920a90060fc6ddc81bc', 'request_id': 'req-c0d72a63-963a-49d8-bd1b-6aa2bc2e5f92'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:56.516731 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-c0d72a63-963a-49d8-bd1b-6aa2bc2e5f92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '664964fad3044920a90060fc6ddc81bc', 'request_id': 'req-c0d72a63-963a-49d8-bd1b-6aa2bc2e5f92'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:56.527661 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-c0d72a63-963a-49d8-bd1b-6aa2bc2e5f92 admin admin] The token cache is being invalidate because project 664964fad3044920a90060fc6ddc81bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:38:56.528025 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-c0d72a63-963a-49d8-bd1b-6aa2bc2e5f92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:56.528741 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-c0d72a63-963a-49d8-bd1b-6aa2bc2e5f92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:38:56.530415 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1078/2125] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:38:56 2022] DELETE /identity/v3/projects/664964fad3044920a90060fc6ddc81bc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:39:03.646398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed14cf9-9760-4cde-83b7-f6aa6a7f07e1 None None] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:03.646824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed14cf9-9760-4cde-83b7-f6aa6a7f07e1 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:03.646969 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed14cf9-9760-4cde-83b7-f6aa6a7f07e1 None None] PATH_INFO: `/` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:03.648330 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1048/2126] 10.222.0.36 () {54 vars in 961 bytes} [Thu Oct 20 13:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:39:03.653860 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128b1a7-3fc7-4427-aefb-95c9dd08547b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:03.654289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128b1a7-3fc7-4427-aefb-95c9dd08547b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:03.654417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128b1a7-3fc7-4427-aefb-95c9dd08547b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:03.674374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5128b1a7-3fc7-4427-aefb-95c9dd08547b None None] MFA Rules not processed for user `a00f0b4cee8d49a48a95317aec9f647c`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:39:03.675588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5128b1a7-3fc7-4427-aefb-95c9dd08547b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:39:03.722637 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:03.739479 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1079/2127] 10.222.0.36 () {58 vars in 1058 bytes} [Thu Oct 20 13:39:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:39:03.747200 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed14cf9-9760-4cde-83b7-f6aa6a7f07e1 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:39:03.761468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed14cf9-9760-4cde-83b7-f6aa6a7f07e1 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:39:03.766587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeac2b5-95ed-4d62-8183-258b7579e90e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a00f0b4cee8d49a48a95317aec9f647c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:39:03.767282 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac2b5-95ed-4d62-8183-258b7579e90e service placement] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:03.767567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac2b5-95ed-4d62-8183-258b7579e90e service placement] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:03.767843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeac2b5-95ed-4d62-8183-258b7579e90e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:03.769592 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-fdeac2b5-95ed-4d62-8183-258b7579e90e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:39:03.782610 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeac2b5-95ed-4d62-8183-258b7579e90e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:39:03.784144 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeac2b5-95ed-4d62-8183-258b7579e90e service placement] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:39:03.794464 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1049/2128] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:39:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:39:13.733643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:13.789688 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=6 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:20.864484 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dd51d-884a-4b9f-ae70-3d7cda298835 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:20.864484 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dd51d-884a-4b9f-ae70-3d7cda298835 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:20.864990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dd51d-884a-4b9f-ae70-3d7cda298835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:20.892127 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-8d0dd51d-884a-4b9f-ae70-3d7cda298835 None None] MFA Rules not processed for user `4019f657541a4c2ab6e6cdf2bb82a99e`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:39:20.893587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8d0dd51d-884a-4b9f-ae70-3d7cda298835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:39:20.992946 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1080/2129] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:39:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:39:22.630590 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeac2b5-95ed-4d62-8183-258b7579e90e service placement] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:39:22.632249 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-fdeac2b5-95ed-4d62-8183-258b7579e90e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:39:22.700338 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeac2b5-95ed-4d62-8183-258b7579e90e service placement] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:39:22.704882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6b1421-fb85-4d9e-9c9d-07632cabd345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:39:22.705516 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b1421-fb85-4d9e-9c9d-07632cabd345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:22.705795 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b1421-fb85-4d9e-9c9d-07632cabd345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:22.706093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6b1421-fb85-4d9e-9c9d-07632cabd345 admin admin] PATH_INFO: `/v3/users/534a714eb912475fb8cc8e5008b63a6d` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:22.707242 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b1421-fb85-4d9e-9c9d-07632cabd345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=534a714eb912475fb8cc8e5008b63a6d)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:39:22.709178 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6b1421-fb85-4d9e-9c9d-07632cabd345 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:39:22.759084 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-df6b1421-fb85-4d9e-9c9d-07632cabd345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '534a714eb912475fb8cc8e5008b63a6d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:39:22.759768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-df6b1421-fb85-4d9e-9c9d-07632cabd345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '534a714eb912475fb8cc8e5008b63a6d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:39:22.767182 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-df6b1421-fb85-4d9e-9c9d-07632cabd345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '534a714eb912475fb8cc8e5008b63a6d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:39:22.782409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-df6b1421-fb85-4d9e-9c9d-07632cabd345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '534a714eb912475fb8cc8e5008b63a6d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:39:22.783146 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-df6b1421-fb85-4d9e-9c9d-07632cabd345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '534a714eb912475fb8cc8e5008b63a6d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:39:22.798610 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1050/2130] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:39:22 2022] DELETE /identity/v3/users/534a714eb912475fb8cc8e5008b63a6d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:39:22.971264 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dd51d-884a-4b9f-ae70-3d7cda298835 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:39:22.985067 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dd51d-884a-4b9f-ae70-3d7cda298835 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:39:23.043151 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c6783-53d0-40bb-9103-e36831c6069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:39:23.043946 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6783-53d0-40bb-9103-e36831c6069b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:23.044221 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6783-53d0-40bb-9103-e36831c6069b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:23.044489 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6783-53d0-40bb-9103-e36831c6069b admin admin] PATH_INFO: `/v3/projects/8f16eaa708654a069faa6434afea597b` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:23.045598 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c6783-53d0-40bb-9103-e36831c6069b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f16eaa708654a069faa6434afea597b)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:39:23.047525 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c6783-53d0-40bb-9103-e36831c6069b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:39:23.092566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-065c6783-53d0-40bb-9103-e36831c6069b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f16eaa708654a069faa6434afea597b', 'request_id': 'req-065c6783-53d0-40bb-9103-e36831c6069b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:39:23.099707 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-065c6783-53d0-40bb-9103-e36831c6069b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f16eaa708654a069faa6434afea597b', 'request_id': 'req-065c6783-53d0-40bb-9103-e36831c6069b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:39:23.106539 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-065c6783-53d0-40bb-9103-e36831c6069b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f16eaa708654a069faa6434afea597b', 'request_id': 'req-065c6783-53d0-40bb-9103-e36831c6069b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:39:23.116717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-065c6783-53d0-40bb-9103-e36831c6069b admin admin] The token cache is being invalidate because project 8f16eaa708654a069faa6434afea597b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:39:23.117010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-065c6783-53d0-40bb-9103-e36831c6069b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:39:23.117668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-065c6783-53d0-40bb-9103-e36831c6069b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:39:23.119168 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1081/2131] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:39:22 2022] DELETE /identity/v3/projects/8f16eaa708654a069faa6434afea597b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:39:23.124460 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f497ca-1b55-4d0a-8826-93c78f9efcae None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:23.124753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f497ca-1b55-4d0a-8826-93c78f9efcae None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:23.125033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f497ca-1b55-4d0a-8826-93c78f9efcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:23.145168 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-a4f497ca-1b55-4d0a-8826-93c78f9efcae None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:39:23.146376 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a4f497ca-1b55-4d0a-8826-93c78f9efcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:39:23.207786 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1051/2132] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:39:23.216450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789220d1-afcf-470c-86b3-c6e1dbfa4b8b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:23.216735 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789220d1-afcf-470c-86b3-c6e1dbfa4b8b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:23.217013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789220d1-afcf-470c-86b3-c6e1dbfa4b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:23.236739 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-789220d1-afcf-470c-86b3-c6e1dbfa4b8b None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:39:23.237953 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-789220d1-afcf-470c-86b3-c6e1dbfa4b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:39:23.246799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1082/2133] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:39:23.250589 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f497ca-1b55-4d0a-8826-93c78f9efcae None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:39:23.260646 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f497ca-1b55-4d0a-8826-93c78f9efcae None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:39:23.265887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad14b60-0fb7-4026-91a5-a33ecb0421bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:39:23.266488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad14b60-0fb7-4026-91a5-a33ecb0421bf admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:23.266763 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad14b60-0fb7-4026-91a5-a33ecb0421bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:23.267065 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad14b60-0fb7-4026-91a5-a33ecb0421bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:23.267705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad14b60-0fb7-4026-91a5-a33ecb0421bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:39:23.268003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad14b60-0fb7-4026-91a5-a33ecb0421bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:39:23.269586 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad14b60-0fb7-4026-91a5-a33ecb0421bf admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:39:23.281505 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1052/2134] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:39:23.285766 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789220d1-afcf-470c-86b3-c6e1dbfa4b8b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:39:23.295696 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789220d1-afcf-470c-86b3-c6e1dbfa4b8b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:39:23.300556 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24555bba-463d-4e9b-9f91-2dffd7732928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:39:23.301190 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24555bba-463d-4e9b-9f91-2dffd7732928 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:23.301469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24555bba-463d-4e9b-9f91-2dffd7732928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:23.301746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24555bba-463d-4e9b-9f91-2dffd7732928 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:23.302393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24555bba-463d-4e9b-9f91-2dffd7732928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:39:23.304352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24555bba-463d-4e9b-9f91-2dffd7732928 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:39:23.333295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1083/2135] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:39:23 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:39:23.337548 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad14b60-0fb7-4026-91a5-a33ecb0421bf admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:39:23.348231 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad14b60-0fb7-4026-91a5-a33ecb0421bf admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:39:23.352016 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:23.408202 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b82b0-7441-495c-b210-28ab5cc584d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:39:23.408808 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b82b0-7441-495c-b210-28ab5cc584d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:23.409115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b82b0-7441-495c-b210-28ab5cc584d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:23.409389 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56b82b0-7441-495c-b210-28ab5cc584d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:23.410022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b82b0-7441-495c-b210-28ab5cc584d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:39:23.412943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56b82b0-7441-495c-b210-28ab5cc584d5 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:39:23.433321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1053/2136] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:39:23 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:39:23.437483 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24555bba-463d-4e9b-9f91-2dffd7732928 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:39:23.447585 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24555bba-463d-4e9b-9f91-2dffd7732928 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:39:23.452600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2917f-080e-4d71-9062-ce775f3179f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:39:23.453191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2917f-080e-4d71-9062-ce775f3179f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:23.453466 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2917f-080e-4d71-9062-ce775f3179f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:23.453734 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2917f-080e-4d71-9062-ce775f3179f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:23.454361 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2917f-080e-4d71-9062-ce775f3179f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:39:23.455972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2917f-080e-4d71-9062-ce775f3179f8 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:39:23.457172 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:23.468828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1084/2137] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:39:23.472041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b82b0-7441-495c-b210-28ab5cc584d5 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:39:23.482449 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56b82b0-7441-495c-b210-28ab5cc584d5 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:39:23.487284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3321bb5-9c30-4595-a844-575206f3ce11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:39:23.487887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3321bb5-9c30-4595-a844-575206f3ce11 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:23.488165 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3321bb5-9c30-4595-a844-575206f3ce11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:23.488480 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3321bb5-9c30-4595-a844-575206f3ce11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:23.489112 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3321bb5-9c30-4595-a844-575206f3ce11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:39:23.490692 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3321bb5-9c30-4595-a844-575206f3ce11 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:39:23.502130 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1054/2138] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:39:23.506245 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2917f-080e-4d71-9062-ce775f3179f8 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:39:23.517054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2917f-080e-4d71-9062-ce775f3179f8 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:39:23.521655 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f43c0-dc1d-4a4b-8140-97133f0756e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:39:23.522302 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f43c0-dc1d-4a4b-8140-97133f0756e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:23.522578 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f43c0-dc1d-4a4b-8140-97133f0756e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:23.522851 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f43c0-dc1d-4a4b-8140-97133f0756e6 admin admin] PATH_INFO: `/v3/projects/91e7e29ffa52470d80815870b0d6fc1f/users/05a08e72fd6b426699b47d178020560a/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:23.537622 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f43c0-dc1d-4a4b-8140-97133f0756e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91e7e29ffa52470d80815870b0d6fc1f, user_id=05a08e72fd6b426699b47d178020560a, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:39:23.540376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f43c0-dc1d-4a4b-8140-97133f0756e6 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:39:23.553058 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1085/2139] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:39:23 2022] PUT /identity/v3/projects/91e7e29ffa52470d80815870b0d6fc1f/users/05a08e72fd6b426699b47d178020560a/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:39:23.558885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfaca3-bfa1-45ed-a60a-ee68eeea17f0 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:23.559222 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfaca3-bfa1-45ed-a60a-ee68eeea17f0 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:23.559537 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bfaca3-bfa1-45ed-a60a-ee68eeea17f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:23.579210 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-84bfaca3-bfa1-45ed-a60a-ee68eeea17f0 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:39:23.580406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-84bfaca3-bfa1-45ed-a60a-ee68eeea17f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:39:23.646336 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1055/2140] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:39:23.656064 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f43c0-dc1d-4a4b-8140-97133f0756e6 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:39:23.657981 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8a8f43c0-dc1d-4a4b-8140-97133f0756e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:39:23.725441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f43c0-dc1d-4a4b-8140-97133f0756e6 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:39:23.729033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c43a75-80d9-43b5-a969-af074479c1e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:39:23.729776 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c43a75-80d9-43b5-a969-af074479c1e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:23.730099 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c43a75-80d9-43b5-a969-af074479c1e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:23.730284 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c43a75-80d9-43b5-a969-af074479c1e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:23.739209 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c43a75-80d9-43b5-a969-af074479c1e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:39:23.740612 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c43a75-80d9-43b5-a969-af074479c1e5 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:39:23.750493 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1086/2141] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:39:29.716308 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d44f5b-887e-4036-8ef0-21ae60bb8b29 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:29.716886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d44f5b-887e-4036-8ef0-21ae60bb8b29 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:29.716886 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d44f5b-887e-4036-8ef0-21ae60bb8b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:29.767756 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-61d44f5b-887e-4036-8ef0-21ae60bb8b29 None None] MFA Rules not processed for user `05a08e72fd6b426699b47d178020560a`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:39:29.769693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-61d44f5b-887e-4036-8ef0-21ae60bb8b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:39:29.899743 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1056/2142] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:39:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:39:29.901256 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c43a75-80d9-43b5-a969-af074479c1e5 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:39:29.917940 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c43a75-80d9-43b5-a969-af074479c1e5 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:39:29.926573 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068d67b-9370-4e71-8ed1-69ad6a54a417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:39:29.927356 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068d67b-9370-4e71-8ed1-69ad6a54a417 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:29.928370 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068d67b-9370-4e71-8ed1-69ad6a54a417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:29.929339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068d67b-9370-4e71-8ed1-69ad6a54a417 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:29.931485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068d67b-9370-4e71-8ed1-69ad6a54a417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:39:29.936441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068d67b-9370-4e71-8ed1-69ad6a54a417 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:39:30.014594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d44f5b-887e-4036-8ef0-21ae60bb8b29 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:39:30.022272 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1087/2143] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:39:29 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:39:30.032242 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d44f5b-887e-4036-8ef0-21ae60bb8b29 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:39:30.062076 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:30.124114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f410f-91cf-4db2-93fd-0ef3e8f111ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:39:30.124835 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f410f-91cf-4db2-93fd-0ef3e8f111ae admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:30.125178 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f410f-91cf-4db2-93fd-0ef3e8f111ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:30.125519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f410f-91cf-4db2-93fd-0ef3e8f111ae admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:30.126283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f410f-91cf-4db2-93fd-0ef3e8f111ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:39:30.128516 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f410f-91cf-4db2-93fd-0ef3e8f111ae admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:39:30.157792 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1057/2144] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:39:30 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:39:30.159119 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068d67b-9370-4e71-8ed1-69ad6a54a417 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:39:30.170691 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068d67b-9370-4e71-8ed1-69ad6a54a417 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:39:30.176415 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3c95b-a822-429b-a277-1ccac037a6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:39:30.177365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3c95b-a822-429b-a277-1ccac037a6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:30.177871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3c95b-a822-429b-a277-1ccac037a6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:30.178371 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3c95b-a822-429b-a277-1ccac037a6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:30.179456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3c95b-a822-429b-a277-1ccac037a6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:39:30.181611 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3c95b-a822-429b-a277-1ccac037a6d1 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:39:30.195652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1088/2145] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:39:30.200684 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f410f-91cf-4db2-93fd-0ef3e8f111ae admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:39:30.215367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f410f-91cf-4db2-93fd-0ef3e8f111ae admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:39:30.222372 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc0a0f-7434-4aa9-889c-fa13b3bd44c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:39:30.223592 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc0a0f-7434-4aa9-889c-fa13b3bd44c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:30.223592 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc0a0f-7434-4aa9-889c-fa13b3bd44c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:30.223796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc0a0f-7434-4aa9-889c-fa13b3bd44c0 admin admin] PATH_INFO: `/v3/projects/a8c2110bbf5b4311b70348debfb9c379/users/477a7c8335a5446d86d9a1812d88760b/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:30.243184 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc0a0f-7434-4aa9-889c-fa13b3bd44c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c2110bbf5b4311b70348debfb9c379, user_id=477a7c8335a5446d86d9a1812d88760b, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:39:30.247869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc0a0f-7434-4aa9-889c-fa13b3bd44c0 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:39:30.267032 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1058/2146] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:39:30 2022] PUT /identity/v3/projects/a8c2110bbf5b4311b70348debfb9c379/users/477a7c8335a5446d86d9a1812d88760b/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:39:30.270938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3c95b-a822-429b-a277-1ccac037a6d1 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:39:30.283381 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3c95b-a822-429b-a277-1ccac037a6d1 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:39:30.364535 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b7ead-f158-4cc5-a854-f6c5f6152448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:39:30.365155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b7ead-f158-4cc5-a854-f6c5f6152448 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:30.365436 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b7ead-f158-4cc5-a854-f6c5f6152448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:30.365711 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b7ead-f158-4cc5-a854-f6c5f6152448 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:30.366395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b7ead-f158-4cc5-a854-f6c5f6152448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:39:30.368093 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b7ead-f158-4cc5-a854-f6c5f6152448 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:39:30.382473 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1089/2147] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:39:30.383559 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc0a0f-7434-4aa9-889c-fa13b3bd44c0 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:39:30.396504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc0a0f-7434-4aa9-889c-fa13b3bd44c0 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:39:30.402765 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd957412-4b56-4b58-957e-bccab7f5d049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:39:30.403690 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd957412-4b56-4b58-957e-bccab7f5d049 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:30.403863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd957412-4b56-4b58-957e-bccab7f5d049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:30.404019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd957412-4b56-4b58-957e-bccab7f5d049 admin admin] PATH_INFO: `/v3/projects/a8c2110bbf5b4311b70348debfb9c379/users/477a7c8335a5446d86d9a1812d88760b/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:30.405953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd957412-4b56-4b58-957e-bccab7f5d049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c2110bbf5b4311b70348debfb9c379, user_id=477a7c8335a5446d86d9a1812d88760b, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:39:30.408623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd957412-4b56-4b58-957e-bccab7f5d049 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:39:30.430698 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1059/2148] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:39:30 2022] PUT /identity/v3/projects/a8c2110bbf5b4311b70348debfb9c379/users/477a7c8335a5446d86d9a1812d88760b/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:39:32.107900 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f91a66-4d00-40f5-beaf-3adcf96c8002 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:32.108789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f91a66-4d00-40f5-beaf-3adcf96c8002 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:32.109223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f91a66-4d00-40f5-beaf-3adcf96c8002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:32.129733 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d8f91a66-4d00-40f5-beaf-3adcf96c8002 None None] MFA Rules not processed for user `b3455d2a3c3d4d139544e88e7b04b0d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:39:32.131348 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d8f91a66-4d00-40f5-beaf-3adcf96c8002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:39:32.174250 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:32.219372 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1090/2149] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:39:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:39:37.686114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a1f0e-2ad1-4640-9f4e-e3f3ebb31f08 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:37.686608 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a1f0e-2ad1-4640-9f4e-e3f3ebb31f08 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:37.686723 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a1f0e-2ad1-4640-9f4e-e3f3ebb31f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:37.718198 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-a97a1f0e-2ad1-4640-9f4e-e3f3ebb31f08 None None] MFA Rules not processed for user `477a7c8335a5446d86d9a1812d88760b`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:39:37.719575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a97a1f0e-2ad1-4640-9f4e-e3f3ebb31f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:39:37.796851 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1060/2150] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:39:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:39:37.813068 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f91a66-4d00-40f5-beaf-3adcf96c8002 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:39:37.814508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d8f91a66-4d00-40f5-beaf-3adcf96c8002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:39:37.904303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f91a66-4d00-40f5-beaf-3adcf96c8002 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:39:37.910634 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b05e5a-d50e-449a-bbaf-c7cce53c9d5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:39:37.911408 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b05e5a-d50e-449a-bbaf-c7cce53c9d5e service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:37.911695 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b05e5a-d50e-449a-bbaf-c7cce53c9d5e service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:37.911970 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b05e5a-d50e-449a-bbaf-c7cce53c9d5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:37.982849 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b05e5a-d50e-449a-bbaf-c7cce53c9d5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:39:37.985004 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b05e5a-d50e-449a-bbaf-c7cce53c9d5e service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:39:37.995636 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1091/2151] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:39:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:39:39.358233 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daeaea-fd5f-4109-aa03-9e12dfe2c582 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:39.358716 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daeaea-fd5f-4109-aa03-9e12dfe2c582 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:39.358831 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daeaea-fd5f-4109-aa03-9e12dfe2c582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:39.379226 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-46daeaea-fd5f-4109-aa03-9e12dfe2c582 None None] MFA Rules not processed for user `05a08e72fd6b426699b47d178020560a`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:39:39.380553 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-46daeaea-fd5f-4109-aa03-9e12dfe2c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:39:39.387893 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1061/2152] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:39:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:39:39.739009 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720c343-2b97-4a50-bea1-c6645965262e None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:39:39.739518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720c343-2b97-4a50-bea1-c6645965262e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:39:39.740677 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720c343-2b97-4a50-bea1-c6645965262e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:39:39.763566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-2720c343-2b97-4a50-bea1-c6645965262e None None] MFA Rules not processed for user `274bdb52067d4788a0c628e6d900c2df`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:39:39.764981 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2720c343-2b97-4a50-bea1-c6645965262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:39:39.836594 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1092/2153] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:39:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:39:49.372620 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=74,keystone:INSERT=5 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:39:49.820378 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:04.541519 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46daeaea-fd5f-4109-aa03-9e12dfe2c582 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:04.617172 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46daeaea-fd5f-4109-aa03-9e12dfe2c582 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:04.621085 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708c762-1b1b-4022-a2d4-008253f36960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:04.621720 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708c762-1b1b-4022-a2d4-008253f36960 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:04.621999 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708c762-1b1b-4022-a2d4-008253f36960 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:04.622271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708c762-1b1b-4022-a2d4-008253f36960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:04.631318 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708c762-1b1b-4022-a2d4-008253f36960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:04.632735 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708c762-1b1b-4022-a2d4-008253f36960 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:04.643139 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1062/2154] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:40:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:40:14.638648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=26 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:28.831972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720c343-2b97-4a50-bea1-c6645965262e None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:28.833946 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2720c343-2b97-4a50-bea1-c6645965262e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:28.902721 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720c343-2b97-4a50-bea1-c6645965262e None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:28.907762 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed3e53-1b14-4bbe-aaac-56070c00172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:28.908469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed3e53-1b14-4bbe-aaac-56070c00172d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:28.908900 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed3e53-1b14-4bbe-aaac-56070c00172d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:28.909183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed3e53-1b14-4bbe-aaac-56070c00172d admin admin] PATH_INFO: `/v3/users/4019f657541a4c2ab6e6cdf2bb82a99e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:28.910416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed3e53-1b14-4bbe-aaac-56070c00172d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4019f657541a4c2ab6e6cdf2bb82a99e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:28.912339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed3e53-1b14-4bbe-aaac-56070c00172d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:28.960820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-11ed3e53-1b14-4bbe-aaac-56070c00172d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4019f657541a4c2ab6e6cdf2bb82a99e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:28.961487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-11ed3e53-1b14-4bbe-aaac-56070c00172d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4019f657541a4c2ab6e6cdf2bb82a99e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:28.968998 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-11ed3e53-1b14-4bbe-aaac-56070c00172d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4019f657541a4c2ab6e6cdf2bb82a99e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:28.982277 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-11ed3e53-1b14-4bbe-aaac-56070c00172d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4019f657541a4c2ab6e6cdf2bb82a99e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:28.983075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-11ed3e53-1b14-4bbe-aaac-56070c00172d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4019f657541a4c2ab6e6cdf2bb82a99e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:28.998622 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1093/2155] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:40:28 2022] DELETE /identity/v3/users/4019f657541a4c2ab6e6cdf2bb82a99e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:40:29.170139 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708c762-1b1b-4022-a2d4-008253f36960 service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:29.183684 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708c762-1b1b-4022-a2d4-008253f36960 service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:29.249354 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc42b7c-a5df-4dab-a4ba-3a62a4c87c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:29.250099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc42b7c-a5df-4dab-a4ba-3a62a4c87c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:29.250385 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc42b7c-a5df-4dab-a4ba-3a62a4c87c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:29.250661 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc42b7c-a5df-4dab-a4ba-3a62a4c87c30 admin admin] PATH_INFO: `/v3/projects/a6b5308342dc4c809406290d79bccfe9` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:29.251841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc42b7c-a5df-4dab-a4ba-3a62a4c87c30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b5308342dc4c809406290d79bccfe9)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:29.253869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc42b7c-a5df-4dab-a4ba-3a62a4c87c30 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:29.314157 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5fc42b7c-a5df-4dab-a4ba-3a62a4c87c30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b5308342dc4c809406290d79bccfe9', 'request_id': 'req-5fc42b7c-a5df-4dab-a4ba-3a62a4c87c30'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:29.322134 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5fc42b7c-a5df-4dab-a4ba-3a62a4c87c30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b5308342dc4c809406290d79bccfe9', 'request_id': 'req-5fc42b7c-a5df-4dab-a4ba-3a62a4c87c30'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:29.328305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5fc42b7c-a5df-4dab-a4ba-3a62a4c87c30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b5308342dc4c809406290d79bccfe9', 'request_id': 'req-5fc42b7c-a5df-4dab-a4ba-3a62a4c87c30'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:29.347713 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5fc42b7c-a5df-4dab-a4ba-3a62a4c87c30 admin admin] The token cache is being invalidate because project a6b5308342dc4c809406290d79bccfe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:40:29.348005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5fc42b7c-a5df-4dab-a4ba-3a62a4c87c30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:29.348779 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5fc42b7c-a5df-4dab-a4ba-3a62a4c87c30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:29.350280 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1063/2156] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:40:29 2022] DELETE /identity/v3/projects/a6b5308342dc4c809406290d79bccfe9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:40:29.355792 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a526f46-1d56-4935-85ac-604f6738e29e None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:29.356080 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a526f46-1d56-4935-85ac-604f6738e29e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:29.356385 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a526f46-1d56-4935-85ac-604f6738e29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:29.377034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-8a526f46-1d56-4935-85ac-604f6738e29e None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:40:29.378249 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8a526f46-1d56-4935-85ac-604f6738e29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:29.438557 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1094/2157] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:40:29.446296 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d9915-913f-4307-b0f4-37fd5eaf3ef4 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:29.446578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d9915-913f-4307-b0f4-37fd5eaf3ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:29.446852 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d9915-913f-4307-b0f4-37fd5eaf3ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:29.467202 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-fd0d9915-913f-4307-b0f4-37fd5eaf3ef4 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:40:29.468397 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-fd0d9915-913f-4307-b0f4-37fd5eaf3ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:29.476323 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1064/2158] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:40:29.481078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a526f46-1d56-4935-85ac-604f6738e29e None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:29.491128 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a526f46-1d56-4935-85ac-604f6738e29e None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:29.496049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533eb8a0-d35c-4073-9ffb-cdba9e11e4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:29.496912 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eb8a0-d35c-4073-9ffb-cdba9e11e4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:29.497228 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eb8a0-d35c-4073-9ffb-cdba9e11e4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:29.497510 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eb8a0-d35c-4073-9ffb-cdba9e11e4c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:29.498157 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533eb8a0-d35c-4073-9ffb-cdba9e11e4c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:40:29.498457 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533eb8a0-d35c-4073-9ffb-cdba9e11e4c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:29.500093 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533eb8a0-d35c-4073-9ffb-cdba9e11e4c9 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:29.511859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1095/2159] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:40:29.516255 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d9915-913f-4307-b0f4-37fd5eaf3ef4 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:29.525946 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d9915-913f-4307-b0f4-37fd5eaf3ef4 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:29.531420 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5bf72-25cb-464d-be02-3f411327550e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:29.532021 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5bf72-25cb-464d-be02-3f411327550e admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:29.532297 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5bf72-25cb-464d-be02-3f411327550e admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:29.532563 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5bf72-25cb-464d-be02-3f411327550e admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:29.533216 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5bf72-25cb-464d-be02-3f411327550e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:29.535317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5bf72-25cb-464d-be02-3f411327550e admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:29.564837 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1065/2160] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:40:29 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:40:29.568990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533eb8a0-d35c-4073-9ffb-cdba9e11e4c9 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:29.579663 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533eb8a0-d35c-4073-9ffb-cdba9e11e4c9 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:29.583541 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:29.640184 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e7e10-ae15-493d-be52-7dbcaedf9543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:29.640785 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7e10-ae15-493d-be52-7dbcaedf9543 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:29.641061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7e10-ae15-493d-be52-7dbcaedf9543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:29.641331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e7e10-ae15-493d-be52-7dbcaedf9543 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:29.641958 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e7e10-ae15-493d-be52-7dbcaedf9543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:29.643880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e7e10-ae15-493d-be52-7dbcaedf9543 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:29.664640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1096/2161] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:40:29 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:40:29.669001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5bf72-25cb-464d-be02-3f411327550e admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:29.679026 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5bf72-25cb-464d-be02-3f411327550e admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:29.684402 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647720fa-0f85-4f3c-9d64-c8aa25ed6294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:29.685013 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647720fa-0f85-4f3c-9d64-c8aa25ed6294 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:29.685291 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647720fa-0f85-4f3c-9d64-c8aa25ed6294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:29.685575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647720fa-0f85-4f3c-9d64-c8aa25ed6294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:29.686302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647720fa-0f85-4f3c-9d64-c8aa25ed6294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:29.687929 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647720fa-0f85-4f3c-9d64-c8aa25ed6294 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:29.698036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1066/2162] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:40:29.702237 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e7e10-ae15-493d-be52-7dbcaedf9543 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:29.712338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e7e10-ae15-493d-be52-7dbcaedf9543 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:29.717782 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d8165-1dd4-4fdc-97c3-41aff10f43a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:29.718437 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d8165-1dd4-4fdc-97c3-41aff10f43a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:29.718831 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d8165-1dd4-4fdc-97c3-41aff10f43a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:29.719019 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d8165-1dd4-4fdc-97c3-41aff10f43a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:29.719658 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d8165-1dd4-4fdc-97c3-41aff10f43a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:29.721288 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d8165-1dd4-4fdc-97c3-41aff10f43a9 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:29.731894 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1097/2163] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:40:29.736165 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647720fa-0f85-4f3c-9d64-c8aa25ed6294 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:29.746602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647720fa-0f85-4f3c-9d64-c8aa25ed6294 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:29.751346 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa973c6-554d-4b2b-81b8-b0cb76ec9e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:29.751996 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa973c6-554d-4b2b-81b8-b0cb76ec9e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:29.752277 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa973c6-554d-4b2b-81b8-b0cb76ec9e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:29.752554 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa973c6-554d-4b2b-81b8-b0cb76ec9e45 admin admin] PATH_INFO: `/v3/projects/95a0fa8aa4bd45d2a62778c6d32490bd/users/0a2ac1496c0b410e96d13e7e0a8b51c3/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:29.767640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa973c6-554d-4b2b-81b8-b0cb76ec9e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a0fa8aa4bd45d2a62778c6d32490bd, user_id=0a2ac1496c0b410e96d13e7e0a8b51c3, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:29.770316 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa973c6-554d-4b2b-81b8-b0cb76ec9e45 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:29.783130 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1067/2164] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:40:29 2022] PUT /identity/v3/projects/95a0fa8aa4bd45d2a62778c6d32490bd/users/0a2ac1496c0b410e96d13e7e0a8b51c3/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:40:29.788120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb0e06-0ea3-4815-b0b0-67f542897d08 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:29.788403 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb0e06-0ea3-4815-b0b0-67f542897d08 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:29.788676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb0e06-0ea3-4815-b0b0-67f542897d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:29.807333 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-24eb0e06-0ea3-4815-b0b0-67f542897d08 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:40:29.809119 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-24eb0e06-0ea3-4815-b0b0-67f542897d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:29.867039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1098/2165] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:40:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:40:29.877285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa973c6-554d-4b2b-81b8-b0cb76ec9e45 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:29.879059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9fa973c6-554d-4b2b-81b8-b0cb76ec9e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:29.909120 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:29.938033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa973c6-554d-4b2b-81b8-b0cb76ec9e45 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:29.943086 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23df22-8b46-453b-b368-bba4b80973cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:29.943684 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23df22-8b46-453b-b368-bba4b80973cd service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:29.943960 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23df22-8b46-453b-b368-bba4b80973cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:29.944231 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23df22-8b46-453b-b368-bba4b80973cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:29.953252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23df22-8b46-453b-b368-bba4b80973cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:29.954611 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23df22-8b46-453b-b368-bba4b80973cd service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:29.963968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1068/2166] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:40:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:40:34.206664 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b053e2-7e89-446d-a35a-c81814c12d0c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:34.207586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b053e2-7e89-446d-a35a-c81814c12d0c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:34.207874 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b053e2-7e89-446d-a35a-c81814c12d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:34.238843 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-53b053e2-7e89-446d-a35a-c81814c12d0c None None] MFA Rules not processed for user `0a2ac1496c0b410e96d13e7e0a8b51c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:40:34.240114 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-53b053e2-7e89-446d-a35a-c81814c12d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:34.332294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1099/2167] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:40:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:40:34.347416 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23df22-8b46-453b-b368-bba4b80973cd service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:34.348885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-cf23df22-8b46-453b-b368-bba4b80973cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:34.441408 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23df22-8b46-453b-b368-bba4b80973cd service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:34.447038 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bc989-904e-4b69-b6bc-901f6bcef0ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:34.447684 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc989-904e-4b69-b6bc-901f6bcef0ef service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:34.447970 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc989-904e-4b69-b6bc-901f6bcef0ef service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:34.448273 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc989-904e-4b69-b6bc-901f6bcef0ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:34.457228 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bc989-904e-4b69-b6bc-901f6bcef0ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:34.458856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bc989-904e-4b69-b6bc-901f6bcef0ef service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:34.468842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1069/2168] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:40:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:40:35.127496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b053e2-7e89-446d-a35a-c81814c12d0c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:35.141634 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b053e2-7e89-446d-a35a-c81814c12d0c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:35.145916 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2e8e9-e81a-441a-ae55-7e22fc764cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:35.146527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2e8e9-e81a-441a-ae55-7e22fc764cec service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:35.146801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2e8e9-e81a-441a-ae55-7e22fc764cec service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:35.147120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee2e8e9-e81a-441a-ae55-7e22fc764cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:35.153939 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-cee2e8e9-e81a-441a-ae55-7e22fc764cec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:35.185903 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2e8e9-e81a-441a-ae55-7e22fc764cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:35.187388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee2e8e9-e81a-441a-ae55-7e22fc764cec service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:35.208178 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1100/2169] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:40:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:40:36.045540 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1b0e0-9678-42fd-84c9-0951ad1a1766 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:36.046022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1b0e0-9678-42fd-84c9-0951ad1a1766 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:36.046156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1b0e0-9678-42fd-84c9-0951ad1a1766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:36.065272 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-92b1b0e0-9678-42fd-84c9-0951ad1a1766 None None] MFA Rules not processed for user `0a2ac1496c0b410e96d13e7e0a8b51c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:40:36.066476 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-92b1b0e0-9678-42fd-84c9-0951ad1a1766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:36.073308 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1070/2170] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:40:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:40:36.110704 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2e8e9-e81a-441a-ae55-7e22fc764cec service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:36.112104 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-cee2e8e9-e81a-441a-ae55-7e22fc764cec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:36.116924 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:36.170252 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee2e8e9-e81a-441a-ae55-7e22fc764cec service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:36.173812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f6895-d2a1-40cc-a24a-275ebd52e142 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d026ec6ed344404a5ebe4352792cc1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:36.174409 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f6895-d2a1-40cc-a24a-275ebd52e142 service glance] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:36.174686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f6895-d2a1-40cc-a24a-275ebd52e142 service glance] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:36.174971 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f6895-d2a1-40cc-a24a-275ebd52e142 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:36.176703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c75f6895-d2a1-40cc-a24a-275ebd52e142 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:36.191790 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f6895-d2a1-40cc-a24a-275ebd52e142 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:36.193208 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f6895-d2a1-40cc-a24a-275ebd52e142 service glance] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:36.204648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1101/2171] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:40:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:40:42.617234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebac133-5046-4d6c-bcb8-ad6f1acd6eba None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:42.617668 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebac133-5046-4d6c-bcb8-ad6f1acd6eba None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:42.617824 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebac133-5046-4d6c-bcb8-ad6f1acd6eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:42.637830 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-2ebac133-5046-4d6c-bcb8-ad6f1acd6eba None None] MFA Rules not processed for user `b3455d2a3c3d4d139544e88e7b04b0d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:40:42.639141 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-2ebac133-5046-4d6c-bcb8-ad6f1acd6eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:42.697784 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1071/2172] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:40:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:40:46.199584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=25 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:50.464367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f6895-d2a1-40cc-a24a-275ebd52e142 service glance] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:50.466072 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c75f6895-d2a1-40cc-a24a-275ebd52e142 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:50.528054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f6895-d2a1-40cc-a24a-275ebd52e142 service glance] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:50.531708 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d1bea-85c4-46de-acda-b7b451d29913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:50.532327 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d1bea-85c4-46de-acda-b7b451d29913 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:50.532613 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d1bea-85c4-46de-acda-b7b451d29913 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:50.532889 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d1bea-85c4-46de-acda-b7b451d29913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:50.534623 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-591d1bea-85c4-46de-acda-b7b451d29913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:50.597819 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d1bea-85c4-46de-acda-b7b451d29913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:50.599286 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d1bea-85c4-46de-acda-b7b451d29913 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:50.609031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1102/2173] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:40:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:40:52.691082 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=76 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:53.077765 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebac133-5046-4d6c-bcb8-ad6f1acd6eba None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:53.087336 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebac133-5046-4d6c-bcb8-ad6f1acd6eba None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:53.091148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484d38c-d8ef-4f54-b61a-21fb64b9188e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:53.091750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484d38c-d8ef-4f54-b61a-21fb64b9188e service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:53.092032 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484d38c-d8ef-4f54-b61a-21fb64b9188e service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:53.092308 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f484d38c-d8ef-4f54-b61a-21fb64b9188e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:53.094022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-f484d38c-d8ef-4f54-b61a-21fb64b9188e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:53.106259 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484d38c-d8ef-4f54-b61a-21fb64b9188e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:53.107762 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f484d38c-d8ef-4f54-b61a-21fb64b9188e service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:53.117209 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1072/2174] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:40:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:40:56.273134 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d1bea-85c4-46de-acda-b7b451d29913 service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:56.275351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-591d1bea-85c4-46de-acda-b7b451d29913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:56.298006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d1bea-85c4-46de-acda-b7b451d29913 service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:56.310584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fd70c-1018-48cc-aca7-bebd58ccf523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:56.311503 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fd70c-1018-48cc-aca7-bebd58ccf523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:56.311971 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fd70c-1018-48cc-aca7-bebd58ccf523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:56.312413 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fd70c-1018-48cc-aca7-bebd58ccf523 admin admin] PATH_INFO: `/v3/users/274bdb52067d4788a0c628e6d900c2df` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:56.313898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fd70c-1018-48cc-aca7-bebd58ccf523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=274bdb52067d4788a0c628e6d900c2df)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:56.316124 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fd70c-1018-48cc-aca7-bebd58ccf523 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:56.376066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-2d9fd70c-1018-48cc-aca7-bebd58ccf523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '274bdb52067d4788a0c628e6d900c2df'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:56.376842 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-2d9fd70c-1018-48cc-aca7-bebd58ccf523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '274bdb52067d4788a0c628e6d900c2df'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:56.385546 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-2d9fd70c-1018-48cc-aca7-bebd58ccf523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '274bdb52067d4788a0c628e6d900c2df'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:56.403149 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-2d9fd70c-1018-48cc-aca7-bebd58ccf523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '274bdb52067d4788a0c628e6d900c2df'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:56.404191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-2d9fd70c-1018-48cc-aca7-bebd58ccf523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '274bdb52067d4788a0c628e6d900c2df'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:56.420612 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1103/2175] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:40:56 2022] DELETE /identity/v3/users/274bdb52067d4788a0c628e6d900c2df => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:40:56.614877 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484d38c-d8ef-4f54-b61a-21fb64b9188e service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:56.633073 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f484d38c-d8ef-4f54-b61a-21fb64b9188e service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:56.714615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d2c4b-a640-4725-9f77-6f98ffc80142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:56.715302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d2c4b-a640-4725-9f77-6f98ffc80142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:56.715587 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d2c4b-a640-4725-9f77-6f98ffc80142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:56.715872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d2c4b-a640-4725-9f77-6f98ffc80142 admin admin] PATH_INFO: `/v3/projects/066aae5e3d3f4e6fbc2e750a2248a7fb` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:56.717039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d2c4b-a640-4725-9f77-6f98ffc80142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=066aae5e3d3f4e6fbc2e750a2248a7fb)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:56.718982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d2c4b-a640-4725-9f77-6f98ffc80142 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:56.777584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b01d2c4b-a640-4725-9f77-6f98ffc80142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '066aae5e3d3f4e6fbc2e750a2248a7fb', 'request_id': 'req-b01d2c4b-a640-4725-9f77-6f98ffc80142'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:56.784532 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b01d2c4b-a640-4725-9f77-6f98ffc80142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '066aae5e3d3f4e6fbc2e750a2248a7fb', 'request_id': 'req-b01d2c4b-a640-4725-9f77-6f98ffc80142'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:56.793255 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b01d2c4b-a640-4725-9f77-6f98ffc80142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '066aae5e3d3f4e6fbc2e750a2248a7fb', 'request_id': 'req-b01d2c4b-a640-4725-9f77-6f98ffc80142'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:56.808687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b01d2c4b-a640-4725-9f77-6f98ffc80142 admin admin] The token cache is being invalidate because project 066aae5e3d3f4e6fbc2e750a2248a7fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:40:56.808957 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b01d2c4b-a640-4725-9f77-6f98ffc80142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:56.809708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b01d2c4b-a640-4725-9f77-6f98ffc80142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:40:56.811529 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1073/2176] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:40:56 2022] DELETE /identity/v3/projects/066aae5e3d3f4e6fbc2e750a2248a7fb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:40:56.816551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda77a3-b7c1-4761-8ce9-bfb040e1d310 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:56.817644 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda77a3-b7c1-4761-8ce9-bfb040e1d310 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:56.818240 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda77a3-b7c1-4761-8ce9-bfb040e1d310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:56.840481 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ddda77a3-b7c1-4761-8ce9-bfb040e1d310 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:40:56.841969 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ddda77a3-b7c1-4761-8ce9-bfb040e1d310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:56.866260 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:56.924373 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1104/2177] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:40:56.932455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68037fe-dbb4-4748-bb47-2385d21bcdd2 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:56.933031 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68037fe-dbb4-4748-bb47-2385d21bcdd2 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:56.933496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68037fe-dbb4-4748-bb47-2385d21bcdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:56.955990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-f68037fe-dbb4-4748-bb47-2385d21bcdd2 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:40:56.957345 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-f68037fe-dbb4-4748-bb47-2385d21bcdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:56.968270 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1074/2178] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:40:56.972469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda77a3-b7c1-4761-8ce9-bfb040e1d310 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:56.983515 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda77a3-b7c1-4761-8ce9-bfb040e1d310 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:56.988864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cb0f1-eb22-4d3c-96d5-67d6e900b823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:56.989568 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cb0f1-eb22-4d3c-96d5-67d6e900b823 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:56.989850 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cb0f1-eb22-4d3c-96d5-67d6e900b823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:56.990131 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cb0f1-eb22-4d3c-96d5-67d6e900b823 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:56.990763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cb0f1-eb22-4d3c-96d5-67d6e900b823 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:40:56.991107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cb0f1-eb22-4d3c-96d5-67d6e900b823 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:56.992747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cb0f1-eb22-4d3c-96d5-67d6e900b823 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:57.006659 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1105/2179] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:40:57.010709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68037fe-dbb4-4748-bb47-2385d21bcdd2 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:57.020431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68037fe-dbb4-4748-bb47-2385d21bcdd2 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:57.025681 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4982c19-219b-48ad-bb2e-5ec9d5773add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:57.026360 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4982c19-219b-48ad-bb2e-5ec9d5773add admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:57.026761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4982c19-219b-48ad-bb2e-5ec9d5773add admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:57.027183 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4982c19-219b-48ad-bb2e-5ec9d5773add admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:57.027843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4982c19-219b-48ad-bb2e-5ec9d5773add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:57.029758 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4982c19-219b-48ad-bb2e-5ec9d5773add admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:57.081572 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1075/2180] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:40:57 2022] POST /identity/v3/projects => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:40:57.085800 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cb0f1-eb22-4d3c-96d5-67d6e900b823 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:57.095990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cb0f1-eb22-4d3c-96d5-67d6e900b823 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:57.154310 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad129551-22f3-4747-9b91-56a36861c042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:57.154931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad129551-22f3-4747-9b91-56a36861c042 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:57.155240 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad129551-22f3-4747-9b91-56a36861c042 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:57.155504 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad129551-22f3-4747-9b91-56a36861c042 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:57.156148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad129551-22f3-4747-9b91-56a36861c042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:57.158192 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad129551-22f3-4747-9b91-56a36861c042 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:57.182352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1106/2181] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:40:57 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:40:57.186445 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4982c19-219b-48ad-bb2e-5ec9d5773add admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:57.196938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4982c19-219b-48ad-bb2e-5ec9d5773add admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:57.202141 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50619b-ad27-4fb0-8b68-d2aee75b41bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:57.202764 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50619b-ad27-4fb0-8b68-d2aee75b41bc admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:57.203076 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50619b-ad27-4fb0-8b68-d2aee75b41bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:57.203375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50619b-ad27-4fb0-8b68-d2aee75b41bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:57.204027 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50619b-ad27-4fb0-8b68-d2aee75b41bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:57.205687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50619b-ad27-4fb0-8b68-d2aee75b41bc admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:57.217337 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1076/2182] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:40:57.221450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad129551-22f3-4747-9b91-56a36861c042 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:57.231969 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad129551-22f3-4747-9b91-56a36861c042 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:57.236722 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f717f-f4aa-4521-9b74-001c6b0873e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:57.237327 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f717f-f4aa-4521-9b74-001c6b0873e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:57.237601 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f717f-f4aa-4521-9b74-001c6b0873e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:57.237870 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f717f-f4aa-4521-9b74-001c6b0873e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:57.238505 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f717f-f4aa-4521-9b74-001c6b0873e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:57.240147 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f717f-f4aa-4521-9b74-001c6b0873e7 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:57.252065 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1107/2183] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:40:57.257797 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50619b-ad27-4fb0-8b68-d2aee75b41bc admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:57.269561 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50619b-ad27-4fb0-8b68-d2aee75b41bc admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:57.274325 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb84a43-010c-47d8-a35f-0c1ed4f62cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:57.275017 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb84a43-010c-47d8-a35f-0c1ed4f62cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:57.275302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb84a43-010c-47d8-a35f-0c1ed4f62cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:57.275575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb84a43-010c-47d8-a35f-0c1ed4f62cc5 admin admin] PATH_INFO: `/v3/projects/9339e87fcd4b41cbb2151f573579283c/users/3526887396bd40f281a963347a85116a/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:57.291728 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb84a43-010c-47d8-a35f-0c1ed4f62cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9339e87fcd4b41cbb2151f573579283c, user_id=3526887396bd40f281a963347a85116a, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:57.294467 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb84a43-010c-47d8-a35f-0c1ed4f62cc5 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:57.309383 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1077/2184] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:40:57 2022] PUT /identity/v3/projects/9339e87fcd4b41cbb2151f573579283c/users/3526887396bd40f281a963347a85116a/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:40:57.321078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76d41a-ec39-4e0f-a5a4-613e1e4036e5 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:57.321635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76d41a-ec39-4e0f-a5a4-613e1e4036e5 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:57.321635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76d41a-ec39-4e0f-a5a4-613e1e4036e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:57.354001 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0f76d41a-ec39-4e0f-a5a4-613e1e4036e5 None None] MFA Rules not processed for user `3526887396bd40f281a963347a85116a`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:40:57.355554 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0f76d41a-ec39-4e0f-a5a4-613e1e4036e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:57.423576 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1108/2185] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:40:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:40:57.428195 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb84a43-010c-47d8-a35f-0c1ed4f62cc5 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:57.442883 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:57.498451 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb84a43-010c-47d8-a35f-0c1ed4f62cc5 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:57.503433 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41397bd6-0e2c-4735-8dee-10b9d806e25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:57.504049 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41397bd6-0e2c-4735-8dee-10b9d806e25e admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:57.504323 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41397bd6-0e2c-4735-8dee-10b9d806e25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:57.504595 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41397bd6-0e2c-4735-8dee-10b9d806e25e admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:57.505238 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41397bd6-0e2c-4735-8dee-10b9d806e25e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:57.507181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41397bd6-0e2c-4735-8dee-10b9d806e25e admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:57.535020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1078/2186] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:40:57 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:40:57.539061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76d41a-ec39-4e0f-a5a4-613e1e4036e5 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:57.549838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76d41a-ec39-4e0f-a5a4-613e1e4036e5 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:57.569395 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:57.609245 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d621a-80cb-4119-b34a-f2c09470cb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:57.609880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d621a-80cb-4119-b34a-f2c09470cb40 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:57.610155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d621a-80cb-4119-b34a-f2c09470cb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:57.610541 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d621a-80cb-4119-b34a-f2c09470cb40 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:57.611196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d621a-80cb-4119-b34a-f2c09470cb40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:57.613095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d621a-80cb-4119-b34a-f2c09470cb40 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:57.635901 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1109/2187] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:40:57 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:40:57.639876 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41397bd6-0e2c-4735-8dee-10b9d806e25e admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:57.650028 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41397bd6-0e2c-4735-8dee-10b9d806e25e admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:57.654703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8caacd7-2526-48a9-9ede-f5a7a6afe763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:57.655331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caacd7-2526-48a9-9ede-f5a7a6afe763 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:57.655602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caacd7-2526-48a9-9ede-f5a7a6afe763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:57.655917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8caacd7-2526-48a9-9ede-f5a7a6afe763 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:57.656501 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8caacd7-2526-48a9-9ede-f5a7a6afe763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:57.658075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8caacd7-2526-48a9-9ede-f5a7a6afe763 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:57.669084 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1079/2188] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:40:57.673321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d621a-80cb-4119-b34a-f2c09470cb40 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:57.684204 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d621a-80cb-4119-b34a-f2c09470cb40 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:57.688848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db7fc5-b47a-4be2-8af2-28e27fbb1d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:57.689512 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db7fc5-b47a-4be2-8af2-28e27fbb1d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:57.689810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db7fc5-b47a-4be2-8af2-28e27fbb1d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:57.690092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69db7fc5-b47a-4be2-8af2-28e27fbb1d52 admin admin] PATH_INFO: `/v3/projects/1da2eddab22c4571bb352ffa8e1e07bb/users/0d0543968d57405d96c87dd6b455475c/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:57.705457 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db7fc5-b47a-4be2-8af2-28e27fbb1d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da2eddab22c4571bb352ffa8e1e07bb, user_id=0d0543968d57405d96c87dd6b455475c, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:57.708169 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69db7fc5-b47a-4be2-8af2-28e27fbb1d52 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:57.720788 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1110/2189] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:40:57 2022] PUT /identity/v3/projects/1da2eddab22c4571bb352ffa8e1e07bb/users/0d0543968d57405d96c87dd6b455475c/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:40:57.724764 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8caacd7-2526-48a9-9ede-f5a7a6afe763 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:57.735165 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8caacd7-2526-48a9-9ede-f5a7a6afe763 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:57.789580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9aa3bb-f5f3-4e52-89a9-29566c63c2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:57.790174 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aa3bb-f5f3-4e52-89a9-29566c63c2ff admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:57.790451 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aa3bb-f5f3-4e52-89a9-29566c63c2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:57.790719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9aa3bb-f5f3-4e52-89a9-29566c63c2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:57.791383 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9aa3bb-f5f3-4e52-89a9-29566c63c2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:57.793658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9aa3bb-f5f3-4e52-89a9-29566c63c2ff admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:57.803155 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1080/2190] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:40:57.808247 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db7fc5-b47a-4be2-8af2-28e27fbb1d52 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:57.818696 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69db7fc5-b47a-4be2-8af2-28e27fbb1d52 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:57.823396 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88288b-614f-41c4-a995-9a52c16fbf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:57.824047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88288b-614f-41c4-a995-9a52c16fbf9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:57.824330 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88288b-614f-41c4-a995-9a52c16fbf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:57.824606 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88288b-614f-41c4-a995-9a52c16fbf9b admin admin] PATH_INFO: `/v3/projects/1da2eddab22c4571bb352ffa8e1e07bb/users/0d0543968d57405d96c87dd6b455475c/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:57.826566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88288b-614f-41c4-a995-9a52c16fbf9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da2eddab22c4571bb352ffa8e1e07bb, user_id=0d0543968d57405d96c87dd6b455475c, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:57.829242 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88288b-614f-41c4-a995-9a52c16fbf9b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:57.839549 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1111/2191] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:40:57 2022] PUT /identity/v3/projects/1da2eddab22c4571bb352ffa8e1e07bb/users/0d0543968d57405d96c87dd6b455475c/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:40:57.849759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cf8d8-efc8-4967-90cd-e6ab2de80986 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:57.850050 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cf8d8-efc8-4967-90cd-e6ab2de80986 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:57.850327 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3cf8d8-efc8-4967-90cd-e6ab2de80986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:57.879825 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-ed3cf8d8-efc8-4967-90cd-e6ab2de80986 None None] MFA Rules not processed for user `0d0543968d57405d96c87dd6b455475c`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:40:57.881058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-ed3cf8d8-efc8-4967-90cd-e6ab2de80986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:57.948737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1081/2192] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:40:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:40:57.959659 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88288b-614f-41c4-a995-9a52c16fbf9b admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:57.961384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ef88288b-614f-41c4-a995-9a52c16fbf9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:58.017602 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88288b-614f-41c4-a995-9a52c16fbf9b admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:58.021200 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583106f-2b6c-48b2-b452-8d498c8bdaa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:58.021790 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583106f-2b6c-48b2-b452-8d498c8bdaa9 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:58.022064 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583106f-2b6c-48b2-b452-8d498c8bdaa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:58.022335 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583106f-2b6c-48b2-b452-8d498c8bdaa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:58.031744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583106f-2b6c-48b2-b452-8d498c8bdaa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:58.033141 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583106f-2b6c-48b2-b452-8d498c8bdaa9 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:58.042861 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1112/2193] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:40:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:40:58.087411 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cf8d8-efc8-4967-90cd-e6ab2de80986 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:40:58.089345 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-ed3cf8d8-efc8-4967-90cd-e6ab2de80986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:40:58.101114 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3cf8d8-efc8-4967-90cd-e6ab2de80986 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:40:58.105226 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b1253-707f-48cc-bcc6-665b263f14b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:40:58.105818 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b1253-707f-48cc-bcc6-665b263f14b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:40:58.106095 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b1253-707f-48cc-bcc6-665b263f14b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:40:58.106363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b1253-707f-48cc-bcc6-665b263f14b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:40:58.111478 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:40:58.163765 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b1253-707f-48cc-bcc6-665b263f14b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:40:58.165218 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b1253-707f-48cc-bcc6-665b263f14b1 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:40:58.174253 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1082/2194] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:40:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:01.462794 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583106f-2b6c-48b2-b452-8d498c8bdaa9 service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:01.524564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583106f-2b6c-48b2-b452-8d498c8bdaa9 service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:01.529285 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fadc0-a7fc-4e8c-9651-8ab02c2b16bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:01.529913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fadc0-a7fc-4e8c-9651-8ab02c2b16bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:01.530195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fadc0-a7fc-4e8c-9651-8ab02c2b16bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:01.530472 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fadc0-a7fc-4e8c-9651-8ab02c2b16bf admin admin] PATH_INFO: `/v3/users/3526887396bd40f281a963347a85116a` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:01.531618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fadc0-a7fc-4e8c-9651-8ab02c2b16bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3526887396bd40f281a963347a85116a)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:01.533554 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fadc0-a7fc-4e8c-9651-8ab02c2b16bf admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:01.554789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:01.580897 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b58fadc0-a7fc-4e8c-9651-8ab02c2b16bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3526887396bd40f281a963347a85116a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:01.581542 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b58fadc0-a7fc-4e8c-9651-8ab02c2b16bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3526887396bd40f281a963347a85116a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:01.588312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b58fadc0-a7fc-4e8c-9651-8ab02c2b16bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3526887396bd40f281a963347a85116a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:01.599972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b58fadc0-a7fc-4e8c-9651-8ab02c2b16bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3526887396bd40f281a963347a85116a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:01.600594 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-b58fadc0-a7fc-4e8c-9651-8ab02c2b16bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3526887396bd40f281a963347a85116a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:01.612812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1113/2195] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:41:01 2022] DELETE /identity/v3/users/3526887396bd40f281a963347a85116a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:01.617346 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b48d8-6a14-4df3-ab71-743180bdaab4 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:01.617832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b48d8-6a14-4df3-ab71-743180bdaab4 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:01.617832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b48d8-6a14-4df3-ab71-743180bdaab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:01.637447 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-607b48d8-6a14-4df3-ab71-743180bdaab4 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:01.638642 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-607b48d8-6a14-4df3-ab71-743180bdaab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:01.697047 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1083/2196] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:01.706713 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fadc0-a7fc-4e8c-9651-8ab02c2b16bf admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:01.708180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b58fadc0-a7fc-4e8c-9651-8ab02c2b16bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:01.765373 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fadc0-a7fc-4e8c-9651-8ab02c2b16bf admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:01.769095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f52113-9c8c-46b1-85ba-d8360dea5b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:01.769724 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f52113-9c8c-46b1-85ba-d8360dea5b47 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:01.770008 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f52113-9c8c-46b1-85ba-d8360dea5b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:01.770286 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f52113-9c8c-46b1-85ba-d8360dea5b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:01.779685 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f52113-9c8c-46b1-85ba-d8360dea5b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:01.781104 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f52113-9c8c-46b1-85ba-d8360dea5b47 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:01.790536 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1114/2197] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:02.062358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b48d8-6a14-4df3-ab71-743180bdaab4 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:02.063827 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-607b48d8-6a14-4df3-ab71-743180bdaab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:02.076276 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b48d8-6a14-4df3-ab71-743180bdaab4 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:02.080853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d87fb1-265b-45ae-9f1e-693b34476f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:02.081483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d87fb1-265b-45ae-9f1e-693b34476f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:02.081775 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d87fb1-265b-45ae-9f1e-693b34476f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:02.082030 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d87fb1-265b-45ae-9f1e-693b34476f36 admin admin] PATH_INFO: `/v3/projects/9339e87fcd4b41cbb2151f573579283c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:02.083227 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d87fb1-265b-45ae-9f1e-693b34476f36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9339e87fcd4b41cbb2151f573579283c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:02.085136 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d87fb1-265b-45ae-9f1e-693b34476f36 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:02.130733 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b9d87fb1-265b-45ae-9f1e-693b34476f36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9339e87fcd4b41cbb2151f573579283c', 'request_id': 'req-b9d87fb1-265b-45ae-9f1e-693b34476f36'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:02.137302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b9d87fb1-265b-45ae-9f1e-693b34476f36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9339e87fcd4b41cbb2151f573579283c', 'request_id': 'req-b9d87fb1-265b-45ae-9f1e-693b34476f36'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:02.142781 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b9d87fb1-265b-45ae-9f1e-693b34476f36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9339e87fcd4b41cbb2151f573579283c', 'request_id': 'req-b9d87fb1-265b-45ae-9f1e-693b34476f36'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:02.155615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b9d87fb1-265b-45ae-9f1e-693b34476f36 admin admin] The token cache is being invalidate because project 9339e87fcd4b41cbb2151f573579283c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:41:02.155909 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b9d87fb1-265b-45ae-9f1e-693b34476f36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:02.156553 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b9d87fb1-265b-45ae-9f1e-693b34476f36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:02.158110 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1084/2198] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:41:02 2022] DELETE /identity/v3/projects/9339e87fcd4b41cbb2151f573579283c => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:02.162131 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f52113-9c8c-46b1-85ba-d8360dea5b47 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:02.172260 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f52113-9c8c-46b1-85ba-d8360dea5b47 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:02.227558 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e696d1-a8e7-4122-90fd-a315ea448083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:02.228186 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e696d1-a8e7-4122-90fd-a315ea448083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:02.228466 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e696d1-a8e7-4122-90fd-a315ea448083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:02.228739 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e696d1-a8e7-4122-90fd-a315ea448083 admin admin] PATH_INFO: `/v3/users/0d0543968d57405d96c87dd6b455475c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:02.229871 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e696d1-a8e7-4122-90fd-a315ea448083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d0543968d57405d96c87dd6b455475c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:02.231806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e696d1-a8e7-4122-90fd-a315ea448083 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:02.273121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:02.278924 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-33e696d1-a8e7-4122-90fd-a315ea448083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d0543968d57405d96c87dd6b455475c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:02.279692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-33e696d1-a8e7-4122-90fd-a315ea448083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d0543968d57405d96c87dd6b455475c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:02.287602 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-33e696d1-a8e7-4122-90fd-a315ea448083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d0543968d57405d96c87dd6b455475c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:02.298989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-33e696d1-a8e7-4122-90fd-a315ea448083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d0543968d57405d96c87dd6b455475c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:02.299638 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-33e696d1-a8e7-4122-90fd-a315ea448083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d0543968d57405d96c87dd6b455475c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:02.311962 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1115/2199] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:41:02 2022] DELETE /identity/v3/users/0d0543968d57405d96c87dd6b455475c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:41:02.580961 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d87fb1-265b-45ae-9f1e-693b34476f36 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:02.582431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b9d87fb1-265b-45ae-9f1e-693b34476f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:02.595265 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d87fb1-265b-45ae-9f1e-693b34476f36 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:02.628407 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:02.658851 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe744c-2bec-4300-88d6-2dae8467a76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:02.659514 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe744c-2bec-4300-88d6-2dae8467a76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:02.659849 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe744c-2bec-4300-88d6-2dae8467a76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:02.660075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe744c-2bec-4300-88d6-2dae8467a76e admin admin] PATH_INFO: `/v3/projects/1da2eddab22c4571bb352ffa8e1e07bb` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:02.661227 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe744c-2bec-4300-88d6-2dae8467a76e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da2eddab22c4571bb352ffa8e1e07bb)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:02.663167 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe744c-2bec-4300-88d6-2dae8467a76e admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:02.708755 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c4fe744c-2bec-4300-88d6-2dae8467a76e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da2eddab22c4571bb352ffa8e1e07bb', 'request_id': 'req-c4fe744c-2bec-4300-88d6-2dae8467a76e'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:02.715066 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c4fe744c-2bec-4300-88d6-2dae8467a76e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da2eddab22c4571bb352ffa8e1e07bb', 'request_id': 'req-c4fe744c-2bec-4300-88d6-2dae8467a76e'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:02.720503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c4fe744c-2bec-4300-88d6-2dae8467a76e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da2eddab22c4571bb352ffa8e1e07bb', 'request_id': 'req-c4fe744c-2bec-4300-88d6-2dae8467a76e'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:02.732149 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c4fe744c-2bec-4300-88d6-2dae8467a76e admin admin] The token cache is being invalidate because project 1da2eddab22c4571bb352ffa8e1e07bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:41:02.732430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c4fe744c-2bec-4300-88d6-2dae8467a76e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:02.733058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c4fe744c-2bec-4300-88d6-2dae8467a76e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:02.734515 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1085/2200] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:41:02 2022] DELETE /identity/v3/projects/1da2eddab22c4571bb352ffa8e1e07bb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:02.739458 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08443253-852b-43a2-9210-14fa19bc3737 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:02.739947 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08443253-852b-43a2-9210-14fa19bc3737 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:02.740047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08443253-852b-43a2-9210-14fa19bc3737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:02.759812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-08443253-852b-43a2-9210-14fa19bc3737 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:02.761695 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-08443253-852b-43a2-9210-14fa19bc3737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:02.819541 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1116/2201] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:41:02.827957 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9054956-2af3-4bc7-8c3b-4396b49a8061 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:02.828246 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9054956-2af3-4bc7-8c3b-4396b49a8061 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:02.828520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9054956-2af3-4bc7-8c3b-4396b49a8061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:02.847763 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-c9054956-2af3-4bc7-8c3b-4396b49a8061 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:02.848954 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-c9054956-2af3-4bc7-8c3b-4396b49a8061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:02.857635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1086/2202] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:02.861836 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08443253-852b-43a2-9210-14fa19bc3737 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:02.872333 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08443253-852b-43a2-9210-14fa19bc3737 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:02.876938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfad66-8b4c-46ed-a75d-1d7e6e9514ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:02.877544 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfad66-8b4c-46ed-a75d-1d7e6e9514ec admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:02.877816 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfad66-8b4c-46ed-a75d-1d7e6e9514ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:02.878080 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfad66-8b4c-46ed-a75d-1d7e6e9514ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:02.878710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cfad66-8b4c-46ed-a75d-1d7e6e9514ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:41:02.879152 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cfad66-8b4c-46ed-a75d-1d7e6e9514ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:02.880903 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cfad66-8b4c-46ed-a75d-1d7e6e9514ec admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:02.892752 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1117/2203] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:41:02.897264 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9054956-2af3-4bc7-8c3b-4396b49a8061 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:02.906775 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9054956-2af3-4bc7-8c3b-4396b49a8061 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:02.911484 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7dc95-1a23-49e8-a617-524b186af762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:02.912012 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7dc95-1a23-49e8-a617-524b186af762 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:02.912289 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7dc95-1a23-49e8-a617-524b186af762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:02.912578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d7dc95-1a23-49e8-a617-524b186af762 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:02.913181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7dc95-1a23-49e8-a617-524b186af762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:02.915083 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d7dc95-1a23-49e8-a617-524b186af762 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:02.943583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1087/2204] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:41:02 2022] POST /identity/v3/projects => generated 407 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:41:02.947996 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfad66-8b4c-46ed-a75d-1d7e6e9514ec admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:02.958403 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfad66-8b4c-46ed-a75d-1d7e6e9514ec admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:03.014514 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ac38d-e270-4b61-b815-f716166059c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:03.015144 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ac38d-e270-4b61-b815-f716166059c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:03.015423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ac38d-e270-4b61-b815-f716166059c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:03.015696 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ac38d-e270-4b61-b815-f716166059c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:03.016330 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ac38d-e270-4b61-b815-f716166059c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:03.018231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ac38d-e270-4b61-b815-f716166059c4 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:03.038941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1118/2205] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:41:02 2022] POST /identity/v3/users => generated 304 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:03.043969 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7dc95-1a23-49e8-a617-524b186af762 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:03.054111 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d7dc95-1a23-49e8-a617-524b186af762 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:03.059181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc17894-e35d-446a-97d8-c24f5eee581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:03.059772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc17894-e35d-446a-97d8-c24f5eee581f admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:03.060048 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc17894-e35d-446a-97d8-c24f5eee581f admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:03.060314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc17894-e35d-446a-97d8-c24f5eee581f admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:03.060941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc17894-e35d-446a-97d8-c24f5eee581f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:03.062549 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc17894-e35d-446a-97d8-c24f5eee581f admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:03.072213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1088/2206] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:41:03.076824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ac38d-e270-4b61-b815-f716166059c4 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:03.087078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ac38d-e270-4b61-b815-f716166059c4 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:03.092324 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a9cfa1-55c5-4c73-b0d2-ddfe03055de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:03.092911 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9cfa1-55c5-4c73-b0d2-ddfe03055de3 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:03.093193 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9cfa1-55c5-4c73-b0d2-ddfe03055de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:03.093467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a9cfa1-55c5-4c73-b0d2-ddfe03055de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:03.094105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9cfa1-55c5-4c73-b0d2-ddfe03055de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:03.095741 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a9cfa1-55c5-4c73-b0d2-ddfe03055de3 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:03.106237 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1119/2207] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:03.110236 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc17894-e35d-446a-97d8-c24f5eee581f admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:03.120051 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc17894-e35d-446a-97d8-c24f5eee581f admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:03.124801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5672e-99bc-4da1-a556-bef3170ad462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:03.125444 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5672e-99bc-4da1-a556-bef3170ad462 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:03.125728 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5672e-99bc-4da1-a556-bef3170ad462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:03.126006 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5672e-99bc-4da1-a556-bef3170ad462 admin admin] PATH_INFO: `/v3/projects/b751a7303ba94048941acd3e6261629f/users/14c64e6012ce4273b52de3a7ccfdbc9a/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:03.140902 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5672e-99bc-4da1-a556-bef3170ad462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b751a7303ba94048941acd3e6261629f, user_id=14c64e6012ce4273b52de3a7ccfdbc9a, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:03.143595 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5672e-99bc-4da1-a556-bef3170ad462 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:03.156504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1089/2208] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:41:03 2022] PUT /identity/v3/projects/b751a7303ba94048941acd3e6261629f/users/14c64e6012ce4273b52de3a7ccfdbc9a/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:03.168689 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309668b2-68d0-4ecf-8548-0aba996dd6c8 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:03.168905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309668b2-68d0-4ecf-8548-0aba996dd6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:03.169180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309668b2-68d0-4ecf-8548-0aba996dd6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:03.196333 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-309668b2-68d0-4ecf-8548-0aba996dd6c8 None None] MFA Rules not processed for user `14c64e6012ce4273b52de3a7ccfdbc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:03.197611 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-309668b2-68d0-4ecf-8548-0aba996dd6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:03.209611 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:03.261846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1120/2209] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:03 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:03.266442 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5672e-99bc-4da1-a556-bef3170ad462 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:03.323880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:03.327537 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5672e-99bc-4da1-a556-bef3170ad462 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:03.333344 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f1fa5-c84e-4de2-afaf-83eeca7f0c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:03.334057 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f1fa5-c84e-4de2-afaf-83eeca7f0c20 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:03.334521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f1fa5-c84e-4de2-afaf-83eeca7f0c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:03.334985 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f1fa5-c84e-4de2-afaf-83eeca7f0c20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:03.335640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f1fa5-c84e-4de2-afaf-83eeca7f0c20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:03.337675 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f1fa5-c84e-4de2-afaf-83eeca7f0c20 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:03.364787 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1090/2210] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:41:03 2022] POST /identity/v3/projects => generated 407 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:03.368869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309668b2-68d0-4ecf-8548-0aba996dd6c8 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:03.379534 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309668b2-68d0-4ecf-8548-0aba996dd6c8 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:03.434370 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc4ab0-55f7-45b0-92c9-5a16056075a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:03.434904 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc4ab0-55f7-45b0-92c9-5a16056075a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:03.435192 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc4ab0-55f7-45b0-92c9-5a16056075a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:03.435462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc4ab0-55f7-45b0-92c9-5a16056075a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:03.436078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc4ab0-55f7-45b0-92c9-5a16056075a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:03.437997 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc4ab0-55f7-45b0-92c9-5a16056075a7 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:03.458925 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1121/2211] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:41:03 2022] POST /identity/v3/users => generated 310 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:03.462968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f1fa5-c84e-4de2-afaf-83eeca7f0c20 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:03.474190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f1fa5-c84e-4de2-afaf-83eeca7f0c20 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:03.478889 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea055c-af95-4e78-bba1-7a2e4ddc2092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:03.480341 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea055c-af95-4e78-bba1-7a2e4ddc2092 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:03.480627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea055c-af95-4e78-bba1-7a2e4ddc2092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:03.480900 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea055c-af95-4e78-bba1-7a2e4ddc2092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:03.481536 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea055c-af95-4e78-bba1-7a2e4ddc2092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:03.483166 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea055c-af95-4e78-bba1-7a2e4ddc2092 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:03.494126 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1091/2212] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:03.499670 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc4ab0-55f7-45b0-92c9-5a16056075a7 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:03.509577 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc4ab0-55f7-45b0-92c9-5a16056075a7 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:03.514271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda31a7-d7d7-41fa-856c-c95ca7a9a9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:03.514907 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda31a7-d7d7-41fa-856c-c95ca7a9a9a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:03.515215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda31a7-d7d7-41fa-856c-c95ca7a9a9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:03.515486 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda31a7-d7d7-41fa-856c-c95ca7a9a9a4 admin admin] PATH_INFO: `/v3/projects/6baad3d8260f450588057e77b33c62ca/users/1c3cbb0787e149459c40513e5ea29515/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:03.530346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda31a7-d7d7-41fa-856c-c95ca7a9a9a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6baad3d8260f450588057e77b33c62ca, user_id=1c3cbb0787e149459c40513e5ea29515, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:03.532993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda31a7-d7d7-41fa-856c-c95ca7a9a9a4 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:03.545496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1122/2213] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:41:03 2022] PUT /identity/v3/projects/6baad3d8260f450588057e77b33c62ca/users/1c3cbb0787e149459c40513e5ea29515/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:03.549553 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea055c-af95-4e78-bba1-7a2e4ddc2092 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:03.560295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea055c-af95-4e78-bba1-7a2e4ddc2092 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:03.615569 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35728a07-c989-4bd3-8f79-14e71761d736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:03.616165 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35728a07-c989-4bd3-8f79-14e71761d736 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:03.616444 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35728a07-c989-4bd3-8f79-14e71761d736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:03.616739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35728a07-c989-4bd3-8f79-14e71761d736 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:03.617369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35728a07-c989-4bd3-8f79-14e71761d736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:03.618978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35728a07-c989-4bd3-8f79-14e71761d736 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:03.629372 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1092/2214] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:03.633532 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda31a7-d7d7-41fa-856c-c95ca7a9a9a4 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:03.644156 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda31a7-d7d7-41fa-856c-c95ca7a9a9a4 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:03.648763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecec1ee-2b2b-4e97-a66e-c0b4040e5b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:03.649404 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec1ee-2b2b-4e97-a66e-c0b4040e5b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:03.649683 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec1ee-2b2b-4e97-a66e-c0b4040e5b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:03.649953 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec1ee-2b2b-4e97-a66e-c0b4040e5b21 admin admin] PATH_INFO: `/v3/projects/6baad3d8260f450588057e77b33c62ca/users/1c3cbb0787e149459c40513e5ea29515/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:03.652172 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecec1ee-2b2b-4e97-a66e-c0b4040e5b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6baad3d8260f450588057e77b33c62ca, user_id=1c3cbb0787e149459c40513e5ea29515, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:03.654799 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecec1ee-2b2b-4e97-a66e-c0b4040e5b21 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:03.664851 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1123/2215] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:41:03 2022] PUT /identity/v3/projects/6baad3d8260f450588057e77b33c62ca/users/1c3cbb0787e149459c40513e5ea29515/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:03.675958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3737f-cf0b-4b87-b3dc-9011f474cbde None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:03.676341 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3737f-cf0b-4b87-b3dc-9011f474cbde None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:03.676717 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f3737f-cf0b-4b87-b3dc-9011f474cbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:03.705851 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-56f3737f-cf0b-4b87-b3dc-9011f474cbde None None] MFA Rules not processed for user `1c3cbb0787e149459c40513e5ea29515`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:03.707023 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-56f3737f-cf0b-4b87-b3dc-9011f474cbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:03.773311 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1093/2216] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:03 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:03.784055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecec1ee-2b2b-4e97-a66e-c0b4040e5b21 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:03.785833 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-9ecec1ee-2b2b-4e97-a66e-c0b4040e5b21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:03.842551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecec1ee-2b2b-4e97-a66e-c0b4040e5b21 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:03.846150 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05533f-74ed-48fa-b1c6-f74b54a58bd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:03.846738 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05533f-74ed-48fa-b1c6-f74b54a58bd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:03.847047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05533f-74ed-48fa-b1c6-f74b54a58bd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:03.847319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05533f-74ed-48fa-b1c6-f74b54a58bd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:03.856496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05533f-74ed-48fa-b1c6-f74b54a58bd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:03.857929 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05533f-74ed-48fa-b1c6-f74b54a58bd4 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:03.867071 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1124/2217] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:03 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:04.017502 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3737f-cf0b-4b87-b3dc-9011f474cbde None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:04.028082 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f3737f-cf0b-4b87-b3dc-9011f474cbde None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:04.031593 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff089230-ca83-4836-a9e5-8967b2b8e53b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:04.032216 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff089230-ca83-4836-a9e5-8967b2b8e53b service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:04.032499 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff089230-ca83-4836-a9e5-8967b2b8e53b service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:04.032770 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff089230-ca83-4836-a9e5-8967b2b8e53b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:04.080607 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:04.090542 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff089230-ca83-4836-a9e5-8967b2b8e53b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:04.091990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff089230-ca83-4836-a9e5-8967b2b8e53b service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:04.100667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1094/2218] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:04 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:09.340471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05533f-74ed-48fa-b1c6-f74b54a58bd4 service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:09.350573 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:09.409108 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05533f-74ed-48fa-b1c6-f74b54a58bd4 service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:09.413781 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f8f8e-3d8f-43d1-b603-fd6dc59b738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:09.414426 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f8f8e-3d8f-43d1-b603-fd6dc59b738f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:09.414708 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f8f8e-3d8f-43d1-b603-fd6dc59b738f admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:09.415009 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f8f8e-3d8f-43d1-b603-fd6dc59b738f admin admin] PATH_INFO: `/v3/users/14c64e6012ce4273b52de3a7ccfdbc9a` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:09.416256 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f8f8e-3d8f-43d1-b603-fd6dc59b738f admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c64e6012ce4273b52de3a7ccfdbc9a)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:09.418750 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f8f8e-3d8f-43d1-b603-fd6dc59b738f admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:09.470780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f94f8f8e-3d8f-43d1-b603-fd6dc59b738f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c64e6012ce4273b52de3a7ccfdbc9a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:09.471418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f94f8f8e-3d8f-43d1-b603-fd6dc59b738f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c64e6012ce4273b52de3a7ccfdbc9a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:09.479327 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f94f8f8e-3d8f-43d1-b603-fd6dc59b738f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c64e6012ce4273b52de3a7ccfdbc9a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:09.491215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f94f8f8e-3d8f-43d1-b603-fd6dc59b738f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c64e6012ce4273b52de3a7ccfdbc9a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:09.491895 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f94f8f8e-3d8f-43d1-b603-fd6dc59b738f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c64e6012ce4273b52de3a7ccfdbc9a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:09.504761 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1125/2219] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:41:09 2022] DELETE /identity/v3/users/14c64e6012ce4273b52de3a7ccfdbc9a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:09.509213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9eedb1-53ea-4030-9b09-7a8df6b21f90 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:09.509687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9eedb1-53ea-4030-9b09-7a8df6b21f90 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:09.509800 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9eedb1-53ea-4030-9b09-7a8df6b21f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:09.529477 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-6a9eedb1-53ea-4030-9b09-7a8df6b21f90 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:09.530656 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6a9eedb1-53ea-4030-9b09-7a8df6b21f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:09.587879 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1095/2220] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:09.598136 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f8f8e-3d8f-43d1-b603-fd6dc59b738f admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:09.599571 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f94f8f8e-3d8f-43d1-b603-fd6dc59b738f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:09.656819 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f8f8e-3d8f-43d1-b603-fd6dc59b738f admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:09.660474 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9685c9b-1e1d-447c-8cc9-be40816e4134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:09.661080 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9685c9b-1e1d-447c-8cc9-be40816e4134 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:09.661360 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9685c9b-1e1d-447c-8cc9-be40816e4134 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:09.661632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9685c9b-1e1d-447c-8cc9-be40816e4134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:09.670625 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9685c9b-1e1d-447c-8cc9-be40816e4134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:09.672081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9685c9b-1e1d-447c-8cc9-be40816e4134 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:09.681635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1126/2221] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:09.950621 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9eedb1-53ea-4030-9b09-7a8df6b21f90 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:09.952210 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6a9eedb1-53ea-4030-9b09-7a8df6b21f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:09.965274 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9eedb1-53ea-4030-9b09-7a8df6b21f90 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:09.970331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5142b9-8df5-4b99-9d13-ace9a1992f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:09.971005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5142b9-8df5-4b99-9d13-ace9a1992f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:09.971430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5142b9-8df5-4b99-9d13-ace9a1992f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:09.971710 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5142b9-8df5-4b99-9d13-ace9a1992f60 admin admin] PATH_INFO: `/v3/projects/b751a7303ba94048941acd3e6261629f` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:09.972851 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5142b9-8df5-4b99-9d13-ace9a1992f60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b751a7303ba94048941acd3e6261629f)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:09.974778 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5142b9-8df5-4b99-9d13-ace9a1992f60 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:10.022144 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6b5142b9-8df5-4b99-9d13-ace9a1992f60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b751a7303ba94048941acd3e6261629f', 'request_id': 'req-6b5142b9-8df5-4b99-9d13-ace9a1992f60'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:10.028411 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6b5142b9-8df5-4b99-9d13-ace9a1992f60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b751a7303ba94048941acd3e6261629f', 'request_id': 'req-6b5142b9-8df5-4b99-9d13-ace9a1992f60'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:10.033895 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6b5142b9-8df5-4b99-9d13-ace9a1992f60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b751a7303ba94048941acd3e6261629f', 'request_id': 'req-6b5142b9-8df5-4b99-9d13-ace9a1992f60'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:10.046162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6b5142b9-8df5-4b99-9d13-ace9a1992f60 admin admin] The token cache is being invalidate because project b751a7303ba94048941acd3e6261629f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:41:10.046451 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6b5142b9-8df5-4b99-9d13-ace9a1992f60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:10.047129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6b5142b9-8df5-4b99-9d13-ace9a1992f60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:10.048645 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1096/2222] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:41:09 2022] DELETE /identity/v3/projects/b751a7303ba94048941acd3e6261629f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:10.052634 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9685c9b-1e1d-447c-8cc9-be40816e4134 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:10.062881 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9685c9b-1e1d-447c-8cc9-be40816e4134 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:10.091381 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:10.122065 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f592e-86e5-4d8a-990c-9d2126767461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:10.122686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f592e-86e5-4d8a-990c-9d2126767461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:10.122990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f592e-86e5-4d8a-990c-9d2126767461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:10.123271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f592e-86e5-4d8a-990c-9d2126767461 admin admin] PATH_INFO: `/v3/users/1c3cbb0787e149459c40513e5ea29515` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:10.124388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f592e-86e5-4d8a-990c-9d2126767461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c3cbb0787e149459c40513e5ea29515)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:10.126293 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f592e-86e5-4d8a-990c-9d2126767461 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:10.171068 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-476f592e-86e5-4d8a-990c-9d2126767461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c3cbb0787e149459c40513e5ea29515'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:10.171708 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-476f592e-86e5-4d8a-990c-9d2126767461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c3cbb0787e149459c40513e5ea29515'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:10.178788 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-476f592e-86e5-4d8a-990c-9d2126767461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c3cbb0787e149459c40513e5ea29515'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:10.191141 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-476f592e-86e5-4d8a-990c-9d2126767461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c3cbb0787e149459c40513e5ea29515'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:10.191771 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-476f592e-86e5-4d8a-990c-9d2126767461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c3cbb0787e149459c40513e5ea29515'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:10.204219 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1127/2223] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:41:10 2022] DELETE /identity/v3/users/1c3cbb0787e149459c40513e5ea29515 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:10.479730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5142b9-8df5-4b99-9d13-ace9a1992f60 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:10.481278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6b5142b9-8df5-4b99-9d13-ace9a1992f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:10.494696 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5142b9-8df5-4b99-9d13-ace9a1992f60 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:10.553058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a5465c-1a6e-43c1-a5b1-2236e53f9a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:10.553737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5465c-1a6e-43c1-a5b1-2236e53f9a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:10.553857 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5465c-1a6e-43c1-a5b1-2236e53f9a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:10.554129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a5465c-1a6e-43c1-a5b1-2236e53f9a98 admin admin] PATH_INFO: `/v3/projects/6baad3d8260f450588057e77b33c62ca` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:10.555254 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5465c-1a6e-43c1-a5b1-2236e53f9a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6baad3d8260f450588057e77b33c62ca)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:10.557638 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a5465c-1a6e-43c1-a5b1-2236e53f9a98 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:10.574472 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:10.606966 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-77a5465c-1a6e-43c1-a5b1-2236e53f9a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6baad3d8260f450588057e77b33c62ca', 'request_id': 'req-77a5465c-1a6e-43c1-a5b1-2236e53f9a98'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:10.612998 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-77a5465c-1a6e-43c1-a5b1-2236e53f9a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6baad3d8260f450588057e77b33c62ca', 'request_id': 'req-77a5465c-1a6e-43c1-a5b1-2236e53f9a98'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:10.618495 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-77a5465c-1a6e-43c1-a5b1-2236e53f9a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6baad3d8260f450588057e77b33c62ca', 'request_id': 'req-77a5465c-1a6e-43c1-a5b1-2236e53f9a98'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:10.630499 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-77a5465c-1a6e-43c1-a5b1-2236e53f9a98 admin admin] The token cache is being invalidate because project 6baad3d8260f450588057e77b33c62ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:41:10.630778 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-77a5465c-1a6e-43c1-a5b1-2236e53f9a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:10.631427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-77a5465c-1a6e-43c1-a5b1-2236e53f9a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:10.632887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1097/2224] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:41:10 2022] DELETE /identity/v3/projects/6baad3d8260f450588057e77b33c62ca => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:10.638464 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de059e3a-642e-4495-ad9a-d73f6c9d10a1 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:10.638932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de059e3a-642e-4495-ad9a-d73f6c9d10a1 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:10.639082 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de059e3a-642e-4495-ad9a-d73f6c9d10a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:10.658746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-de059e3a-642e-4495-ad9a-d73f6c9d10a1 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:10.659984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-de059e3a-642e-4495-ad9a-d73f6c9d10a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:10.718231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1128/2225] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:10.726915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333742e-2492-4b0e-a43f-1646d6e1a887 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:10.727297 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333742e-2492-4b0e-a43f-1646d6e1a887 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:10.727648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5333742e-2492-4b0e-a43f-1646d6e1a887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:10.747870 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-5333742e-2492-4b0e-a43f-1646d6e1a887 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:10.749053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-5333742e-2492-4b0e-a43f-1646d6e1a887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:10.756818 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1098/2226] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:10.761396 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de059e3a-642e-4495-ad9a-d73f6c9d10a1 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:10.770855 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de059e3a-642e-4495-ad9a-d73f6c9d10a1 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:10.775416 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4392112-af2d-40da-93ba-c1533dc11d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:10.776050 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4392112-af2d-40da-93ba-c1533dc11d15 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:10.776324 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4392112-af2d-40da-93ba-c1533dc11d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:10.776590 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4392112-af2d-40da-93ba-c1533dc11d15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:10.777245 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4392112-af2d-40da-93ba-c1533dc11d15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:41:10.777546 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4392112-af2d-40da-93ba-c1533dc11d15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:10.779143 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4392112-af2d-40da-93ba-c1533dc11d15 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:10.790602 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1129/2227] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:41:10.794975 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333742e-2492-4b0e-a43f-1646d6e1a887 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:10.804140 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5333742e-2492-4b0e-a43f-1646d6e1a887 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:10.809513 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcc528-74d1-473d-ae48-21b7c040f98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:10.810097 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcc528-74d1-473d-ae48-21b7c040f98d admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:10.810372 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcc528-74d1-473d-ae48-21b7c040f98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:10.810638 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcc528-74d1-473d-ae48-21b7c040f98d admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:10.811318 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bcc528-74d1-473d-ae48-21b7c040f98d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:10.813175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bcc528-74d1-473d-ae48-21b7c040f98d admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:10.840312 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1099/2228] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:41:10 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:41:10.844454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4392112-af2d-40da-93ba-c1533dc11d15 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:10.854473 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4392112-af2d-40da-93ba-c1533dc11d15 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:10.889494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:10.914122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fc22a-77ba-4d6a-8825-d58280d70878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:10.914720 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fc22a-77ba-4d6a-8825-d58280d70878 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:10.915029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fc22a-77ba-4d6a-8825-d58280d70878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:10.915301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53fc22a-77ba-4d6a-8825-d58280d70878 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:10.915926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fc22a-77ba-4d6a-8825-d58280d70878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:10.917945 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53fc22a-77ba-4d6a-8825-d58280d70878 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:10.939569 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1130/2229] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:41:10 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:10.943716 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcc528-74d1-473d-ae48-21b7c040f98d admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:10.954982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcc528-74d1-473d-ae48-21b7c040f98d admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:10.959624 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60abc5-6a30-4536-a135-4b349cf01b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:10.960231 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60abc5-6a30-4536-a135-4b349cf01b18 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:10.960509 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60abc5-6a30-4536-a135-4b349cf01b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:10.960781 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60abc5-6a30-4536-a135-4b349cf01b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:10.961423 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60abc5-6a30-4536-a135-4b349cf01b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:10.963045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60abc5-6a30-4536-a135-4b349cf01b18 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:10.972990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1100/2230] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:10.976944 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fc22a-77ba-4d6a-8825-d58280d70878 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:10.987047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53fc22a-77ba-4d6a-8825-d58280d70878 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:10.991728 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5041c30-bc7c-439e-abd6-9eb98238a877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:10.992321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5041c30-bc7c-439e-abd6-9eb98238a877 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:10.992602 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5041c30-bc7c-439e-abd6-9eb98238a877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:10.992877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5041c30-bc7c-439e-abd6-9eb98238a877 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:10.993518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5041c30-bc7c-439e-abd6-9eb98238a877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:10.995705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5041c30-bc7c-439e-abd6-9eb98238a877 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:11.005552 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1131/2231] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:11.009630 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60abc5-6a30-4536-a135-4b349cf01b18 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:11.020070 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60abc5-6a30-4536-a135-4b349cf01b18 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:11.024625 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3c4a8-d018-42fa-bb7a-5fa4f3517793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:11.025266 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3c4a8-d018-42fa-bb7a-5fa4f3517793 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:11.025567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3c4a8-d018-42fa-bb7a-5fa4f3517793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:11.025845 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e3c4a8-d018-42fa-bb7a-5fa4f3517793 admin admin] PATH_INFO: `/v3/projects/980de57f927f40c9b76a4e2ae4468de6/users/78c35f8ed2ad4a449b4677d882e7f811/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:11.040096 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3c4a8-d018-42fa-bb7a-5fa4f3517793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=980de57f927f40c9b76a4e2ae4468de6, user_id=78c35f8ed2ad4a449b4677d882e7f811, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:11.042766 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e3c4a8-d018-42fa-bb7a-5fa4f3517793 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:11.055366 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1101/2232] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:41:11 2022] PUT /identity/v3/projects/980de57f927f40c9b76a4e2ae4468de6/users/78c35f8ed2ad4a449b4677d882e7f811/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:11.066501 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218e1a7-b7b8-411a-9ee5-42fdcd5c2b5f None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:11.066793 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218e1a7-b7b8-411a-9ee5-42fdcd5c2b5f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:11.067102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218e1a7-b7b8-411a-9ee5-42fdcd5c2b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:11.095040 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5218e1a7-b7b8-411a-9ee5-42fdcd5c2b5f None None] MFA Rules not processed for user `78c35f8ed2ad4a449b4677d882e7f811`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:11.096256 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5218e1a7-b7b8-411a-9ee5-42fdcd5c2b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:11.159076 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1132/2233] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:11.163495 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3c4a8-d018-42fa-bb7a-5fa4f3517793 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:11.234100 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e3c4a8-d018-42fa-bb7a-5fa4f3517793 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:11.238675 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648811fe-4caa-4970-8981-c7995226c88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:11.239300 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648811fe-4caa-4970-8981-c7995226c88c admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:11.239578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648811fe-4caa-4970-8981-c7995226c88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:11.239861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648811fe-4caa-4970-8981-c7995226c88c admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:11.240476 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648811fe-4caa-4970-8981-c7995226c88c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:11.242356 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648811fe-4caa-4970-8981-c7995226c88c admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:11.269638 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1102/2234] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:41:11 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:11.273896 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218e1a7-b7b8-411a-9ee5-42fdcd5c2b5f None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:11.285306 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218e1a7-b7b8-411a-9ee5-42fdcd5c2b5f None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:11.341214 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb73c4e-876f-466c-9569-1b0c468a2b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:11.341742 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb73c4e-876f-466c-9569-1b0c468a2b2d admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:11.342022 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb73c4e-876f-466c-9569-1b0c468a2b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:11.342297 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb73c4e-876f-466c-9569-1b0c468a2b2d admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:11.342923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb73c4e-876f-466c-9569-1b0c468a2b2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:11.344881 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb73c4e-876f-466c-9569-1b0c468a2b2d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:11.366179 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1133/2235] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:41:11 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:11.370770 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648811fe-4caa-4970-8981-c7995226c88c admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:11.381120 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648811fe-4caa-4970-8981-c7995226c88c admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:11.385738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61777802-8cfc-4bd1-b266-ca5c6e24dd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:11.386334 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61777802-8cfc-4bd1-b266-ca5c6e24dd9f admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:11.386615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61777802-8cfc-4bd1-b266-ca5c6e24dd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:11.386884 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61777802-8cfc-4bd1-b266-ca5c6e24dd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:11.387544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61777802-8cfc-4bd1-b266-ca5c6e24dd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:11.389127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61777802-8cfc-4bd1-b266-ca5c6e24dd9f admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:11.399690 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1103/2236] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:11.403826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb73c4e-876f-466c-9569-1b0c468a2b2d admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:11.413595 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb73c4e-876f-466c-9569-1b0c468a2b2d admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:11.418866 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90457fd6-b839-42b9-ae19-ad149479419a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:11.419540 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90457fd6-b839-42b9-ae19-ad149479419a admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:11.419820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90457fd6-b839-42b9-ae19-ad149479419a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:11.420096 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90457fd6-b839-42b9-ae19-ad149479419a admin admin] PATH_INFO: `/v3/projects/0779ba63492546cf91ddd35fe130eec8/users/166b41edafd24d1ca0215c9a19cce7ce/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:11.435413 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90457fd6-b839-42b9-ae19-ad149479419a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0779ba63492546cf91ddd35fe130eec8, user_id=166b41edafd24d1ca0215c9a19cce7ce, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:11.438045 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90457fd6-b839-42b9-ae19-ad149479419a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:11.450705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1134/2237] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:41:11 2022] PUT /identity/v3/projects/0779ba63492546cf91ddd35fe130eec8/users/166b41edafd24d1ca0215c9a19cce7ce/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:41:11.454688 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61777802-8cfc-4bd1-b266-ca5c6e24dd9f admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:11.464964 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61777802-8cfc-4bd1-b266-ca5c6e24dd9f admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:11.475980 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:11.523247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027e6aa-2535-46d7-ae3b-e52745845dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:11.523887 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027e6aa-2535-46d7-ae3b-e52745845dda admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:11.524169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027e6aa-2535-46d7-ae3b-e52745845dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:11.524442 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027e6aa-2535-46d7-ae3b-e52745845dda admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:11.525108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027e6aa-2535-46d7-ae3b-e52745845dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:11.527390 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027e6aa-2535-46d7-ae3b-e52745845dda admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:11.538079 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1104/2238] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:11.542521 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90457fd6-b839-42b9-ae19-ad149479419a admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:11.552696 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90457fd6-b839-42b9-ae19-ad149479419a admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:11.557628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7df8fa-803c-4d72-80bd-72e5cc6ecce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:11.558267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7df8fa-803c-4d72-80bd-72e5cc6ecce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:11.558545 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7df8fa-803c-4d72-80bd-72e5cc6ecce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:11.558812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7df8fa-803c-4d72-80bd-72e5cc6ecce6 admin admin] PATH_INFO: `/v3/projects/0779ba63492546cf91ddd35fe130eec8/users/166b41edafd24d1ca0215c9a19cce7ce/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:11.560751 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7df8fa-803c-4d72-80bd-72e5cc6ecce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0779ba63492546cf91ddd35fe130eec8, user_id=166b41edafd24d1ca0215c9a19cce7ce, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:11.563422 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7df8fa-803c-4d72-80bd-72e5cc6ecce6 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:11.568769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:11.574576 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1135/2239] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:41:11 2022] PUT /identity/v3/projects/0779ba63492546cf91ddd35fe130eec8/users/166b41edafd24d1ca0215c9a19cce7ce/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:41:11.584749 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8d18a-756d-4830-857c-4f7b1e605e27 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:11.585212 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8d18a-756d-4830-857c-4f7b1e605e27 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:11.585307 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8d18a-756d-4830-857c-4f7b1e605e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:11.614133 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-c4a8d18a-756d-4830-857c-4f7b1e605e27 None None] MFA Rules not processed for user `166b41edafd24d1ca0215c9a19cce7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:11.615282 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-c4a8d18a-756d-4830-857c-4f7b1e605e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:11.683473 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1105/2240] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:11.693934 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7df8fa-803c-4d72-80bd-72e5cc6ecce6 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:11.695686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3f7df8fa-803c-4d72-80bd-72e5cc6ecce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:11.754394 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7df8fa-803c-4d72-80bd-72e5cc6ecce6 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:11.758002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad516460-4b60-412e-aaec-74de9ef8f4cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:11.758607 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad516460-4b60-412e-aaec-74de9ef8f4cb service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:11.758890 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad516460-4b60-412e-aaec-74de9ef8f4cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:11.759221 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad516460-4b60-412e-aaec-74de9ef8f4cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:11.768357 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad516460-4b60-412e-aaec-74de9ef8f4cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:11.769763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad516460-4b60-412e-aaec-74de9ef8f4cb service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:11.779722 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1136/2241] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:12.181466 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8d18a-756d-4830-857c-4f7b1e605e27 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:12.243975 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8d18a-756d-4830-857c-4f7b1e605e27 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:12.248703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e3456-1a5e-445a-bca8-f194fcd09242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:12.249325 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e3456-1a5e-445a-bca8-f194fcd09242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:12.249604 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e3456-1a5e-445a-bca8-f194fcd09242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:12.249876 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e3456-1a5e-445a-bca8-f194fcd09242 admin admin] PATH_INFO: `/v3/users/78c35f8ed2ad4a449b4677d882e7f811` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:12.251031 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e3456-1a5e-445a-bca8-f194fcd09242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78c35f8ed2ad4a449b4677d882e7f811)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:12.252933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e3456-1a5e-445a-bca8-f194fcd09242 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:12.293801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:12.300454 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-800e3456-1a5e-445a-bca8-f194fcd09242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78c35f8ed2ad4a449b4677d882e7f811'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:12.301103 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-800e3456-1a5e-445a-bca8-f194fcd09242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78c35f8ed2ad4a449b4677d882e7f811'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:12.308629 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-800e3456-1a5e-445a-bca8-f194fcd09242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78c35f8ed2ad4a449b4677d882e7f811'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:12.320495 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-800e3456-1a5e-445a-bca8-f194fcd09242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78c35f8ed2ad4a449b4677d882e7f811'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:12.321146 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-800e3456-1a5e-445a-bca8-f194fcd09242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78c35f8ed2ad4a449b4677d882e7f811'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:12.333571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1106/2242] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:41:12 2022] DELETE /identity/v3/users/78c35f8ed2ad4a449b4677d882e7f811 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:12.338664 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148345-573c-42ae-94fa-620fe068ef73 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:12.339041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148345-573c-42ae-94fa-620fe068ef73 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:12.339410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b148345-573c-42ae-94fa-620fe068ef73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:12.358879 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-3b148345-573c-42ae-94fa-620fe068ef73 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:12.360139 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3b148345-573c-42ae-94fa-620fe068ef73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:12.418698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1137/2243] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:12.428828 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e3456-1a5e-445a-bca8-f194fcd09242 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:12.430262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-800e3456-1a5e-445a-bca8-f194fcd09242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:12.487691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e3456-1a5e-445a-bca8-f194fcd09242 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:12.491347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d80d65-f7c3-4fba-966e-996b3a55667c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:12.491951 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d80d65-f7c3-4fba-966e-996b3a55667c service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:12.492232 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d80d65-f7c3-4fba-966e-996b3a55667c service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:12.492503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d80d65-f7c3-4fba-966e-996b3a55667c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:12.501853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d80d65-f7c3-4fba-966e-996b3a55667c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:12.503310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d80d65-f7c3-4fba-966e-996b3a55667c service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:12.512973 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1107/2244] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:12.786962 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b148345-573c-42ae-94fa-620fe068ef73 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:12.788427 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3b148345-573c-42ae-94fa-620fe068ef73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:12.800641 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b148345-573c-42ae-94fa-620fe068ef73 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:12.805325 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffd18d-e3b5-44b0-b45d-6a6f777e6628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:12.806211 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffd18d-e3b5-44b0-b45d-6a6f777e6628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:12.806493 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffd18d-e3b5-44b0-b45d-6a6f777e6628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:12.806772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffd18d-e3b5-44b0-b45d-6a6f777e6628 admin admin] PATH_INFO: `/v3/projects/980de57f927f40c9b76a4e2ae4468de6` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:12.808002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffd18d-e3b5-44b0-b45d-6a6f777e6628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=980de57f927f40c9b76a4e2ae4468de6)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:12.809924 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffd18d-e3b5-44b0-b45d-6a6f777e6628 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:12.859027 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-afffd18d-e3b5-44b0-b45d-6a6f777e6628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '980de57f927f40c9b76a4e2ae4468de6', 'request_id': 'req-afffd18d-e3b5-44b0-b45d-6a6f777e6628'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:12.866125 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-afffd18d-e3b5-44b0-b45d-6a6f777e6628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '980de57f927f40c9b76a4e2ae4468de6', 'request_id': 'req-afffd18d-e3b5-44b0-b45d-6a6f777e6628'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:12.873075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-afffd18d-e3b5-44b0-b45d-6a6f777e6628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '980de57f927f40c9b76a4e2ae4468de6', 'request_id': 'req-afffd18d-e3b5-44b0-b45d-6a6f777e6628'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:12.883818 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-afffd18d-e3b5-44b0-b45d-6a6f777e6628 admin admin] The token cache is being invalidate because project 980de57f927f40c9b76a4e2ae4468de6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:41:12.884105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-afffd18d-e3b5-44b0-b45d-6a6f777e6628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:12.885341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-afffd18d-e3b5-44b0-b45d-6a6f777e6628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:12.887388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1138/2245] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:41:12 2022] DELETE /identity/v3/projects/980de57f927f40c9b76a4e2ae4468de6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:12.891067 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d80d65-f7c3-4fba-966e-996b3a55667c service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:12.901147 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d80d65-f7c3-4fba-966e-996b3a55667c service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:12.959045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588b0e9-3ea8-43b1-8def-7469ab2bbcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:12.959621 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588b0e9-3ea8-43b1-8def-7469ab2bbcb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:12.959895 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588b0e9-3ea8-43b1-8def-7469ab2bbcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:12.960164 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588b0e9-3ea8-43b1-8def-7469ab2bbcb6 admin admin] PATH_INFO: `/v3/users/166b41edafd24d1ca0215c9a19cce7ce` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:12.961253 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588b0e9-3ea8-43b1-8def-7469ab2bbcb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=166b41edafd24d1ca0215c9a19cce7ce)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:12.963841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588b0e9-3ea8-43b1-8def-7469ab2bbcb6 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:13.008617 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6588b0e9-3ea8-43b1-8def-7469ab2bbcb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166b41edafd24d1ca0215c9a19cce7ce'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:13.009250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6588b0e9-3ea8-43b1-8def-7469ab2bbcb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166b41edafd24d1ca0215c9a19cce7ce'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:13.016151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6588b0e9-3ea8-43b1-8def-7469ab2bbcb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166b41edafd24d1ca0215c9a19cce7ce'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:13.020680 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:13.029834 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6588b0e9-3ea8-43b1-8def-7469ab2bbcb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166b41edafd24d1ca0215c9a19cce7ce'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:13.030554 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-6588b0e9-3ea8-43b1-8def-7469ab2bbcb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166b41edafd24d1ca0215c9a19cce7ce'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:13.044022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1108/2246] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:41:12 2022] DELETE /identity/v3/users/166b41edafd24d1ca0215c9a19cce7ce => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:13.314541 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffd18d-e3b5-44b0-b45d-6a6f777e6628 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:13.315985 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-afffd18d-e3b5-44b0-b45d-6a6f777e6628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:13.329087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffd18d-e3b5-44b0-b45d-6a6f777e6628 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:13.349590 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:13.387538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db98e46-187d-4133-9b04-6a82b454bfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:13.388166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db98e46-187d-4133-9b04-6a82b454bfb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:13.388452 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db98e46-187d-4133-9b04-6a82b454bfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:13.388727 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db98e46-187d-4133-9b04-6a82b454bfb7 admin admin] PATH_INFO: `/v3/projects/0779ba63492546cf91ddd35fe130eec8` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:13.389844 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db98e46-187d-4133-9b04-6a82b454bfb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0779ba63492546cf91ddd35fe130eec8)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:13.391777 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db98e46-187d-4133-9b04-6a82b454bfb7 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:13.437305 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-7db98e46-187d-4133-9b04-6a82b454bfb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0779ba63492546cf91ddd35fe130eec8', 'request_id': 'req-7db98e46-187d-4133-9b04-6a82b454bfb7'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:13.444450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-7db98e46-187d-4133-9b04-6a82b454bfb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0779ba63492546cf91ddd35fe130eec8', 'request_id': 'req-7db98e46-187d-4133-9b04-6a82b454bfb7'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:13.451232 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-7db98e46-187d-4133-9b04-6a82b454bfb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0779ba63492546cf91ddd35fe130eec8', 'request_id': 'req-7db98e46-187d-4133-9b04-6a82b454bfb7'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:13.461378 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-7db98e46-187d-4133-9b04-6a82b454bfb7 admin admin] The token cache is being invalidate because project 0779ba63492546cf91ddd35fe130eec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:41:13.461669 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-7db98e46-187d-4133-9b04-6a82b454bfb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:13.462294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-7db98e46-187d-4133-9b04-6a82b454bfb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:13.463853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1139/2247] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:41:13 2022] DELETE /identity/v3/projects/0779ba63492546cf91ddd35fe130eec8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:13.468636 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85e209-9246-48e8-8bde-0cb5dd8ce9b3 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:13.468926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85e209-9246-48e8-8bde-0cb5dd8ce9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:13.469206 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85e209-9246-48e8-8bde-0cb5dd8ce9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:13.489396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-4e85e209-9246-48e8-8bde-0cb5dd8ce9b3 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:13.490541 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-4e85e209-9246-48e8-8bde-0cb5dd8ce9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:13.550458 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1109/2248] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:13.558864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d2839-c3e1-49d2-9b2f-83cae0ba2a3c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:13.559200 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d2839-c3e1-49d2-9b2f-83cae0ba2a3c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:13.559474 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d2839-c3e1-49d2-9b2f-83cae0ba2a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:13.578717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-f70d2839-c3e1-49d2-9b2f-83cae0ba2a3c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:13.580014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f70d2839-c3e1-49d2-9b2f-83cae0ba2a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:13.587935 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1140/2249] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:13.592106 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85e209-9246-48e8-8bde-0cb5dd8ce9b3 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:13.602337 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85e209-9246-48e8-8bde-0cb5dd8ce9b3 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:13.607684 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385e59e-048d-4203-8879-02a4d5ac4ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:13.608291 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e59e-048d-4203-8879-02a4d5ac4ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:13.608575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e59e-048d-4203-8879-02a4d5ac4ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:13.608851 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385e59e-048d-4203-8879-02a4d5ac4ab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:13.609496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385e59e-048d-4203-8879-02a4d5ac4ab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:41:13.609804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385e59e-048d-4203-8879-02a4d5ac4ab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:13.611438 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385e59e-048d-4203-8879-02a4d5ac4ab2 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:13.624524 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1110/2250] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:41:13.628847 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d2839-c3e1-49d2-9b2f-83cae0ba2a3c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:13.637907 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d2839-c3e1-49d2-9b2f-83cae0ba2a3c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:13.642430 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320ab3a-9f80-4aa6-8f14-d02f19263187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:13.643051 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320ab3a-9f80-4aa6-8f14-d02f19263187 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:13.643331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320ab3a-9f80-4aa6-8f14-d02f19263187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:13.643602 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320ab3a-9f80-4aa6-8f14-d02f19263187 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:13.644223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320ab3a-9f80-4aa6-8f14-d02f19263187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:13.646126 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320ab3a-9f80-4aa6-8f14-d02f19263187 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:13.672686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1141/2251] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:41:13 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:13.676581 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385e59e-048d-4203-8879-02a4d5ac4ab2 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:13.687491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385e59e-048d-4203-8879-02a4d5ac4ab2 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:13.743367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72360b-5917-4b47-a1ef-f8da19eb9ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:13.743977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72360b-5917-4b47-a1ef-f8da19eb9ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:13.744275 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72360b-5917-4b47-a1ef-f8da19eb9ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:13.744544 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72360b-5917-4b47-a1ef-f8da19eb9ac0 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:13.745170 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72360b-5917-4b47-a1ef-f8da19eb9ac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:13.747107 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72360b-5917-4b47-a1ef-f8da19eb9ac0 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:13.767819 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1111/2252] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:41:13 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:13.771898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320ab3a-9f80-4aa6-8f14-d02f19263187 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:13.782432 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320ab3a-9f80-4aa6-8f14-d02f19263187 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:13.786992 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70663980-e7ae-460e-b8f0-9764a3b91c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:13.787571 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70663980-e7ae-460e-b8f0-9764a3b91c68 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:13.787847 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70663980-e7ae-460e-b8f0-9764a3b91c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:13.788119 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70663980-e7ae-460e-b8f0-9764a3b91c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:13.788775 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70663980-e7ae-460e-b8f0-9764a3b91c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:13.790315 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70663980-e7ae-460e-b8f0-9764a3b91c68 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:13.800564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1142/2253] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:13.804580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72360b-5917-4b47-a1ef-f8da19eb9ac0 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:13.815187 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72360b-5917-4b47-a1ef-f8da19eb9ac0 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:13.819766 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f947489-6d3b-4502-9169-a76111d0d7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:13.820352 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f947489-6d3b-4502-9169-a76111d0d7db admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:13.820644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f947489-6d3b-4502-9169-a76111d0d7db admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:13.820899 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f947489-6d3b-4502-9169-a76111d0d7db admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:13.821530 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f947489-6d3b-4502-9169-a76111d0d7db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:13.823151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f947489-6d3b-4502-9169-a76111d0d7db admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:13.833538 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1112/2254] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:13.837621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70663980-e7ae-460e-b8f0-9764a3b91c68 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:13.847900 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70663980-e7ae-460e-b8f0-9764a3b91c68 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:13.852435 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793e4c3-319a-448a-a2c2-ad4fd336ed51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:13.853069 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793e4c3-319a-448a-a2c2-ad4fd336ed51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:13.853345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793e4c3-319a-448a-a2c2-ad4fd336ed51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:13.854339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793e4c3-319a-448a-a2c2-ad4fd336ed51 admin admin] PATH_INFO: `/v3/projects/dfd57c7035444d6f843fed783e802e09/users/2fd17fff4ab141cfa98d4d6df2a52d65/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:13.868651 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793e4c3-319a-448a-a2c2-ad4fd336ed51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfd57c7035444d6f843fed783e802e09, user_id=2fd17fff4ab141cfa98d4d6df2a52d65, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:13.871343 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793e4c3-319a-448a-a2c2-ad4fd336ed51 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:13.884430 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1143/2255] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:41:13 2022] PUT /identity/v3/projects/dfd57c7035444d6f843fed783e802e09/users/2fd17fff4ab141cfa98d4d6df2a52d65/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:41:13.894820 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4277d4-a924-4988-81bb-9829f8d21c3a None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:13.895284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4277d4-a924-4988-81bb-9829f8d21c3a None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:13.895403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4277d4-a924-4988-81bb-9829f8d21c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:13.923455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-8b4277d4-a924-4988-81bb-9829f8d21c3a None None] MFA Rules not processed for user `2fd17fff4ab141cfa98d4d6df2a52d65`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:13.924664 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8b4277d4-a924-4988-81bb-9829f8d21c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:13.957643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:13.992056 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1113/2256] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:14.003978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793e4c3-319a-448a-a2c2-ad4fd336ed51 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:14.005657 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c793e4c3-319a-448a-a2c2-ad4fd336ed51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:14.061780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793e4c3-319a-448a-a2c2-ad4fd336ed51 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:14.065457 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e009b4-c832-4868-9fd3-336ec962dbb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:14.066035 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e009b4-c832-4868-9fd3-336ec962dbb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:14.066316 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e009b4-c832-4868-9fd3-336ec962dbb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:14.066592 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e009b4-c832-4868-9fd3-336ec962dbb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:14.071825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:14.077400 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e009b4-c832-4868-9fd3-336ec962dbb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:14.079171 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e009b4-c832-4868-9fd3-336ec962dbb5 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:14.089022 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1144/2257] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:14.111525 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4277d4-a924-4988-81bb-9829f8d21c3a None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:14.172485 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4277d4-a924-4988-81bb-9829f8d21c3a None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:14.177039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d3f2c-ac56-4985-a5f1-077c9d516dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:14.177651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d3f2c-ac56-4985-a5f1-077c9d516dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:14.177932 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d3f2c-ac56-4985-a5f1-077c9d516dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:14.178204 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d3f2c-ac56-4985-a5f1-077c9d516dfe admin admin] PATH_INFO: `/v3/users/2fd17fff4ab141cfa98d4d6df2a52d65` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:14.179434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d3f2c-ac56-4985-a5f1-077c9d516dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd17fff4ab141cfa98d4d6df2a52d65)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:14.181616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d3f2c-ac56-4985-a5f1-077c9d516dfe admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:14.227733 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-358d3f2c-ac56-4985-a5f1-077c9d516dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd17fff4ab141cfa98d4d6df2a52d65'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:14.228398 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-358d3f2c-ac56-4985-a5f1-077c9d516dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd17fff4ab141cfa98d4d6df2a52d65'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:14.236014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-358d3f2c-ac56-4985-a5f1-077c9d516dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd17fff4ab141cfa98d4d6df2a52d65'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:14.248547 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-358d3f2c-ac56-4985-a5f1-077c9d516dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd17fff4ab141cfa98d4d6df2a52d65'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:14.249229 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-358d3f2c-ac56-4985-a5f1-077c9d516dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd17fff4ab141cfa98d4d6df2a52d65'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:14.265207 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1114/2258] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:41:14 2022] DELETE /identity/v3/users/2fd17fff4ab141cfa98d4d6df2a52d65 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:14.269797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbda5f0-a848-4370-bbde-bf6817d044df None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:14.270089 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbda5f0-a848-4370-bbde-bf6817d044df None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:14.270371 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbda5f0-a848-4370-bbde-bf6817d044df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:14.289455 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5bbda5f0-a848-4370-bbde-bf6817d044df None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:14.290659 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5bbda5f0-a848-4370-bbde-bf6817d044df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:14.350323 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1145/2259] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:14.360640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d3f2c-ac56-4985-a5f1-077c9d516dfe admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:14.362037 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-358d3f2c-ac56-4985-a5f1-077c9d516dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:14.418273 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d3f2c-ac56-4985-a5f1-077c9d516dfe admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:14.422183 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1e77b4-05f5-4c07-b1d8-4e8e264a4d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:14.422782 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e77b4-05f5-4c07-b1d8-4e8e264a4d3d service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:14.423089 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e77b4-05f5-4c07-b1d8-4e8e264a4d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:14.423361 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1e77b4-05f5-4c07-b1d8-4e8e264a4d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:14.430179 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:14.433363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e77b4-05f5-4c07-b1d8-4e8e264a4d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:14.435291 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1e77b4-05f5-4c07-b1d8-4e8e264a4d3d service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:14.446308 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1115/2260] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:14.704827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbda5f0-a848-4370-bbde-bf6817d044df None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:14.706486 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5bbda5f0-a848-4370-bbde-bf6817d044df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:14.720523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbda5f0-a848-4370-bbde-bf6817d044df None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:14.725208 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e00da2-e97f-46bd-8b65-62bdf5da1a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:14.726333 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e00da2-e97f-46bd-8b65-62bdf5da1a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:14.726790 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e00da2-e97f-46bd-8b65-62bdf5da1a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:14.727106 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e00da2-e97f-46bd-8b65-62bdf5da1a71 admin admin] PATH_INFO: `/v3/projects/dfd57c7035444d6f843fed783e802e09` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:14.728237 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e00da2-e97f-46bd-8b65-62bdf5da1a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfd57c7035444d6f843fed783e802e09)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:14.730334 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e00da2-e97f-46bd-8b65-62bdf5da1a71 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:14.777283 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-99e00da2-e97f-46bd-8b65-62bdf5da1a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfd57c7035444d6f843fed783e802e09', 'request_id': 'req-99e00da2-e97f-46bd-8b65-62bdf5da1a71'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:14.784120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-99e00da2-e97f-46bd-8b65-62bdf5da1a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfd57c7035444d6f843fed783e802e09', 'request_id': 'req-99e00da2-e97f-46bd-8b65-62bdf5da1a71'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:14.790566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-99e00da2-e97f-46bd-8b65-62bdf5da1a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfd57c7035444d6f843fed783e802e09', 'request_id': 'req-99e00da2-e97f-46bd-8b65-62bdf5da1a71'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:14.800804 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-99e00da2-e97f-46bd-8b65-62bdf5da1a71 admin admin] The token cache is being invalidate because project dfd57c7035444d6f843fed783e802e09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:41:14.801090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-99e00da2-e97f-46bd-8b65-62bdf5da1a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:14.801716 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-99e00da2-e97f-46bd-8b65-62bdf5da1a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:14.803220 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1146/2261] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:41:14 2022] DELETE /identity/v3/projects/dfd57c7035444d6f843fed783e802e09 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:14.809187 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e940ad-a524-4701-8749-dabf97c9c6ec None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:14.809474 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e940ad-a524-4701-8749-dabf97c9c6ec None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:14.809754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e940ad-a524-4701-8749-dabf97c9c6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:14.829740 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-76e940ad-a524-4701-8749-dabf97c9c6ec None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:14.830972 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-76e940ad-a524-4701-8749-dabf97c9c6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:14.903151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1116/2262] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:14.912015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f33237-55bc-4f63-acf2-9a6e7067550d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:14.912300 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f33237-55bc-4f63-acf2-9a6e7067550d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:14.912577 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f33237-55bc-4f63-acf2-9a6e7067550d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:14.933034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-58f33237-55bc-4f63-acf2-9a6e7067550d None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:14.934243 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-58f33237-55bc-4f63-acf2-9a6e7067550d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:14.942158 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1147/2263] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:14.946336 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e940ad-a524-4701-8749-dabf97c9c6ec None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:14.956601 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e940ad-a524-4701-8749-dabf97c9c6ec None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:14.961156 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82378346-69a8-4fd1-9496-536ad99a09f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:14.961749 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378346-69a8-4fd1-9496-536ad99a09f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:14.962036 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378346-69a8-4fd1-9496-536ad99a09f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:14.962306 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82378346-69a8-4fd1-9496-536ad99a09f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:14.963730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82378346-69a8-4fd1-9496-536ad99a09f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:41:14.964241 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82378346-69a8-4fd1-9496-536ad99a09f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:14.965836 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82378346-69a8-4fd1-9496-536ad99a09f6 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:14.977121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1117/2264] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:41:14.981668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f33237-55bc-4f63-acf2-9a6e7067550d None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:14.990747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f33237-55bc-4f63-acf2-9a6e7067550d None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:14.995511 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9435f52-5391-466a-929e-b50806787e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:14.996102 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9435f52-5391-466a-929e-b50806787e0b admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:14.996379 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9435f52-5391-466a-929e-b50806787e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:14.996650 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9435f52-5391-466a-929e-b50806787e0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:14.997286 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9435f52-5391-466a-929e-b50806787e0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:14.999193 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9435f52-5391-466a-929e-b50806787e0b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:15.027230 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1148/2265] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:41:14 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:15.031142 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82378346-69a8-4fd1-9496-536ad99a09f6 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:15.041097 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82378346-69a8-4fd1-9496-536ad99a09f6 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:15.097478 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29aa30-aa61-465d-99e4-3dc4ba813543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:15.098078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29aa30-aa61-465d-99e4-3dc4ba813543 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:15.098355 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29aa30-aa61-465d-99e4-3dc4ba813543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:15.098623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29aa30-aa61-465d-99e4-3dc4ba813543 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:15.099276 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29aa30-aa61-465d-99e4-3dc4ba813543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:15.101165 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29aa30-aa61-465d-99e4-3dc4ba813543 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:15.121554 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1118/2266] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:41:15 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:15.125688 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9435f52-5391-466a-929e-b50806787e0b admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:15.136158 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9435f52-5391-466a-929e-b50806787e0b admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:15.140706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1c3c5-4323-469b-b88d-7ac4336846cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:15.141292 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1c3c5-4323-469b-b88d-7ac4336846cf admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:15.141566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1c3c5-4323-469b-b88d-7ac4336846cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:15.141835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1c3c5-4323-469b-b88d-7ac4336846cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:15.142464 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1c3c5-4323-469b-b88d-7ac4336846cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:15.144064 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1c3c5-4323-469b-b88d-7ac4336846cf admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:15.154526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1149/2267] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:41:15.158328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29aa30-aa61-465d-99e4-3dc4ba813543 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:15.168213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29aa30-aa61-465d-99e4-3dc4ba813543 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:15.172840 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818b67d5-083f-49ec-89b9-185d6ca5b229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:15.173427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b67d5-083f-49ec-89b9-185d6ca5b229 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:15.173709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b67d5-083f-49ec-89b9-185d6ca5b229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:15.173983 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818b67d5-083f-49ec-89b9-185d6ca5b229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:15.174616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b67d5-083f-49ec-89b9-185d6ca5b229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:15.176248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818b67d5-083f-49ec-89b9-185d6ca5b229 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:15.187638 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1119/2268] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:15.191534 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1c3c5-4323-469b-b88d-7ac4336846cf admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:15.201929 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1c3c5-4323-469b-b88d-7ac4336846cf admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:15.206449 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a276ec-0888-4a65-839a-1a4abe311bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:15.207116 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a276ec-0888-4a65-839a-1a4abe311bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:15.207393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a276ec-0888-4a65-839a-1a4abe311bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:15.207663 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a276ec-0888-4a65-839a-1a4abe311bb9 admin admin] PATH_INFO: `/v3/projects/f93073cc4e4249e285e9053e553cd7fc/users/a8024c7ff9174ee1b26682a09a869dca/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:15.222255 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a276ec-0888-4a65-839a-1a4abe311bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93073cc4e4249e285e9053e553cd7fc, user_id=a8024c7ff9174ee1b26682a09a869dca, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:15.224942 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a276ec-0888-4a65-839a-1a4abe311bb9 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:15.237453 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1150/2269] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:41:15 2022] PUT /identity/v3/projects/f93073cc4e4249e285e9053e553cd7fc/users/a8024c7ff9174ee1b26682a09a869dca/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:15.248317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5cb0b-38af-4c82-9548-1a56a6e1ad08 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:15.248712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5cb0b-38af-4c82-9548-1a56a6e1ad08 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:15.248992 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5cb0b-38af-4c82-9548-1a56a6e1ad08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:15.276712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-15d5cb0b-38af-4c82-9548-1a56a6e1ad08 None None] MFA Rules not processed for user `a8024c7ff9174ee1b26682a09a869dca`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:15.277898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-15d5cb0b-38af-4c82-9548-1a56a6e1ad08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:15.325845 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:15.343461 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1120/2270] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:15.354461 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a276ec-0888-4a65-839a-1a4abe311bb9 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:15.356185 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-06a276ec-0888-4a65-839a-1a4abe311bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:15.371156 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:15.415355 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a276ec-0888-4a65-839a-1a4abe311bb9 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:15.419250 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94715c-8acd-4f2a-b9a3-298b29673d71 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d026ec6ed344404a5ebe4352792cc1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:15.419846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94715c-8acd-4f2a-b9a3-298b29673d71 service glance] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:15.420121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94715c-8acd-4f2a-b9a3-298b29673d71 service glance] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:15.420417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94715c-8acd-4f2a-b9a3-298b29673d71 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:15.428509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94715c-8acd-4f2a-b9a3-298b29673d71 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:15.429906 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94715c-8acd-4f2a-b9a3-298b29673d71 service glance] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:15.439564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1151/2271] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:25.340547 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=4 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:25.435594 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=20 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:30.042408 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5cb0b-38af-4c82-9548-1a56a6e1ad08 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:30.105549 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5cb0b-38af-4c82-9548-1a56a6e1ad08 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:30.110089 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e2d29-6ecc-4e41-a941-340f50249859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:30.110718 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2d29-6ecc-4e41-a941-340f50249859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:30.111023 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2d29-6ecc-4e41-a941-340f50249859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:30.111301 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e2d29-6ecc-4e41-a941-340f50249859 admin admin] PATH_INFO: `/v3/users/a8024c7ff9174ee1b26682a09a869dca` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:30.112414 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e2d29-6ecc-4e41-a941-340f50249859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8024c7ff9174ee1b26682a09a869dca)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:30.114326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e2d29-6ecc-4e41-a941-340f50249859 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:30.159525 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-854e2d29-6ecc-4e41-a941-340f50249859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8024c7ff9174ee1b26682a09a869dca'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:30.160171 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-854e2d29-6ecc-4e41-a941-340f50249859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8024c7ff9174ee1b26682a09a869dca'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:30.168801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-854e2d29-6ecc-4e41-a941-340f50249859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8024c7ff9174ee1b26682a09a869dca'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:30.183566 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-854e2d29-6ecc-4e41-a941-340f50249859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8024c7ff9174ee1b26682a09a869dca'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:30.184243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-854e2d29-6ecc-4e41-a941-340f50249859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8024c7ff9174ee1b26682a09a869dca'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:30.201465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1121/2272] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:41:30 2022] DELETE /identity/v3/users/a8024c7ff9174ee1b26682a09a869dca => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:30.208204 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71233aff-3c41-4f2d-ad5f-f78b31b977c5 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:30.208769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71233aff-3c41-4f2d-ad5f-f78b31b977c5 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:30.208769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71233aff-3c41-4f2d-ad5f-f78b31b977c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:30.228898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-71233aff-3c41-4f2d-ad5f-f78b31b977c5 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:30.230136 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-71233aff-3c41-4f2d-ad5f-f78b31b977c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:30.287447 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1152/2273] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:30.299873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e2d29-6ecc-4e41-a941-340f50249859 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:30.301307 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-854e2d29-6ecc-4e41-a941-340f50249859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:30.365880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e2d29-6ecc-4e41-a941-340f50249859 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:30.370093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c83b82-58f2-441a-84fe-b5d35351645f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:30.370706 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c83b82-58f2-441a-84fe-b5d35351645f service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:30.371009 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c83b82-58f2-441a-84fe-b5d35351645f service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:30.371303 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c83b82-58f2-441a-84fe-b5d35351645f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:30.382201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c83b82-58f2-441a-84fe-b5d35351645f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:30.383995 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c83b82-58f2-441a-84fe-b5d35351645f service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:30.394108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1122/2274] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:30.707581 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71233aff-3c41-4f2d-ad5f-f78b31b977c5 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:30.709172 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-71233aff-3c41-4f2d-ad5f-f78b31b977c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:30.722932 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71233aff-3c41-4f2d-ad5f-f78b31b977c5 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:30.727998 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7f8d33-fabc-430e-aeb3-dc006db7a260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:30.728708 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f8d33-fabc-430e-aeb3-dc006db7a260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:30.729177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f8d33-fabc-430e-aeb3-dc006db7a260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:30.729580 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f8d33-fabc-430e-aeb3-dc006db7a260 admin admin] PATH_INFO: `/v3/projects/f93073cc4e4249e285e9053e553cd7fc` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:30.730854 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f8d33-fabc-430e-aeb3-dc006db7a260 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93073cc4e4249e285e9053e553cd7fc)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:30.732883 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7f8d33-fabc-430e-aeb3-dc006db7a260 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:30.787189 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-1b7f8d33-fabc-430e-aeb3-dc006db7a260 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93073cc4e4249e285e9053e553cd7fc', 'request_id': 'req-1b7f8d33-fabc-430e-aeb3-dc006db7a260'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:30.797852 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-1b7f8d33-fabc-430e-aeb3-dc006db7a260 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93073cc4e4249e285e9053e553cd7fc', 'request_id': 'req-1b7f8d33-fabc-430e-aeb3-dc006db7a260'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:30.811250 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-1b7f8d33-fabc-430e-aeb3-dc006db7a260 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93073cc4e4249e285e9053e553cd7fc', 'request_id': 'req-1b7f8d33-fabc-430e-aeb3-dc006db7a260'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:30.824178 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-1b7f8d33-fabc-430e-aeb3-dc006db7a260 admin admin] The token cache is being invalidate because project f93073cc4e4249e285e9053e553cd7fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:41:30.824543 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-1b7f8d33-fabc-430e-aeb3-dc006db7a260 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:30.825338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-1b7f8d33-fabc-430e-aeb3-dc006db7a260 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:30.826883 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1153/2275] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:41:30 2022] DELETE /identity/v3/projects/f93073cc4e4249e285e9053e553cd7fc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:30.832203 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3a4fc-a20e-46c0-96f6-fb2e28e8ca00 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:30.832694 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3a4fc-a20e-46c0-96f6-fb2e28e8ca00 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:30.833022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3a4fc-a20e-46c0-96f6-fb2e28e8ca00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:30.855408 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-8cd3a4fc-a20e-46c0-96f6-fb2e28e8ca00 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:30.856693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8cd3a4fc-a20e-46c0-96f6-fb2e28e8ca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:30.877252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:30.937712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1123/2276] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:30.946636 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7fc14-1812-4eaa-9b1a-bda60947fe0e None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:30.947669 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7fc14-1812-4eaa-9b1a-bda60947fe0e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:30.947942 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7fc14-1812-4eaa-9b1a-bda60947fe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:30.971728 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0af7fc14-1812-4eaa-9b1a-bda60947fe0e None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:30.972931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0af7fc14-1812-4eaa-9b1a-bda60947fe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:30.980704 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1154/2277] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:30.984975 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3a4fc-a20e-46c0-96f6-fb2e28e8ca00 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:30.995613 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3a4fc-a20e-46c0-96f6-fb2e28e8ca00 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:31.000292 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b276c19-a079-464b-87b0-a8330605a6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:31.000933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b276c19-a079-464b-87b0-a8330605a6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:31.001212 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b276c19-a079-464b-87b0-a8330605a6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:31.001483 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b276c19-a079-464b-87b0-a8330605a6f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:31.002135 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b276c19-a079-464b-87b0-a8330605a6f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:41:31.002441 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b276c19-a079-464b-87b0-a8330605a6f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:31.004161 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b276c19-a079-464b-87b0-a8330605a6f4 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:31.016621 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1124/2278] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:41:31.020998 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7fc14-1812-4eaa-9b1a-bda60947fe0e None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:31.030254 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7fc14-1812-4eaa-9b1a-bda60947fe0e None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:31.035015 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604d3d6-d496-4b53-9f0c-812956d99f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:31.035617 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d3d6-d496-4b53-9f0c-812956d99f0d admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:31.035899 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d3d6-d496-4b53-9f0c-812956d99f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:31.036174 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2604d3d6-d496-4b53-9f0c-812956d99f0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:31.036812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604d3d6-d496-4b53-9f0c-812956d99f0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:31.038705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2604d3d6-d496-4b53-9f0c-812956d99f0d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:31.065905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1155/2279] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:41:31 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:31.069944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b276c19-a079-464b-87b0-a8330605a6f4 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:31.080394 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b276c19-a079-464b-87b0-a8330605a6f4 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:31.136270 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a97210-8228-4cb9-a56e-0df49664f4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:31.136875 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a97210-8228-4cb9-a56e-0df49664f4cb admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:31.137155 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a97210-8228-4cb9-a56e-0df49664f4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:31.137430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a97210-8228-4cb9-a56e-0df49664f4cb admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:31.138066 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a97210-8228-4cb9-a56e-0df49664f4cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:31.140018 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a97210-8228-4cb9-a56e-0df49664f4cb admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:31.161319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1125/2280] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:41:31 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:31.165651 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604d3d6-d496-4b53-9f0c-812956d99f0d admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:31.175726 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2604d3d6-d496-4b53-9f0c-812956d99f0d admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:31.180286 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a245836-7b4e-4e4c-83c2-8e0026398293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:31.181687 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a245836-7b4e-4e4c-83c2-8e0026398293 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:31.181965 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a245836-7b4e-4e4c-83c2-8e0026398293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:31.182261 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a245836-7b4e-4e4c-83c2-8e0026398293 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:31.182892 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a245836-7b4e-4e4c-83c2-8e0026398293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:31.184507 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a245836-7b4e-4e4c-83c2-8e0026398293 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:31.194447 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1156/2281] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:31.199217 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a97210-8228-4cb9-a56e-0df49664f4cb admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:31.209262 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a97210-8228-4cb9-a56e-0df49664f4cb admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:31.214026 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ef5e3-c232-4938-9d83-8e81fd312a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:31.214620 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ef5e3-c232-4938-9d83-8e81fd312a4a admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:31.214905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ef5e3-c232-4938-9d83-8e81fd312a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:31.215211 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ef5e3-c232-4938-9d83-8e81fd312a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:31.215881 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ef5e3-c232-4938-9d83-8e81fd312a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:31.217478 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ef5e3-c232-4938-9d83-8e81fd312a4a admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:31.228426 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1126/2282] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:31.237622 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a245836-7b4e-4e4c-83c2-8e0026398293 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:31.249054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a245836-7b4e-4e4c-83c2-8e0026398293 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:31.253704 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e246a-3520-47c7-b0ba-940a7b3d024b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:31.254358 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e246a-3520-47c7-b0ba-940a7b3d024b admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:31.254641 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e246a-3520-47c7-b0ba-940a7b3d024b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:31.254918 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e246a-3520-47c7-b0ba-940a7b3d024b admin admin] PATH_INFO: `/v3/projects/c1b895a4f15b4f3faeae1e01a909adee/users/07d355065c7445e89e9cf37f7a53f059/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:31.269993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e246a-3520-47c7-b0ba-940a7b3d024b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b895a4f15b4f3faeae1e01a909adee, user_id=07d355065c7445e89e9cf37f7a53f059, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:31.272700 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e246a-3520-47c7-b0ba-940a7b3d024b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:31.285237 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1157/2283] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:41:31 2022] PUT /identity/v3/projects/c1b895a4f15b4f3faeae1e01a909adee/users/07d355065c7445e89e9cf37f7a53f059/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:41:31.296755 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554d518-7db9-4af8-802f-894bf1aa148b None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:31.297000 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554d518-7db9-4af8-802f-894bf1aa148b None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:31.297265 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554d518-7db9-4af8-802f-894bf1aa148b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:31.327131 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-8554d518-7db9-4af8-802f-894bf1aa148b None None] MFA Rules not processed for user `07d355065c7445e89e9cf37f7a53f059`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:31.328277 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-8554d518-7db9-4af8-802f-894bf1aa148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:31.391229 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1127/2284] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:31.401930 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e246a-3520-47c7-b0ba-940a7b3d024b admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:31.403632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-4e0e246a-3520-47c7-b0ba-940a7b3d024b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:31.425280 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:31.463909 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e246a-3520-47c7-b0ba-940a7b3d024b admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:31.467624 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0febe-31ed-4ef1-809c-d00724394194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:31.468226 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0febe-31ed-4ef1-809c-d00724394194 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:31.468503 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0febe-31ed-4ef1-809c-d00724394194 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:31.468774 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0febe-31ed-4ef1-809c-d00724394194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:31.476893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0febe-31ed-4ef1-809c-d00724394194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:31.478354 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0febe-31ed-4ef1-809c-d00724394194 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:31.486879 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1158/2285] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:34.515405 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554d518-7db9-4af8-802f-894bf1aa148b None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:34.534191 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:34.579014 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554d518-7db9-4af8-802f-894bf1aa148b None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:34.583470 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725294c-b09d-4e8a-bfc1-d3629345a423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:34.584093 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725294c-b09d-4e8a-bfc1-d3629345a423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:34.584375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725294c-b09d-4e8a-bfc1-d3629345a423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:34.584650 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725294c-b09d-4e8a-bfc1-d3629345a423 admin admin] PATH_INFO: `/v3/users/07d355065c7445e89e9cf37f7a53f059` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:34.585769 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725294c-b09d-4e8a-bfc1-d3629345a423 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d355065c7445e89e9cf37f7a53f059)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:34.587742 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725294c-b09d-4e8a-bfc1-d3629345a423 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:34.634278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-3725294c-b09d-4e8a-bfc1-d3629345a423 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d355065c7445e89e9cf37f7a53f059'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:34.634912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-3725294c-b09d-4e8a-bfc1-d3629345a423 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d355065c7445e89e9cf37f7a53f059'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:34.641903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-3725294c-b09d-4e8a-bfc1-d3629345a423 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d355065c7445e89e9cf37f7a53f059'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:34.653882 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-3725294c-b09d-4e8a-bfc1-d3629345a423 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d355065c7445e89e9cf37f7a53f059'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:34.654536 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-3725294c-b09d-4e8a-bfc1-d3629345a423 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d355065c7445e89e9cf37f7a53f059'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:34.667877 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1128/2286] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:41:34 2022] DELETE /identity/v3/users/07d355065c7445e89e9cf37f7a53f059 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:41:34.672321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd9ed7-43f1-4e92-bf8d-12aef29a7a8c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:34.672844 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd9ed7-43f1-4e92-bf8d-12aef29a7a8c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:34.672959 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd9ed7-43f1-4e92-bf8d-12aef29a7a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:34.692186 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-2abd9ed7-43f1-4e92-bf8d-12aef29a7a8c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:34.693381 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2abd9ed7-43f1-4e92-bf8d-12aef29a7a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:34.754785 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1159/2287] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:34.764825 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725294c-b09d-4e8a-bfc1-d3629345a423 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:34.766318 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-3725294c-b09d-4e8a-bfc1-d3629345a423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:34.823124 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725294c-b09d-4e8a-bfc1-d3629345a423 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:34.826745 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828cd91-d32d-4e14-859f-6a31caced5ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:34.827373 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828cd91-d32d-4e14-859f-6a31caced5ec service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:34.827651 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828cd91-d32d-4e14-859f-6a31caced5ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:34.827920 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828cd91-d32d-4e14-859f-6a31caced5ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:34.836715 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828cd91-d32d-4e14-859f-6a31caced5ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:34.838759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828cd91-d32d-4e14-859f-6a31caced5ec service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:34.848016 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1129/2288] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:35.109741 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd9ed7-43f1-4e92-bf8d-12aef29a7a8c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:35.111318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2abd9ed7-43f1-4e92-bf8d-12aef29a7a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:35.129258 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd9ed7-43f1-4e92-bf8d-12aef29a7a8c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:35.134849 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270214fd-4cba-4aad-8ca4-a196140a13fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:35.135470 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270214fd-4cba-4aad-8ca4-a196140a13fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:35.135866 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270214fd-4cba-4aad-8ca4-a196140a13fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:35.136161 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270214fd-4cba-4aad-8ca4-a196140a13fe admin admin] PATH_INFO: `/v3/projects/c1b895a4f15b4f3faeae1e01a909adee` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:35.137714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270214fd-4cba-4aad-8ca4-a196140a13fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b895a4f15b4f3faeae1e01a909adee)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:35.140115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270214fd-4cba-4aad-8ca4-a196140a13fe admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:35.198623 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-270214fd-4cba-4aad-8ca4-a196140a13fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b895a4f15b4f3faeae1e01a909adee', 'request_id': 'req-270214fd-4cba-4aad-8ca4-a196140a13fe'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:35.211139 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-270214fd-4cba-4aad-8ca4-a196140a13fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b895a4f15b4f3faeae1e01a909adee', 'request_id': 'req-270214fd-4cba-4aad-8ca4-a196140a13fe'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:35.218297 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-270214fd-4cba-4aad-8ca4-a196140a13fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b895a4f15b4f3faeae1e01a909adee', 'request_id': 'req-270214fd-4cba-4aad-8ca4-a196140a13fe'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:35.230133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-270214fd-4cba-4aad-8ca4-a196140a13fe admin admin] The token cache is being invalidate because project c1b895a4f15b4f3faeae1e01a909adee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:41:35.230421 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-270214fd-4cba-4aad-8ca4-a196140a13fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:35.231125 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-270214fd-4cba-4aad-8ca4-a196140a13fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:35.232642 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1160/2289] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:41:35 2022] DELETE /identity/v3/projects/c1b895a4f15b4f3faeae1e01a909adee => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:35.237588 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdaf1b-6e84-43dd-8b31-35c923d2195a None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:35.237870 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdaf1b-6e84-43dd-8b31-35c923d2195a None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:35.238141 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbdaf1b-6e84-43dd-8b31-35c923d2195a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:35.257930 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-7bbdaf1b-6e84-43dd-8b31-35c923d2195a None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:35.259708 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7bbdaf1b-6e84-43dd-8b31-35c923d2195a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:35.296260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:35.324864 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1130/2290] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:35.332599 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f19a25-7565-4e2b-a88d-8ba5b3c98c67 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:35.332879 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f19a25-7565-4e2b-a88d-8ba5b3c98c67 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:35.333151 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f19a25-7565-4e2b-a88d-8ba5b3c98c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:35.354394 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-a5f19a25-7565-4e2b-a88d-8ba5b3c98c67 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:35.355645 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a5f19a25-7565-4e2b-a88d-8ba5b3c98c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:35.364372 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1161/2291] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:35.368802 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdaf1b-6e84-43dd-8b31-35c923d2195a None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:35.378627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbdaf1b-6e84-43dd-8b31-35c923d2195a None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:35.383394 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36052772-89ef-4a66-95fe-ff58148877fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:35.384564 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36052772-89ef-4a66-95fe-ff58148877fc admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:35.384843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36052772-89ef-4a66-95fe-ff58148877fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:35.385117 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36052772-89ef-4a66-95fe-ff58148877fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:35.385767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36052772-89ef-4a66-95fe-ff58148877fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:41:35.386122 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36052772-89ef-4a66-95fe-ff58148877fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:35.387792 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36052772-89ef-4a66-95fe-ff58148877fc admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:35.404841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1131/2292] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:41:35.405955 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f19a25-7565-4e2b-a88d-8ba5b3c98c67 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:35.416498 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f19a25-7565-4e2b-a88d-8ba5b3c98c67 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:35.421742 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f81b1-cb48-4695-9d90-40e8cb90f137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:35.422350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f81b1-cb48-4695-9d90-40e8cb90f137 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:35.422770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f81b1-cb48-4695-9d90-40e8cb90f137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:35.423092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f81b1-cb48-4695-9d90-40e8cb90f137 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:35.423765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f81b1-cb48-4695-9d90-40e8cb90f137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:35.425658 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f81b1-cb48-4695-9d90-40e8cb90f137 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:35.458179 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1162/2293] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:41:35 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:35.463154 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36052772-89ef-4a66-95fe-ff58148877fc admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:35.473066 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36052772-89ef-4a66-95fe-ff58148877fc admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:35.528218 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43573b-cb21-4bff-a429-75f2356916c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:35.528880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43573b-cb21-4bff-a429-75f2356916c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:35.529086 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43573b-cb21-4bff-a429-75f2356916c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:35.529356 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43573b-cb21-4bff-a429-75f2356916c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:35.529989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43573b-cb21-4bff-a429-75f2356916c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:35.531921 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43573b-cb21-4bff-a429-75f2356916c1 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:35.553533 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1132/2294] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:41:35 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:41:35.557612 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f81b1-cb48-4695-9d90-40e8cb90f137 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:35.567913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f81b1-cb48-4695-9d90-40e8cb90f137 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:35.572652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2acb6-0ca0-4d65-b453-be7f8b683d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:35.573247 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2acb6-0ca0-4d65-b453-be7f8b683d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:35.573528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2acb6-0ca0-4d65-b453-be7f8b683d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:35.573801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2acb6-0ca0-4d65-b453-be7f8b683d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:35.574471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2acb6-0ca0-4d65-b453-be7f8b683d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:35.576090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2acb6-0ca0-4d65-b453-be7f8b683d87 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:35.585838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1163/2295] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:35.590335 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43573b-cb21-4bff-a429-75f2356916c1 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:35.600142 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43573b-cb21-4bff-a429-75f2356916c1 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:35.605305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aabc49-6229-42cc-b113-49db1e1056c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:35.605894 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aabc49-6229-42cc-b113-49db1e1056c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:35.606175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aabc49-6229-42cc-b113-49db1e1056c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:35.606549 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aabc49-6229-42cc-b113-49db1e1056c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:35.607127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aabc49-6229-42cc-b113-49db1e1056c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:35.608704 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aabc49-6229-42cc-b113-49db1e1056c3 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:35.619347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1133/2296] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:35.623490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2acb6-0ca0-4d65-b453-be7f8b683d87 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:35.633806 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2acb6-0ca0-4d65-b453-be7f8b683d87 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:35.638678 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c10b99-6b76-480a-b857-75938cbf187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:35.639362 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c10b99-6b76-480a-b857-75938cbf187b admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:35.639641 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c10b99-6b76-480a-b857-75938cbf187b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:35.639917 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c10b99-6b76-480a-b857-75938cbf187b admin admin] PATH_INFO: `/v3/projects/f2d41338bdf14662982540d1f63f1b31/users/8b2e02a84d124f79a977a6eb5e9c5637/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:35.642078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:35.657157 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c10b99-6b76-480a-b857-75938cbf187b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d41338bdf14662982540d1f63f1b31, user_id=8b2e02a84d124f79a977a6eb5e9c5637, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:35.659882 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c10b99-6b76-480a-b857-75938cbf187b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:35.672697 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1164/2297] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:41:35 2022] PUT /identity/v3/projects/f2d41338bdf14662982540d1f63f1b31/users/8b2e02a84d124f79a977a6eb5e9c5637/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:35.684240 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46939e-8afd-4a38-9d08-967e3d610d2c None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:35.684522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46939e-8afd-4a38-9d08-967e3d610d2c None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:35.684793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46939e-8afd-4a38-9d08-967e3d610d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:35.712747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-0f46939e-8afd-4a38-9d08-967e3d610d2c None None] MFA Rules not processed for user `8b2e02a84d124f79a977a6eb5e9c5637`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:35.713943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0f46939e-8afd-4a38-9d08-967e3d610d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:35.778069 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1134/2298] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:35.789564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c10b99-6b76-480a-b857-75938cbf187b admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:35.791883 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-26c10b99-6b76-480a-b857-75938cbf187b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:35.847498 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c10b99-6b76-480a-b857-75938cbf187b admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:35.851120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8683d39-0a2c-4690-8876-88aade809f6b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d026ec6ed344404a5ebe4352792cc1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:35.851714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683d39-0a2c-4690-8876-88aade809f6b service glance] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:35.851987 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683d39-0a2c-4690-8876-88aade809f6b service glance] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:35.852254 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8683d39-0a2c-4690-8876-88aade809f6b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:35.860791 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8683d39-0a2c-4690-8876-88aade809f6b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:35.862194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8683d39-0a2c-4690-8876-88aade809f6b service glance] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:35.871197 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1165/2299] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:41:40.640302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46939e-8afd-4a38-9d08-967e3d610d2c None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:40.641872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0f46939e-8afd-4a38-9d08-967e3d610d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:40.691379 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:40.738873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46939e-8afd-4a38-9d08-967e3d610d2c None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:40.745921 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ce57e-d28b-49a7-9168-92be0816249e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:40.746646 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ce57e-d28b-49a7-9168-92be0816249e service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:40.746935 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ce57e-d28b-49a7-9168-92be0816249e service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:40.747239 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ce57e-d28b-49a7-9168-92be0816249e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:40.749333 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-403ce57e-d28b-49a7-9168-92be0816249e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:40.768647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ce57e-d28b-49a7-9168-92be0816249e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:40.772269 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ce57e-d28b-49a7-9168-92be0816249e service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:40.786214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1135/2300] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:42.615825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c029917-53a4-4970-99ad-e759768b292f None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:42.616404 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c029917-53a4-4970-99ad-e759768b292f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:42.616404 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c029917-53a4-4970-99ad-e759768b292f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:42.639382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0c029917-53a4-4970-99ad-e759768b292f None None] MFA Rules not processed for user `44342daa668c4516ae131d9f0160261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:42.640601 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0c029917-53a4-4970-99ad-e759768b292f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:42.713384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1166/2301] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Oct 20 13:41:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:42.762240 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ce57e-d28b-49a7-9168-92be0816249e service nova] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:42.763836 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-403ce57e-d28b-49a7-9168-92be0816249e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:42.836608 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ce57e-d28b-49a7-9168-92be0816249e service nova] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:42.842203 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1196c7-dded-417a-a575-da25c5a91c7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c893e6388ed340eca17da2e279ca34a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:42.842801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1196c7-dded-417a-a575-da25c5a91c7c service swift] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:42.843111 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1196c7-dded-417a-a575-da25c5a91c7c service swift] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:42.843383 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1196c7-dded-417a-a575-da25c5a91c7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:42.851166 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1196c7-dded-417a-a575-da25c5a91c7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:42.852724 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1196c7-dded-417a-a575-da25c5a91c7c service swift] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:42.860635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1136/2302] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Oct 20 13:41:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 20 13:41:43.154631 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c029917-53a4-4970-99ad-e759768b292f None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:43.174309 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c029917-53a4-4970-99ad-e759768b292f None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:43.184559 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa721d-dfb7-402b-ba96-86a44bb974b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:43.185363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa721d-dfb7-402b-ba96-86a44bb974b8 service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:43.185878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa721d-dfb7-402b-ba96-86a44bb974b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:43.186258 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa721d-dfb7-402b-ba96-86a44bb974b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:43.188460 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-48aa721d-dfb7-402b-ba96-86a44bb974b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:43.203916 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa721d-dfb7-402b-ba96-86a44bb974b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:43.206247 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa721d-dfb7-402b-ba96-86a44bb974b8 service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:43.232520 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1167/2303] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:45.617645 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1196c7-dded-417a-a575-da25c5a91c7c service swift] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:45.619313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-cb1196c7-dded-417a-a575-da25c5a91c7c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:45.693094 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1196c7-dded-417a-a575-da25c5a91c7c service swift] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:45.696776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d254ee-5184-4d0f-b649-bff26d7ec319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:45.697418 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d254ee-5184-4d0f-b649-bff26d7ec319 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:45.697669 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d254ee-5184-4d0f-b649-bff26d7ec319 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:45.698522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d254ee-5184-4d0f-b649-bff26d7ec319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:45.701221 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-22d254ee-5184-4d0f-b649-bff26d7ec319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:45.711918 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d254ee-5184-4d0f-b649-bff26d7ec319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:45.722713 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d254ee-5184-4d0f-b649-bff26d7ec319 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:45.733105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1137/2304] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:48.134759 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa721d-dfb7-402b-ba96-86a44bb974b8 service nova] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:48.135418 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-48aa721d-dfb7-402b-ba96-86a44bb974b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:48.149191 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa721d-dfb7-402b-ba96-86a44bb974b8 service nova] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:48.153490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae925b-7279-4a5e-b20a-08c9ee2100ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:48.155814 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae925b-7279-4a5e-b20a-08c9ee2100ef service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:48.155814 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae925b-7279-4a5e-b20a-08c9ee2100ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:48.155814 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae925b-7279-4a5e-b20a-08c9ee2100ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:48.158802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-aeae925b-7279-4a5e-b20a-08c9ee2100ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:48.245111 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae925b-7279-4a5e-b20a-08c9ee2100ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:48.249671 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae925b-7279-4a5e-b20a-08c9ee2100ef service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:48.274336 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1168/2305] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:50.341955 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d254ee-5184-4d0f-b649-bff26d7ec319 service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:50.343979 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-22d254ee-5184-4d0f-b649-bff26d7ec319 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:50.409796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:50.434920 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d254ee-5184-4d0f-b649-bff26d7ec319 service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:50.440222 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41410c0-2cf8-4a6a-a28f-86adfd8fa7dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a00f0b4cee8d49a48a95317aec9f647c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:50.440859 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41410c0-2cf8-4a6a-a28f-86adfd8fa7dd service placement] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:50.441310 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41410c0-2cf8-4a6a-a28f-86adfd8fa7dd service placement] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:50.441797 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41410c0-2cf8-4a6a-a28f-86adfd8fa7dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:50.444047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae925b-7279-4a5e-b20a-08c9ee2100ef service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:50.445101 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b41410c0-2cf8-4a6a-a28f-86adfd8fa7dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:50.446478 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-aeae925b-7279-4a5e-b20a-08c9ee2100ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:50.459835 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41410c0-2cf8-4a6a-a28f-86adfd8fa7dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:50.461106 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae925b-7279-4a5e-b20a-08c9ee2100ef service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:50.461488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41410c0-2cf8-4a6a-a28f-86adfd8fa7dd service placement] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:50.467483 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513dac0-2005-46a0-a752-ce6f9ba1030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:50.468410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513dac0-2005-46a0-a752-ce6f9ba1030c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:50.468859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513dac0-2005-46a0-a752-ce6f9ba1030c admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:50.469280 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513dac0-2005-46a0-a752-ce6f9ba1030c admin admin] PATH_INFO: `/v3/users/b3455d2a3c3d4d139544e88e7b04b0d3` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:50.470567 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513dac0-2005-46a0-a752-ce6f9ba1030c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3455d2a3c3d4d139544e88e7b04b0d3)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:50.472863 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513dac0-2005-46a0-a752-ce6f9ba1030c admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:50.476072 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1138/2306] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:50.480925 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:50.568695 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-3513dac0-2005-46a0-a752-ce6f9ba1030c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3455d2a3c3d4d139544e88e7b04b0d3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:50.569508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-3513dac0-2005-46a0-a752-ce6f9ba1030c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3455d2a3c3d4d139544e88e7b04b0d3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:50.578435 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-3513dac0-2005-46a0-a752-ce6f9ba1030c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3455d2a3c3d4d139544e88e7b04b0d3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:50.622432 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-3513dac0-2005-46a0-a752-ce6f9ba1030c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3455d2a3c3d4d139544e88e7b04b0d3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:50.623271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-3513dac0-2005-46a0-a752-ce6f9ba1030c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3455d2a3c3d4d139544e88e7b04b0d3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:50.645142 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1169/2307] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:41:50 2022] DELETE /identity/v3/users/b3455d2a3c3d4d139544e88e7b04b0d3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:41:50.870911 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41410c0-2cf8-4a6a-a28f-86adfd8fa7dd service placement] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:50.897440 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41410c0-2cf8-4a6a-a28f-86adfd8fa7dd service placement] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:51.037647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980da101-a1c4-4382-9a02-50bcebaf4345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:51.043414 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980da101-a1c4-4382-9a02-50bcebaf4345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:51.043941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980da101-a1c4-4382-9a02-50bcebaf4345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:51.044373 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980da101-a1c4-4382-9a02-50bcebaf4345 admin admin] PATH_INFO: `/v3/projects/a42d68adcb2d4ab3b51590dcdbb8cfbc` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:51.046214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980da101-a1c4-4382-9a02-50bcebaf4345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42d68adcb2d4ab3b51590dcdbb8cfbc)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:51.048843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980da101-a1c4-4382-9a02-50bcebaf4345 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:51.116981 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-980da101-a1c4-4382-9a02-50bcebaf4345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42d68adcb2d4ab3b51590dcdbb8cfbc', 'request_id': 'req-980da101-a1c4-4382-9a02-50bcebaf4345'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:51.126761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-980da101-a1c4-4382-9a02-50bcebaf4345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42d68adcb2d4ab3b51590dcdbb8cfbc', 'request_id': 'req-980da101-a1c4-4382-9a02-50bcebaf4345'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:51.133037 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-980da101-a1c4-4382-9a02-50bcebaf4345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42d68adcb2d4ab3b51590dcdbb8cfbc', 'request_id': 'req-980da101-a1c4-4382-9a02-50bcebaf4345'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:51.148705 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-980da101-a1c4-4382-9a02-50bcebaf4345 admin admin] The token cache is being invalidate because project a42d68adcb2d4ab3b51590dcdbb8cfbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:41:51.149283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-980da101-a1c4-4382-9a02-50bcebaf4345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:51.149982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-980da101-a1c4-4382-9a02-50bcebaf4345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:51.152919 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1139/2308] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:41:50 2022] DELETE /identity/v3/projects/a42d68adcb2d4ab3b51590dcdbb8cfbc => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:51.158387 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cef2f-8483-46ec-a01b-c4f2b722d9e8 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:51.158874 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cef2f-8483-46ec-a01b-c4f2b722d9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:51.159249 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cef2f-8483-46ec-a01b-c4f2b722d9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:51.184943 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-8e5cef2f-8483-46ec-a01b-c4f2b722d9e8 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:51.186294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-8e5cef2f-8483-46ec-a01b-c4f2b722d9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:51.268014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1170/2309] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:51.269503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91dc76-61a8-4326-b5fb-46523dae2632 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:51.269870 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91dc76-61a8-4326-b5fb-46523dae2632 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:51.270248 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91dc76-61a8-4326-b5fb-46523dae2632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:51.294668 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-fe91dc76-61a8-4326-b5fb-46523dae2632 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:51.295842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-fe91dc76-61a8-4326-b5fb-46523dae2632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:51.308144 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1140/2310] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:41:51.312745 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cef2f-8483-46ec-a01b-c4f2b722d9e8 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:51.324406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cef2f-8483-46ec-a01b-c4f2b722d9e8 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:51.329078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d0a54-fff1-4a6b-83fa-686139e46894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:51.329737 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d0a54-fff1-4a6b-83fa-686139e46894 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:51.330063 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d0a54-fff1-4a6b-83fa-686139e46894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:51.330339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d0a54-fff1-4a6b-83fa-686139e46894 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:51.331006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d0a54-fff1-4a6b-83fa-686139e46894 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:41:51.331316 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d0a54-fff1-4a6b-83fa-686139e46894 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:51.333364 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d0a54-fff1-4a6b-83fa-686139e46894 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:51.348624 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1171/2311] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:41:51.355517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91dc76-61a8-4326-b5fb-46523dae2632 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:51.371202 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91dc76-61a8-4326-b5fb-46523dae2632 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:51.378034 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d3898-c0d0-4fc1-a38f-b01dc9ae9466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:51.379092 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d3898-c0d0-4fc1-a38f-b01dc9ae9466 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:51.379725 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d3898-c0d0-4fc1-a38f-b01dc9ae9466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:51.380225 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d3898-c0d0-4fc1-a38f-b01dc9ae9466 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:51.381279 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d3898-c0d0-4fc1-a38f-b01dc9ae9466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:51.385722 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d3898-c0d0-4fc1-a38f-b01dc9ae9466 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:51.433500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1141/2312] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:41:51 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:51.437738 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d0a54-fff1-4a6b-83fa-686139e46894 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:51.449300 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d0a54-fff1-4a6b-83fa-686139e46894 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:51.537295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a4755-e723-4228-9c58-ac075283d44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:51.537922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a4755-e723-4228-9c58-ac075283d44c admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:51.538206 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a4755-e723-4228-9c58-ac075283d44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:51.538599 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14a4755-e723-4228-9c58-ac075283d44c admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:51.539290 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a4755-e723-4228-9c58-ac075283d44c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:51.541508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14a4755-e723-4228-9c58-ac075283d44c admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:51.579159 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:51.591263 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1172/2313] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:41:51 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:51.597648 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d3898-c0d0-4fc1-a38f-b01dc9ae9466 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:51.613863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d3898-c0d0-4fc1-a38f-b01dc9ae9466 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:51.619338 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41f6a7-019d-4a1e-8cb4-6e9338320b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:51.620097 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41f6a7-019d-4a1e-8cb4-6e9338320b29 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:51.620371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41f6a7-019d-4a1e-8cb4-6e9338320b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:51.620646 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41f6a7-019d-4a1e-8cb4-6e9338320b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:51.621290 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41f6a7-019d-4a1e-8cb4-6e9338320b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:51.623006 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41f6a7-019d-4a1e-8cb4-6e9338320b29 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:51.640983 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1142/2314] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:51.642516 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a4755-e723-4228-9c58-ac075283d44c admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:51.655133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14a4755-e723-4228-9c58-ac075283d44c admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:51.661729 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242034de-fd36-43d0-98e0-84821d9e53d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:51.662347 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242034de-fd36-43d0-98e0-84821d9e53d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:51.662632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242034de-fd36-43d0-98e0-84821d9e53d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:51.662910 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242034de-fd36-43d0-98e0-84821d9e53d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:51.663609 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242034de-fd36-43d0-98e0-84821d9e53d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:51.665258 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242034de-fd36-43d0-98e0-84821d9e53d3 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:51.681033 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1173/2315] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:51.682799 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41f6a7-019d-4a1e-8cb4-6e9338320b29 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:51.694627 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41f6a7-019d-4a1e-8cb4-6e9338320b29 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:51.700147 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99205a22-adfe-433b-ad1f-34179058fe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:51.700992 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99205a22-adfe-433b-ad1f-34179058fe17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:51.701294 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99205a22-adfe-433b-ad1f-34179058fe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:51.701669 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99205a22-adfe-433b-ad1f-34179058fe17 admin admin] PATH_INFO: `/v3/projects/6575b7bc71d84a1e9f78dde16103a023/users/ed8ce799569646d3a52689781300bf69/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:51.720767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99205a22-adfe-433b-ad1f-34179058fe17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6575b7bc71d84a1e9f78dde16103a023, user_id=ed8ce799569646d3a52689781300bf69, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:51.723842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99205a22-adfe-433b-ad1f-34179058fe17 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:51.737969 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1143/2316] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:41:51 2022] PUT /identity/v3/projects/6575b7bc71d84a1e9f78dde16103a023/users/ed8ce799569646d3a52689781300bf69/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:51.749180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ab7ab-8f6a-427c-bb72-384792c441bc None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:51.749482 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ab7ab-8f6a-427c-bb72-384792c441bc None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:51.749757 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ab7ab-8f6a-427c-bb72-384792c441bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:51.782647 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-a41ab7ab-8f6a-427c-bb72-384792c441bc None None] MFA Rules not processed for user `ed8ce799569646d3a52689781300bf69`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:51.784257 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a41ab7ab-8f6a-427c-bb72-384792c441bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:51.856170 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1174/2317] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:51.872240 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99205a22-adfe-433b-ad1f-34179058fe17 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:51.874794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-99205a22-adfe-433b-ad1f-34179058fe17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:51.891029 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:51.974045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99205a22-adfe-433b-ad1f-34179058fe17 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:51.980541 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94ec86-1850-436c-afc6-4f927203979a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:51.981155 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94ec86-1850-436c-afc6-4f927203979a service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:51.981434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94ec86-1850-436c-afc6-4f927203979a service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:51.981701 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94ec86-1850-436c-afc6-4f927203979a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:51.990859 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94ec86-1850-436c-afc6-4f927203979a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:51.992499 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94ec86-1850-436c-afc6-4f927203979a service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:52.002328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1144/2318] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:52.298223 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ab7ab-8f6a-427c-bb72-384792c441bc None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:52.385187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ab7ab-8f6a-427c-bb72-384792c441bc None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:52.408123 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3748c05-0308-48f0-a298-0487d5091fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:52.409105 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3748c05-0308-48f0-a298-0487d5091fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:52.409519 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3748c05-0308-48f0-a298-0487d5091fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:52.409873 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3748c05-0308-48f0-a298-0487d5091fe2 admin admin] PATH_INFO: `/v3/users/ed8ce799569646d3a52689781300bf69` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:52.412322 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3748c05-0308-48f0-a298-0487d5091fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed8ce799569646d3a52689781300bf69)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:52.415385 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3748c05-0308-48f0-a298-0487d5091fe2 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:52.470891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f3748c05-0308-48f0-a298-0487d5091fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed8ce799569646d3a52689781300bf69'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:52.471669 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f3748c05-0308-48f0-a298-0487d5091fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed8ce799569646d3a52689781300bf69'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:52.480360 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f3748c05-0308-48f0-a298-0487d5091fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed8ce799569646d3a52689781300bf69'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:52.497283 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f3748c05-0308-48f0-a298-0487d5091fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed8ce799569646d3a52689781300bf69'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:52.498027 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f3748c05-0308-48f0-a298-0487d5091fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed8ce799569646d3a52689781300bf69'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:52.509641 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:52.517152 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1175/2319] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:41:52 2022] DELETE /identity/v3/users/ed8ce799569646d3a52689781300bf69 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:52.521977 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9c4d0-1efe-40a7-a05b-1d41e438d299 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:52.523045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9c4d0-1efe-40a7-a05b-1d41e438d299 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:52.523485 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9c4d0-1efe-40a7-a05b-1d41e438d299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:52.549392 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-71c9c4d0-1efe-40a7-a05b-1d41e438d299 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:52.551119 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-71c9c4d0-1efe-40a7-a05b-1d41e438d299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:52.629492 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1145/2320] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:52.644627 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3748c05-0308-48f0-a298-0487d5091fe2 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:52.646107 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f3748c05-0308-48f0-a298-0487d5091fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:52.722192 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3748c05-0308-48f0-a298-0487d5091fe2 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:52.727071 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc569a74-885c-4927-810c-bcc0ace350ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:52.727749 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc569a74-885c-4927-810c-bcc0ace350ea service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:52.728030 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc569a74-885c-4927-810c-bcc0ace350ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:52.728483 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc569a74-885c-4927-810c-bcc0ace350ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:52.742923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc569a74-885c-4927-810c-bcc0ace350ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:52.745287 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc569a74-885c-4927-810c-bcc0ace350ea service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:52.756467 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1176/2321] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:53.080266 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9c4d0-1efe-40a7-a05b-1d41e438d299 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:53.081944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-71c9c4d0-1efe-40a7-a05b-1d41e438d299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:53.095203 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9c4d0-1efe-40a7-a05b-1d41e438d299 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:53.100344 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c6354a-ca95-4579-8826-2d68db637053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:53.101119 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6354a-ca95-4579-8826-2d68db637053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:53.101504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6354a-ca95-4579-8826-2d68db637053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:53.101879 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c6354a-ca95-4579-8826-2d68db637053 admin admin] PATH_INFO: `/v3/projects/6575b7bc71d84a1e9f78dde16103a023` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:53.103366 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6354a-ca95-4579-8826-2d68db637053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6575b7bc71d84a1e9f78dde16103a023)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:53.106399 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c6354a-ca95-4579-8826-2d68db637053 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:53.179415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d0c6354a-ca95-4579-8826-2d68db637053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6575b7bc71d84a1e9f78dde16103a023', 'request_id': 'req-d0c6354a-ca95-4579-8826-2d68db637053'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:53.186176 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d0c6354a-ca95-4579-8826-2d68db637053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6575b7bc71d84a1e9f78dde16103a023', 'request_id': 'req-d0c6354a-ca95-4579-8826-2d68db637053'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:53.192502 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d0c6354a-ca95-4579-8826-2d68db637053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6575b7bc71d84a1e9f78dde16103a023', 'request_id': 'req-d0c6354a-ca95-4579-8826-2d68db637053'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:53.207037 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d0c6354a-ca95-4579-8826-2d68db637053 admin admin] The token cache is being invalidate because project 6575b7bc71d84a1e9f78dde16103a023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:41:53.207334 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d0c6354a-ca95-4579-8826-2d68db637053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:53.208002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-d0c6354a-ca95-4579-8826-2d68db637053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:53.209506 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1146/2322] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:41:53 2022] DELETE /identity/v3/projects/6575b7bc71d84a1e9f78dde16103a023 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:53.214676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e46e44-9649-4355-b1e6-07785544e7e8 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:53.215064 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e46e44-9649-4355-b1e6-07785544e7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:53.215434 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e46e44-9649-4355-b1e6-07785544e7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:53.236764 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-81e46e44-9649-4355-b1e6-07785544e7e8 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:53.237984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-81e46e44-9649-4355-b1e6-07785544e7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:53.300307 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1177/2323] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:53.309910 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345fd76-429d-479f-aba5-d791c36eeb7d None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:53.310198 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345fd76-429d-479f-aba5-d791c36eeb7d None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:53.310476 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a345fd76-429d-479f-aba5-d791c36eeb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:53.332408 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-a345fd76-429d-479f-aba5-d791c36eeb7d None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:53.333610 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-a345fd76-429d-479f-aba5-d791c36eeb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:53.342331 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1147/2324] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:53.346654 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e46e44-9649-4355-b1e6-07785544e7e8 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:53.356574 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e46e44-9649-4355-b1e6-07785544e7e8 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:53.361134 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b4098-d94f-4654-b25d-094e42d31b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:53.361725 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b4098-d94f-4654-b25d-094e42d31b82 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:53.362000 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b4098-d94f-4654-b25d-094e42d31b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:53.362269 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b4098-d94f-4654-b25d-094e42d31b82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:53.362901 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b4098-d94f-4654-b25d-094e42d31b82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:41:53.363234 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b4098-d94f-4654-b25d-094e42d31b82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:53.364820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b4098-d94f-4654-b25d-094e42d31b82 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:53.376014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1178/2325] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:41:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:41:53.380183 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345fd76-429d-479f-aba5-d791c36eeb7d None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:53.389671 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a345fd76-429d-479f-aba5-d791c36eeb7d None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:53.394243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be71164-0573-473f-8f08-06943d5a10b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:53.394826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be71164-0573-473f-8f08-06943d5a10b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:53.395200 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be71164-0573-473f-8f08-06943d5a10b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:53.395467 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be71164-0573-473f-8f08-06943d5a10b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:53.396091 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be71164-0573-473f-8f08-06943d5a10b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:53.397957 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be71164-0573-473f-8f08-06943d5a10b5 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:53.408011 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:53.429338 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1148/2326] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:41:53 2022] POST /identity/v3/projects => generated 357 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:41:53.434453 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b4098-d94f-4654-b25d-094e42d31b82 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:53.444778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b4098-d94f-4654-b25d-094e42d31b82 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:53.505194 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0e9c6-9048-4d5b-88a5-534516e1ebda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:53.505853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0e9c6-9048-4d5b-88a5-534516e1ebda admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:53.506112 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0e9c6-9048-4d5b-88a5-534516e1ebda admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:53.506368 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0e9c6-9048-4d5b-88a5-534516e1ebda admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:53.507166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0e9c6-9048-4d5b-88a5-534516e1ebda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:53.509090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0e9c6-9048-4d5b-88a5-534516e1ebda admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:53.533914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1179/2327] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:41:53 2022] POST /identity/v3/users => generated 279 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:53.535306 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be71164-0573-473f-8f08-06943d5a10b5 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:53.555174 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be71164-0573-473f-8f08-06943d5a10b5 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:53.561452 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aa295-3a2c-425a-840b-660e3c8286c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:53.562181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aa295-3a2c-425a-840b-660e3c8286c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:53.562554 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aa295-3a2c-425a-840b-660e3c8286c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:53.562914 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aa295-3a2c-425a-840b-660e3c8286c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:53.563704 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8aa295-3a2c-425a-840b-660e3c8286c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:53.565391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8aa295-3a2c-425a-840b-660e3c8286c8 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:53.575961 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1149/2328] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:53.579949 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0e9c6-9048-4d5b-88a5-534516e1ebda admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:53.590887 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0e9c6-9048-4d5b-88a5-534516e1ebda admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:53.597312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf077112-0888-46c1-9bf7-ffe2d67edd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:53.597905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf077112-0888-46c1-9bf7-ffe2d67edd54 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:53.598183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf077112-0888-46c1-9bf7-ffe2d67edd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:53.598450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf077112-0888-46c1-9bf7-ffe2d67edd54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:53.599115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf077112-0888-46c1-9bf7-ffe2d67edd54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:53.600819 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf077112-0888-46c1-9bf7-ffe2d67edd54 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:53.612121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1180/2329] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:53.616236 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aa295-3a2c-425a-840b-660e3c8286c8 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:53.626284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aa295-3a2c-425a-840b-660e3c8286c8 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:53.632038 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275fa2e-6cc2-4d36-9607-40e9c23b9605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:53.632700 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275fa2e-6cc2-4d36-9607-40e9c23b9605 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:53.632986 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275fa2e-6cc2-4d36-9607-40e9c23b9605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:53.633260 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275fa2e-6cc2-4d36-9607-40e9c23b9605 admin admin] PATH_INFO: `/v3/projects/1e78e247acf74b948c0ade35c621be80/users/761650a9563f4e828d34e86da5067845/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:53.648280 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275fa2e-6cc2-4d36-9607-40e9c23b9605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e78e247acf74b948c0ade35c621be80, user_id=761650a9563f4e828d34e86da5067845, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:53.652099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275fa2e-6cc2-4d36-9607-40e9c23b9605 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:53.665526 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1150/2330] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:41:53 2022] PUT /identity/v3/projects/1e78e247acf74b948c0ade35c621be80/users/761650a9563f4e828d34e86da5067845/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:53.676546 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77f23c-98cf-4593-adc5-66fb7b31ea12 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:53.676834 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77f23c-98cf-4593-adc5-66fb7b31ea12 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:53.677128 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77f23c-98cf-4593-adc5-66fb7b31ea12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:53.690873 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:53.705296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-1c77f23c-98cf-4593-adc5-66fb7b31ea12 None None] MFA Rules not processed for user `761650a9563f4e828d34e86da5067845`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:53.706494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1c77f23c-98cf-4593-adc5-66fb7b31ea12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:53.771162 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1181/2331] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:41:53.776326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275fa2e-6cc2-4d36-9607-40e9c23b9605 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:53.841432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275fa2e-6cc2-4d36-9607-40e9c23b9605 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:53.846218 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fc118-bf9c-49e9-9391-0ee594ac7ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:53.847198 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fc118-bf9c-49e9-9391-0ee594ac7ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:53.847503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fc118-bf9c-49e9-9391-0ee594ac7ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:53.847777 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425fc118-bf9c-49e9-9391-0ee594ac7ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:53.848411 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fc118-bf9c-49e9-9391-0ee594ac7ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:53.850320 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425fc118-bf9c-49e9-9391-0ee594ac7ab6 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:53.876767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1151/2332] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:41:53 2022] POST /identity/v3/projects => generated 353 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:53.880857 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77f23c-98cf-4593-adc5-66fb7b31ea12 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:53.892582 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77f23c-98cf-4593-adc5-66fb7b31ea12 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:53.957713 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bf7fe-fee6-457a-bc36-fb3dab76bf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:53.958245 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bf7fe-fee6-457a-bc36-fb3dab76bf6b admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:53.958527 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bf7fe-fee6-457a-bc36-fb3dab76bf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:53.958800 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bf7fe-fee6-457a-bc36-fb3dab76bf6b admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:53.959480 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bf7fe-fee6-457a-bc36-fb3dab76bf6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:53.961392 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bf7fe-fee6-457a-bc36-fb3dab76bf6b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:53.988120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1182/2333] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:41:53 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:41:53.989576 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fc118-bf9c-49e9-9391-0ee594ac7ab6 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:54.000909 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425fc118-bf9c-49e9-9391-0ee594ac7ab6 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:54.005898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b5d28-1cfd-49f8-ae5c-1aeb5a2a829e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:54.006589 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b5d28-1cfd-49f8-ae5c-1aeb5a2a829e admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:54.006936 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b5d28-1cfd-49f8-ae5c-1aeb5a2a829e admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:54.007429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b5d28-1cfd-49f8-ae5c-1aeb5a2a829e admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:54.008146 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b5d28-1cfd-49f8-ae5c-1aeb5a2a829e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:54.009818 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b5d28-1cfd-49f8-ae5c-1aeb5a2a829e admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:54.021252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1152/2334] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:41:54.025427 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bf7fe-fee6-457a-bc36-fb3dab76bf6b admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:54.035944 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bf7fe-fee6-457a-bc36-fb3dab76bf6b admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:54.040600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ea4df-60fd-4dbb-a773-950d2c840444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:54.041837 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ea4df-60fd-4dbb-a773-950d2c840444 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:54.042668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ea4df-60fd-4dbb-a773-950d2c840444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:54.042971 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ea4df-60fd-4dbb-a773-950d2c840444 admin admin] PATH_INFO: `/v3/projects/884912e209554fa3b3e82d341ccab4ad/users/e84a62bce8984401b78c6846f17ef3ca/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:54.059055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ea4df-60fd-4dbb-a773-950d2c840444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884912e209554fa3b3e82d341ccab4ad, user_id=e84a62bce8984401b78c6846f17ef3ca, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:54.061821 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ea4df-60fd-4dbb-a773-950d2c840444 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:54.076469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1183/2335] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:41:54 2022] PUT /identity/v3/projects/884912e209554fa3b3e82d341ccab4ad/users/e84a62bce8984401b78c6846f17ef3ca/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:54.080510 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b5d28-1cfd-49f8-ae5c-1aeb5a2a829e admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:54.091629 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b5d28-1cfd-49f8-ae5c-1aeb5a2a829e admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:54.154484 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9ec47-fbec-4539-97c2-4cc4e0765169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:54.155163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9ec47-fbec-4539-97c2-4cc4e0765169 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:54.155436 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9ec47-fbec-4539-97c2-4cc4e0765169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:54.155702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9ec47-fbec-4539-97c2-4cc4e0765169 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:54.156348 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9ec47-fbec-4539-97c2-4cc4e0765169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:54.157952 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9ec47-fbec-4539-97c2-4cc4e0765169 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:54.169347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1153/2336] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:41:54.173724 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ea4df-60fd-4dbb-a773-950d2c840444 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:54.184919 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ea4df-60fd-4dbb-a773-950d2c840444 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:54.189696 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fff9c4-e081-49a9-bcd1-db3b3513e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:54.190406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fff9c4-e081-49a9-bcd1-db3b3513e021 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:54.190689 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fff9c4-e081-49a9-bcd1-db3b3513e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:54.191006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fff9c4-e081-49a9-bcd1-db3b3513e021 admin admin] PATH_INFO: `/v3/projects/884912e209554fa3b3e82d341ccab4ad/users/e84a62bce8984401b78c6846f17ef3ca/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:54.192960 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fff9c4-e081-49a9-bcd1-db3b3513e021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884912e209554fa3b3e82d341ccab4ad, user_id=e84a62bce8984401b78c6846f17ef3ca, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:54.195784 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fff9c4-e081-49a9-bcd1-db3b3513e021 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:54.207586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1184/2337] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:41:54 2022] PUT /identity/v3/projects/884912e209554fa3b3e82d341ccab4ad/users/e84a62bce8984401b78c6846f17ef3ca/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:54.218736 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839527d9-9157-40e0-a39e-ba9cbc20e183 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:54.219052 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839527d9-9157-40e0-a39e-ba9cbc20e183 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:54.219236 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839527d9-9157-40e0-a39e-ba9cbc20e183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:54.249982 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-839527d9-9157-40e0-a39e-ba9cbc20e183 None None] MFA Rules not processed for user `e84a62bce8984401b78c6846f17ef3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:54.251320 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-839527d9-9157-40e0-a39e-ba9cbc20e183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:54.269020 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:54.332391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1154/2338] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:54 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:54.345044 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fff9c4-e081-49a9-bcd1-db3b3513e021 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:54.346848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b5fff9c4-e081-49a9-bcd1-db3b3513e021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:54.407092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:54.414390 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fff9c4-e081-49a9-bcd1-db3b3513e021 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:54.418111 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0f4c6-522c-44ad-b5f9-b2965ed81fc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:54.418715 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0f4c6-522c-44ad-b5f9-b2965ed81fc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:54.419212 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0f4c6-522c-44ad-b5f9-b2965ed81fc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:54.419493 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0f4c6-522c-44ad-b5f9-b2965ed81fc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:54.428770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d0f4c6-522c-44ad-b5f9-b2965ed81fc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:54.430286 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d0f4c6-522c-44ad-b5f9-b2965ed81fc3 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:54.440738 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1185/2339] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:54 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:54.518503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839527d9-9157-40e0-a39e-ba9cbc20e183 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:54.528549 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839527d9-9157-40e0-a39e-ba9cbc20e183 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:54.532173 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2f38b-f3dc-4359-946b-e9dbdf4cf057 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:54.532874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2f38b-f3dc-4359-946b-e9dbdf4cf057 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:54.533218 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2f38b-f3dc-4359-946b-e9dbdf4cf057 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:54.533553 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2f38b-f3dc-4359-946b-e9dbdf4cf057 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:54.591447 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2f38b-f3dc-4359-946b-e9dbdf4cf057 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:54.592888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2f38b-f3dc-4359-946b-e9dbdf4cf057 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:54.601761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1155/2340] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:57.401941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0f4c6-522c-44ad-b5f9-b2965ed81fc3 service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:57.403921 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-31d0f4c6-522c-44ad-b5f9-b2965ed81fc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:57.470546 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0f4c6-522c-44ad-b5f9-b2965ed81fc3 service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:57.474154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff83197-e4fa-4e4e-9d76-b55d6e7427af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:57.474747 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff83197-e4fa-4e4e-9d76-b55d6e7427af service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:57.475054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff83197-e4fa-4e4e-9d76-b55d6e7427af service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:57.475323 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff83197-e4fa-4e4e-9d76-b55d6e7427af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:57.477021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1ff83197-e4fa-4e4e-9d76-b55d6e7427af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:57.487196 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff83197-e4fa-4e4e-9d76-b55d6e7427af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:57.488528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff83197-e4fa-4e4e-9d76-b55d6e7427af service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:57.496451 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1186/2341] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:58.245880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2f38b-f3dc-4359-946b-e9dbdf4cf057 service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:58.247332 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-1ff2f38b-f3dc-4359-946b-e9dbdf4cf057 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:58.311406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2f38b-f3dc-4359-946b-e9dbdf4cf057 service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:58.315828 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ce36c-8f43-4052-bddb-c81508affeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:58.316440 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ce36c-8f43-4052-bddb-c81508affeea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:58.316716 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ce36c-8f43-4052-bddb-c81508affeea admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:58.317005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ce36c-8f43-4052-bddb-c81508affeea admin admin] PATH_INFO: `/v3/users/8b2e02a84d124f79a977a6eb5e9c5637` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:58.318126 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ce36c-8f43-4052-bddb-c81508affeea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2e02a84d124f79a977a6eb5e9c5637)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:58.320038 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ce36c-8f43-4052-bddb-c81508affeea admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:58.364700 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-e06ce36c-8f43-4052-bddb-c81508affeea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2e02a84d124f79a977a6eb5e9c5637'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:58.365333 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-e06ce36c-8f43-4052-bddb-c81508affeea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2e02a84d124f79a977a6eb5e9c5637'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:58.367314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:58.374242 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-e06ce36c-8f43-4052-bddb-c81508affeea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2e02a84d124f79a977a6eb5e9c5637'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:58.386301 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-e06ce36c-8f43-4052-bddb-c81508affeea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2e02a84d124f79a977a6eb5e9c5637'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:58.387037 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-e06ce36c-8f43-4052-bddb-c81508affeea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2e02a84d124f79a977a6eb5e9c5637'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:58.399969 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1156/2342] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:41:58 2022] DELETE /identity/v3/users/8b2e02a84d124f79a977a6eb5e9c5637 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:58.404627 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbef706-e5d6-41c0-b112-ecbef29e81dd None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:58.405132 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbef706-e5d6-41c0-b112-ecbef29e81dd None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:58.405234 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbef706-e5d6-41c0-b112-ecbef29e81dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:58.424429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5dbef706-e5d6-41c0-b112-ecbef29e81dd None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:58.425615 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5dbef706-e5d6-41c0-b112-ecbef29e81dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:58.485496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1187/2343] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:41:58.495368 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ce36c-8f43-4052-bddb-c81508affeea admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:58.496767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e06ce36c-8f43-4052-bddb-c81508affeea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:58.556124 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ce36c-8f43-4052-bddb-c81508affeea admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:58.561565 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2e18b9-f121-4058-88c7-8394b157a1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:58.562224 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e18b9-f121-4058-88c7-8394b157a1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:58.562563 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e18b9-f121-4058-88c7-8394b157a1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:58.562843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2e18b9-f121-4058-88c7-8394b157a1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:58.572442 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e18b9-f121-4058-88c7-8394b157a1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:58.574605 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2e18b9-f121-4058-88c7-8394b157a1a1 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:58.586941 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1157/2344] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:58.640442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e58ac7-707b-4a62-9c29-053716cb9c18 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:58.640744 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e58ac7-707b-4a62-9c29-053716cb9c18 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:58.641065 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e58ac7-707b-4a62-9c29-053716cb9c18 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:58.642778 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1188/2345] 10.222.0.36 () {54 vars in 921 bytes} [Thu Oct 20 13:41:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:41:58.651136 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212041b-6689-4237-ac5a-ef130e62f5cd None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:58.651723 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212041b-6689-4237-ac5a-ef130e62f5cd None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:58.652469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212041b-6689-4237-ac5a-ef130e62f5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:58.689689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-c212041b-6689-4237-ac5a-ef130e62f5cd None None] MFA Rules not processed for user `674c5b25932a41309428ba6c6c72ed02`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:58.690903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-c212041b-6689-4237-ac5a-ef130e62f5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:58.827202 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1158/2346] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Oct 20 13:41:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:58.842385 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e58ac7-707b-4a62-9c29-053716cb9c18 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:58.844157 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-92e58ac7-707b-4a62-9c29-053716cb9c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:58.921090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e58ac7-707b-4a62-9c29-053716cb9c18 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:58.925759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212041b-6689-4237-ac5a-ef130e62f5cd None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:58.927472 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-c212041b-6689-4237-ac5a-ef130e62f5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:58.937949 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1bd441-8cca-40c8-98c2-4c2a1c5779b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d026ec6ed344404a5ebe4352792cc1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:58.938649 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bd441-8cca-40c8-98c2-4c2a1c5779b3 service glance] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:58.938928 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bd441-8cca-40c8-98c2-4c2a1c5779b3 service glance] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:58.939243 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1bd441-8cca-40c8-98c2-4c2a1c5779b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:58.942936 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212041b-6689-4237-ac5a-ef130e62f5cd None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:58.948321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804739fa-ba4a-4b9f-b062-5df7dc287547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:58.949082 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804739fa-ba4a-4b9f-b062-5df7dc287547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:58.949508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804739fa-ba4a-4b9f-b062-5df7dc287547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:58.949780 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804739fa-ba4a-4b9f-b062-5df7dc287547 admin admin] PATH_INFO: `/v3/projects/f2d41338bdf14662982540d1f63f1b31` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:58.951152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804739fa-ba4a-4b9f-b062-5df7dc287547 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d41338bdf14662982540d1f63f1b31)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:58.952817 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bd441-8cca-40c8-98c2-4c2a1c5779b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:58.953561 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804739fa-ba4a-4b9f-b062-5df7dc287547 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:58.954381 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1bd441-8cca-40c8-98c2-4c2a1c5779b3 service glance] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:58.968714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1189/2347] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:41:59.019622 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-804739fa-ba4a-4b9f-b062-5df7dc287547 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d41338bdf14662982540d1f63f1b31', 'request_id': 'req-804739fa-ba4a-4b9f-b062-5df7dc287547'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:59.026712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-804739fa-ba4a-4b9f-b062-5df7dc287547 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d41338bdf14662982540d1f63f1b31', 'request_id': 'req-804739fa-ba4a-4b9f-b062-5df7dc287547'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:59.029147 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:59.034253 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-804739fa-ba4a-4b9f-b062-5df7dc287547 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d41338bdf14662982540d1f63f1b31', 'request_id': 'req-804739fa-ba4a-4b9f-b062-5df7dc287547'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:59.051597 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7390ffa-028a-4a05-891c-d86d05869d86 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:59.051809 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7390ffa-028a-4a05-891c-d86d05869d86 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:59.052110 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7390ffa-028a-4a05-891c-d86d05869d86 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:59.053891 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1190/2348] 10.222.0.36 () {54 vars in 921 bytes} [Thu Oct 20 13:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:41:59.055573 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-804739fa-ba4a-4b9f-b062-5df7dc287547 admin admin] The token cache is being invalidate because project f2d41338bdf14662982540d1f63f1b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:41:59.055993 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-804739fa-ba4a-4b9f-b062-5df7dc287547 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:59.056659 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-804739fa-ba4a-4b9f-b062-5df7dc287547 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:41:59.058238 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1159/2349] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:41:58 2022] DELETE /identity/v3/projects/f2d41338bdf14662982540d1f63f1b31 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:41:59.060810 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828a2f3-9b2c-40bf-86bb-a0704ad07a41 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:59.061187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828a2f3-9b2c-40bf-86bb-a0704ad07a41 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:59.061536 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828a2f3-9b2c-40bf-86bb-a0704ad07a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:59.063321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34269f5-f4d3-4274-aa46-141c97df1250 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:59.065061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34269f5-f4d3-4274-aa46-141c97df1250 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:59.065061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34269f5-f4d3-4274-aa46-141c97df1250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:59.088121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-f828a2f3-9b2c-40bf-86bb-a0704ad07a41 None None] MFA Rules not processed for user `5852ff82962e4cea85b8aa8593f09d37`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:59.089484 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f828a2f3-9b2c-40bf-86bb-a0704ad07a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:59.091305 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-c34269f5-f4d3-4274-aa46-141c97df1250 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:59.092529 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-c34269f5-f4d3-4274-aa46-141c97df1250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:59.133454 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:59.161234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1160/2350] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:41:59.162844 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1191/2351] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Oct 20 13:41:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:41:59.169095 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601eafb-3f59-4463-bdc1-82b6d7be6d77 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:59.169517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601eafb-3f59-4463-bdc1-82b6d7be6d77 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:59.169624 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601eafb-3f59-4463-bdc1-82b6d7be6d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:59.176538 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828a2f3-9b2c-40bf-86bb-a0704ad07a41 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:59.178108 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f828a2f3-9b2c-40bf-86bb-a0704ad07a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:59.189794 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828a2f3-9b2c-40bf-86bb-a0704ad07a41 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:59.191026 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-1601eafb-3f59-4463-bdc1-82b6d7be6d77 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:59.192203 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-1601eafb-3f59-4463-bdc1-82b6d7be6d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:59.193626 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e81577-aff0-48f0-bed3-603928c70777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:59.194230 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e81577-aff0-48f0-bed3-603928c70777 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:59.194522 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e81577-aff0-48f0-bed3-603928c70777 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:59.194858 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e81577-aff0-48f0-bed3-603928c70777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:59.201972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e81577-aff0-48f0-bed3-603928c70777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:59.203232 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1161/2352] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:59.203496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e81577-aff0-48f0-bed3-603928c70777 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:59.207317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601eafb-3f59-4463-bdc1-82b6d7be6d77 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:59.211598 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1192/2353] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:41:59.216826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601eafb-3f59-4463-bdc1-82b6d7be6d77 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:59.221877 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d79319-77d9-4811-986f-9339c6b23f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:59.222477 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d79319-77d9-4811-986f-9339c6b23f88 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:59.222752 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d79319-77d9-4811-986f-9339c6b23f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:59.223056 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d79319-77d9-4811-986f-9339c6b23f88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:59.223704 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d79319-77d9-4811-986f-9339c6b23f88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:41:59.224005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d79319-77d9-4811-986f-9339c6b23f88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:59.225751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d79319-77d9-4811-986f-9339c6b23f88 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:59.238243 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1162/2354] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:41:59.242882 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e81577-aff0-48f0-bed3-603928c70777 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:59.255295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e81577-aff0-48f0-bed3-603928c70777 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:59.261805 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e7da3-d81f-4dc7-905b-40bf4a6d8a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:59.262982 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7da3-d81f-4dc7-905b-40bf4a6d8a8b admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:59.263529 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7da3-d81f-4dc7-905b-40bf4a6d8a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:59.263651 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7da3-d81f-4dc7-905b-40bf4a6d8a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:59.264326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e7da3-d81f-4dc7-905b-40bf4a6d8a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:59.267115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e7da3-d81f-4dc7-905b-40bf4a6d8a8b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:59.300719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1193/2355] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:41:59 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:41:59.301948 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d79319-77d9-4811-986f-9339c6b23f88 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:59.312662 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d0ec9-8e59-481b-b394-3c9959832589 None None] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:59.313076 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d0ec9-8e59-481b-b394-3c9959832589 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:59.313314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d79319-77d9-4811-986f-9339c6b23f88 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:59.313429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d0ec9-8e59-481b-b394-3c9959832589 None None] PATH_INFO: `/` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:59.314659 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1194/2356] 10.222.0.36 () {54 vars in 921 bytes} [Thu Oct 20 13:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 20 13:41:59.319573 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591763bf-8ca4-4114-b92c-a023e15a996c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:59.320047 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591763bf-8ca4-4114-b92c-a023e15a996c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:59.320323 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591763bf-8ca4-4114-b92c-a023e15a996c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:59.340290 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-591763bf-8ca4-4114-b92c-a023e15a996c None None] MFA Rules not processed for user `674c5b25932a41309428ba6c6c72ed02`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:59.341495 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-591763bf-8ca4-4114-b92c-a023e15a996c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:59.373966 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef904e9d-44c2-4e60-9c01-10ce69efd16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:59.374575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef904e9d-44c2-4e60-9c01-10ce69efd16a admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:59.374854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef904e9d-44c2-4e60-9c01-10ce69efd16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:59.375158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef904e9d-44c2-4e60-9c01-10ce69efd16a admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:59.375805 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef904e9d-44c2-4e60-9c01-10ce69efd16a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:59.377711 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef904e9d-44c2-4e60-9c01-10ce69efd16a admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:59.403574 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1163/2357] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:41:59 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:41:59.404692 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef904e9d-44c2-4e60-9c01-10ce69efd16a admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:59.409260 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1195/2358] 10.222.0.36 () {58 vars in 1018 bytes} [Thu Oct 20 13:41:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:41:59.414535 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef904e9d-44c2-4e60-9c01-10ce69efd16a admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:59.419958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7560d6-fd5e-4d7e-ab74-f4ccfed56256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:59.420278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591763bf-8ca4-4114-b92c-a023e15a996c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:59.420560 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7560d6-fd5e-4d7e-ab74-f4ccfed56256 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:59.420838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7560d6-fd5e-4d7e-ab74-f4ccfed56256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:59.421109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7560d6-fd5e-4d7e-ab74-f4ccfed56256 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:59.421898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7560d6-fd5e-4d7e-ab74-f4ccfed56256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:59.423521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7560d6-fd5e-4d7e-ab74-f4ccfed56256 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:59.435667 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1164/2359] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:41:59.439971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7560d6-fd5e-4d7e-ab74-f4ccfed56256 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:59.450296 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7560d6-fd5e-4d7e-ab74-f4ccfed56256 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:59.455063 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca39c98-3f39-480f-9a51-4ecf46594710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:59.455686 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca39c98-3f39-480f-9a51-4ecf46594710 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:59.455984 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca39c98-3f39-480f-9a51-4ecf46594710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:59.456234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca39c98-3f39-480f-9a51-4ecf46594710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:59.456866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca39c98-3f39-480f-9a51-4ecf46594710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:59.458454 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca39c98-3f39-480f-9a51-4ecf46594710 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:59.469343 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1165/2360] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:41:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:41:59.478126 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591763bf-8ca4-4114-b92c-a023e15a996c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:59.479435 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca39c98-3f39-480f-9a51-4ecf46594710 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:59.482352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ff069-8bb4-4e3f-9cbf-0013d15a1d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:59.483148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ff069-8bb4-4e3f-9cbf-0013d15a1d1a service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:59.483443 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ff069-8bb4-4e3f-9cbf-0013d15a1d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:59.483695 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ff069-8bb4-4e3f-9cbf-0013d15a1d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:59.490204 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca39c98-3f39-480f-9a51-4ecf46594710 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:59.494210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ff069-8bb4-4e3f-9cbf-0013d15a1d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:59.494940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84229b7-b9bb-491e-aeae-323f904d8269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:59.495612 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84229b7-b9bb-491e-aeae-323f904d8269 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:59.495892 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84229b7-b9bb-491e-aeae-323f904d8269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:59.496001 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ff069-8bb4-4e3f-9cbf-0013d15a1d1a service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:59.496205 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84229b7-b9bb-491e-aeae-323f904d8269 admin admin] PATH_INFO: `/v3/projects/d424808db0cc4918bfc411a6de608d33/users/64e1f9c52ce54b22a2bb56f8afeb5029/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:59.506502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1196/2361] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:41:59.511594 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84229b7-b9bb-491e-aeae-323f904d8269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d424808db0cc4918bfc411a6de608d33, user_id=64e1f9c52ce54b22a2bb56f8afeb5029, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:59.514309 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84229b7-b9bb-491e-aeae-323f904d8269 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:59.528261 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1166/2362] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:41:59 2022] PUT /identity/v3/projects/d424808db0cc4918bfc411a6de608d33/users/64e1f9c52ce54b22a2bb56f8afeb5029/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:41:59.538500 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f528d-9eb6-4995-aacf-72b6dae495c3 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:59.538788 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f528d-9eb6-4995-aacf-72b6dae495c3 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:59.539092 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f528d-9eb6-4995-aacf-72b6dae495c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:59.569094 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-597f528d-9eb6-4995-aacf-72b6dae495c3 None None] MFA Rules not processed for user `64e1f9c52ce54b22a2bb56f8afeb5029`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:41:59.570283 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-597f528d-9eb6-4995-aacf-72b6dae495c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:59.571173 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84229b7-b9bb-491e-aeae-323f904d8269 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:59.573412 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-f84229b7-b9bb-491e-aeae-323f904d8269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:59.584196 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:59.604623 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:41:59.636969 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1197/2363] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:41:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:41:59.647823 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f528d-9eb6-4995-aacf-72b6dae495c3 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:41:59.649382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-597f528d-9eb6-4995-aacf-72b6dae495c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:59.649841 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84229b7-b9bb-491e-aeae-323f904d8269 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:59.655847 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf60f9d-7b6c-4e50-80fc-621c18b268c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a00f0b4cee8d49a48a95317aec9f647c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:59.656493 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf60f9d-7b6c-4e50-80fc-621c18b268c2 service placement] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:59.656777 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf60f9d-7b6c-4e50-80fc-621c18b268c2 service placement] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:59.657054 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf60f9d-7b6c-4e50-80fc-621c18b268c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:59.658802 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6bf60f9d-7b6c-4e50-80fc-621c18b268c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:41:59.670585 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf60f9d-7b6c-4e50-80fc-621c18b268c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:59.672407 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf60f9d-7b6c-4e50-80fc-621c18b268c2 service placement] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:59.683908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1167/2364] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:41:59.711431 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f528d-9eb6-4995-aacf-72b6dae495c3 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:41:59.716039 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812033f-b5a7-48c5-befb-e3e787cb1468 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:41:59.716647 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812033f-b5a7-48c5-befb-e3e787cb1468 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:41:59.716930 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812033f-b5a7-48c5-befb-e3e787cb1468 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:41:59.717200 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812033f-b5a7-48c5-befb-e3e787cb1468 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:41:59.726760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812033f-b5a7-48c5-befb-e3e787cb1468 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:41:59.728345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812033f-b5a7-48c5-befb-e3e787cb1468 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:41:59.739283 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1198/2365] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:41:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:42:01.157521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db317856-45f3-4a2d-bcbc-91c8a0b733b7 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:01.158066 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db317856-45f3-4a2d-bcbc-91c8a0b733b7 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:01.158066 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db317856-45f3-4a2d-bcbc-91c8a0b733b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:01.177581 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-db317856-45f3-4a2d-bcbc-91c8a0b733b7 None None] MFA Rules not processed for user `64e1f9c52ce54b22a2bb56f8afeb5029`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:01.178912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-db317856-45f3-4a2d-bcbc-91c8a0b733b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:01.186811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1168/2366] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:02.153365 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44706b8-42a9-41d5-8d38-dc1b9b006eac None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:02.153848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44706b8-42a9-41d5-8d38-dc1b9b006eac None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:02.154095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44706b8-42a9-41d5-8d38-dc1b9b006eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:02.173788 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-a44706b8-42a9-41d5-8d38-dc1b9b006eac None None] MFA Rules not processed for user `44342daa668c4516ae131d9f0160261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:02.175041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a44706b8-42a9-41d5-8d38-dc1b9b006eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:02.235413 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1199/2367] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Oct 20 13:42:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:42:02.248297 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db317856-45f3-4a2d-bcbc-91c8a0b733b7 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:02.250318 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-db317856-45f3-4a2d-bcbc-91c8a0b733b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:02.321747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db317856-45f3-4a2d-bcbc-91c8a0b733b7 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:02.327566 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b4548-6e76-4c2c-872f-c53d2abe45d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c893e6388ed340eca17da2e279ca34a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:02.328181 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4548-6e76-4c2c-872f-c53d2abe45d6 service swift] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:02.328463 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4548-6e76-4c2c-872f-c53d2abe45d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:02.328735 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b4548-6e76-4c2c-872f-c53d2abe45d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:02.336912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b4548-6e76-4c2c-872f-c53d2abe45d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:02.339433 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b4548-6e76-4c2c-872f-c53d2abe45d6 service swift] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:02.347639 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1169/2368] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Oct 20 13:42:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 13:42:10.190440 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44706b8-42a9-41d5-8d38-dc1b9b006eac None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:10.191908 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-a44706b8-42a9-41d5-8d38-dc1b9b006eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:10.258540 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44706b8-42a9-41d5-8d38-dc1b9b006eac None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:10.263941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4236a-ff18-4f23-bbd9-fef72bece85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:10.264565 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4236a-ff18-4f23-bbd9-fef72bece85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:10.264845 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4236a-ff18-4f23-bbd9-fef72bece85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:10.265121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4236a-ff18-4f23-bbd9-fef72bece85c admin admin] PATH_INFO: `/v3/users/761650a9563f4e828d34e86da5067845` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:10.266326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4236a-ff18-4f23-bbd9-fef72bece85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=761650a9563f4e828d34e86da5067845)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:10.268276 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4236a-ff18-4f23-bbd9-fef72bece85c admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:10.297120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:10.316967 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-18e4236a-ff18-4f23-bbd9-fef72bece85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '761650a9563f4e828d34e86da5067845'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:10.317605 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-18e4236a-ff18-4f23-bbd9-fef72bece85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '761650a9563f4e828d34e86da5067845'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:10.324482 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-18e4236a-ff18-4f23-bbd9-fef72bece85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '761650a9563f4e828d34e86da5067845'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:10.336445 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-18e4236a-ff18-4f23-bbd9-fef72bece85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '761650a9563f4e828d34e86da5067845'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:10.337061 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-18e4236a-ff18-4f23-bbd9-fef72bece85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '761650a9563f4e828d34e86da5067845'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:10.350271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1200/2369] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:42:10 2022] DELETE /identity/v3/users/761650a9563f4e828d34e86da5067845 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:10.355341 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31c480-1b3a-4130-b772-fcc340d9607d None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:10.355859 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31c480-1b3a-4130-b772-fcc340d9607d None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:10.355962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31c480-1b3a-4130-b772-fcc340d9607d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:10.376623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-2d31c480-1b3a-4130-b772-fcc340d9607d None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:10.377849 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-2d31c480-1b3a-4130-b772-fcc340d9607d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:10.435637 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1170/2370] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:10.445308 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4236a-ff18-4f23-bbd9-fef72bece85c admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:10.446728 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-18e4236a-ff18-4f23-bbd9-fef72bece85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:10.502769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4236a-ff18-4f23-bbd9-fef72bece85c admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:10.506409 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0e5c0-ecf2-4e39-8321-0a8e79b80ba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:10.507023 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0e5c0-ecf2-4e39-8321-0a8e79b80ba7 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:10.507300 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0e5c0-ecf2-4e39-8321-0a8e79b80ba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:10.507566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f0e5c0-ecf2-4e39-8321-0a8e79b80ba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:10.516869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0e5c0-ecf2-4e39-8321-0a8e79b80ba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:10.518234 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f0e5c0-ecf2-4e39-8321-0a8e79b80ba7 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:10.527409 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1201/2371] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:42:10.798191 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31c480-1b3a-4130-b772-fcc340d9607d None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:10.799955 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-2d31c480-1b3a-4130-b772-fcc340d9607d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:10.812948 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31c480-1b3a-4130-b772-fcc340d9607d None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:10.822096 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:10.822096 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:10.822096 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:10.822096 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402 admin admin] PATH_INFO: `/v3/projects/1e78e247acf74b948c0ade35c621be80` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:10.822830 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e78e247acf74b948c0ade35c621be80)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:10.822830 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:10.840680 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:10.873815 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e78e247acf74b948c0ade35c621be80', 'request_id': 'req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:10.882647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e78e247acf74b948c0ade35c621be80', 'request_id': 'req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:10.888912 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e78e247acf74b948c0ade35c621be80', 'request_id': 'req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:10.901940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402 admin admin] The token cache is being invalidate because project 1e78e247acf74b948c0ade35c621be80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:42:10.902226 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:10.902850 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:10.904611 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1171/2372] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:42:10 2022] DELETE /identity/v3/projects/1e78e247acf74b948c0ade35c621be80 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:42:10.908530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0e5c0-ecf2-4e39-8321-0a8e79b80ba7 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:10.918921 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f0e5c0-ecf2-4e39-8321-0a8e79b80ba7 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:10.976081 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40bbb8c-f8a2-491e-8150-d72075f73040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:10.976708 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bbb8c-f8a2-491e-8150-d72075f73040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:10.976985 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bbb8c-f8a2-491e-8150-d72075f73040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:10.977256 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40bbb8c-f8a2-491e-8150-d72075f73040 admin admin] PATH_INFO: `/v3/users/e84a62bce8984401b78c6846f17ef3ca` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:10.979065 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bbb8c-f8a2-491e-8150-d72075f73040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e84a62bce8984401b78c6846f17ef3ca)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:10.981167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40bbb8c-f8a2-491e-8150-d72075f73040 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:11.027204 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d40bbb8c-f8a2-491e-8150-d72075f73040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e84a62bce8984401b78c6846f17ef3ca'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:11.027859 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d40bbb8c-f8a2-491e-8150-d72075f73040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e84a62bce8984401b78c6846f17ef3ca'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:11.029065 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:11.036890 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d40bbb8c-f8a2-491e-8150-d72075f73040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e84a62bce8984401b78c6846f17ef3ca'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:11.050232 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d40bbb8c-f8a2-491e-8150-d72075f73040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e84a62bce8984401b78c6846f17ef3ca'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:11.051064 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d40bbb8c-f8a2-491e-8150-d72075f73040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e84a62bce8984401b78c6846f17ef3ca'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:11.064864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1202/2373] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:42:10 2022] DELETE /identity/v3/users/e84a62bce8984401b78c6846f17ef3ca => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:11.456090 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:11.457533 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:11.470575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8f960-2fe2-4e80-b7cf-2d02dbd3f402 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:11.529360 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd27fbe-98e7-42ec-b5a9-f3b610498ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:11.529586 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd27fbe-98e7-42ec-b5a9-f3b610498ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:11.529804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd27fbe-98e7-42ec-b5a9-f3b610498ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:11.530099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd27fbe-98e7-42ec-b5a9-f3b610498ae8 admin admin] PATH_INFO: `/v3/projects/884912e209554fa3b3e82d341ccab4ad` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:11.531385 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd27fbe-98e7-42ec-b5a9-f3b610498ae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=884912e209554fa3b3e82d341ccab4ad)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:11.533692 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd27fbe-98e7-42ec-b5a9-f3b610498ae8 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:11.591368 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-fdd27fbe-98e7-42ec-b5a9-f3b610498ae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884912e209554fa3b3e82d341ccab4ad', 'request_id': 'req-fdd27fbe-98e7-42ec-b5a9-f3b610498ae8'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:11.597450 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-fdd27fbe-98e7-42ec-b5a9-f3b610498ae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884912e209554fa3b3e82d341ccab4ad', 'request_id': 'req-fdd27fbe-98e7-42ec-b5a9-f3b610498ae8'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:11.602943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-fdd27fbe-98e7-42ec-b5a9-f3b610498ae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884912e209554fa3b3e82d341ccab4ad', 'request_id': 'req-fdd27fbe-98e7-42ec-b5a9-f3b610498ae8'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:11.617017 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-fdd27fbe-98e7-42ec-b5a9-f3b610498ae8 admin admin] The token cache is being invalidate because project 884912e209554fa3b3e82d341ccab4ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:42:11.617309 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-fdd27fbe-98e7-42ec-b5a9-f3b610498ae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:11.617935 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-fdd27fbe-98e7-42ec-b5a9-f3b610498ae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:11.620019 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1172/2374] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:42:11 2022] DELETE /identity/v3/projects/884912e209554fa3b3e82d341ccab4ad => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:42:11.625232 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378c8e2-2d78-4c44-bdb6-35739a03031a None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:11.625734 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378c8e2-2d78-4c44-bdb6-35739a03031a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:11.626064 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378c8e2-2d78-4c44-bdb6-35739a03031a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:11.647878 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-f378c8e2-2d78-4c44-bdb6-35739a03031a None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:11.649091 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f378c8e2-2d78-4c44-bdb6-35739a03031a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:11.709404 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1203/2375] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:11.717722 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb4edb-2e52-45a6-9321-9331dd6fffc9 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:11.718010 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb4edb-2e52-45a6-9321-9331dd6fffc9 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:11.718285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb4edb-2e52-45a6-9321-9331dd6fffc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:11.738649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-dbcb4edb-2e52-45a6-9321-9331dd6fffc9 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:11.739883 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-dbcb4edb-2e52-45a6-9321-9331dd6fffc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:11.747959 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1173/2376] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:11.751989 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378c8e2-2d78-4c44-bdb6-35739a03031a None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:11.762412 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378c8e2-2d78-4c44-bdb6-35739a03031a None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:11.766898 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26843a0-b1b7-49f2-8036-6b857f72a2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:11.767518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26843a0-b1b7-49f2-8036-6b857f72a2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:11.767796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26843a0-b1b7-49f2-8036-6b857f72a2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:11.768070 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26843a0-b1b7-49f2-8036-6b857f72a2c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:11.768703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26843a0-b1b7-49f2-8036-6b857f72a2c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:42:11.769006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26843a0-b1b7-49f2-8036-6b857f72a2c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:11.770586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26843a0-b1b7-49f2-8036-6b857f72a2c8 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:11.782344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1204/2377] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 20 13:42:11.786479 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb4edb-2e52-45a6-9321-9331dd6fffc9 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:11.796115 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb4edb-2e52-45a6-9321-9331dd6fffc9 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:11.800693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d2948-273c-403d-bb5c-9f9556994b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:11.801280 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2948-273c-403d-bb5c-9f9556994b58 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:11.801556 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2948-273c-403d-bb5c-9f9556994b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:11.801821 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d2948-273c-403d-bb5c-9f9556994b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:11.802441 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d2948-273c-403d-bb5c-9f9556994b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:11.804375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d2948-273c-403d-bb5c-9f9556994b58 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:11.831336 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1174/2378] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:42:11 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:42:11.835506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26843a0-b1b7-49f2-8036-6b857f72a2c8 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:11.845868 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26843a0-b1b7-49f2-8036-6b857f72a2c8 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:11.904447 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a40bb-2c05-43e5-b6f0-d5faeb8252df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:11.905056 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a40bb-2c05-43e5-b6f0-d5faeb8252df admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:11.905335 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a40bb-2c05-43e5-b6f0-d5faeb8252df admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:11.905606 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a40bb-2c05-43e5-b6f0-d5faeb8252df admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:11.906235 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a40bb-2c05-43e5-b6f0-d5faeb8252df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:11.908157 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a40bb-2c05-43e5-b6f0-d5faeb8252df admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:11.932737 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1205/2379] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:42:11 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:42:11.933954 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d2948-273c-403d-bb5c-9f9556994b58 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:11.945145 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d2948-273c-403d-bb5c-9f9556994b58 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:11.950836 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26488ae-3f7f-4f58-b1dc-c158ce5b42c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:11.951477 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26488ae-3f7f-4f58-b1dc-c158ce5b42c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:11.951756 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26488ae-3f7f-4f58-b1dc-c158ce5b42c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:11.952027 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26488ae-3f7f-4f58-b1dc-c158ce5b42c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:11.952666 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26488ae-3f7f-4f58-b1dc-c158ce5b42c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:11.954308 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26488ae-3f7f-4f58-b1dc-c158ce5b42c2 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:11.955880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:11.970158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1175/2380] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:42:11.975051 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a40bb-2c05-43e5-b6f0-d5faeb8252df admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:11.993734 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a40bb-2c05-43e5-b6f0-d5faeb8252df admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:11.999296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0be06-7af7-4cd0-b4c9-b977b4611d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:12.000029 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0be06-7af7-4cd0-b4c9-b977b4611d79 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:12.000332 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0be06-7af7-4cd0-b4c9-b977b4611d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:12.000609 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0be06-7af7-4cd0-b4c9-b977b4611d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:12.001334 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0be06-7af7-4cd0-b4c9-b977b4611d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:12.002836 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0be06-7af7-4cd0-b4c9-b977b4611d79 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:12.018245 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1206/2381] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:42:12.019514 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26488ae-3f7f-4f58-b1dc-c158ce5b42c2 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:12.031127 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26488ae-3f7f-4f58-b1dc-c158ce5b42c2 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:12.037737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176abf3-9804-42be-9724-6bcb2eb980b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:12.038469 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176abf3-9804-42be-9724-6bcb2eb980b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:12.038838 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176abf3-9804-42be-9724-6bcb2eb980b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:12.039214 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176abf3-9804-42be-9724-6bcb2eb980b3 admin admin] PATH_INFO: `/v3/projects/330600f052a147fbad7624893a769c36/users/fa6f9698a4f345408a61c746e248e4f3/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:12.055111 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176abf3-9804-42be-9724-6bcb2eb980b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=330600f052a147fbad7624893a769c36, user_id=fa6f9698a4f345408a61c746e248e4f3, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:12.058550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176abf3-9804-42be-9724-6bcb2eb980b3 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:12.074397 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1176/2382] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:42:12 2022] PUT /identity/v3/projects/330600f052a147fbad7624893a769c36/users/fa6f9698a4f345408a61c746e248e4f3/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:12.084713 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd8c5a-1119-4c3b-aba4-10f66f3fb6bd None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:12.085032 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd8c5a-1119-4c3b-aba4-10f66f3fb6bd None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:12.085265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd8c5a-1119-4c3b-aba4-10f66f3fb6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:12.125122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-c9fd8c5a-1119-4c3b-aba4-10f66f3fb6bd None None] MFA Rules not processed for user `fa6f9698a4f345408a61c746e248e4f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:12.126918 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c9fd8c5a-1119-4c3b-aba4-10f66f3fb6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:12.148388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:12.205722 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1207/2383] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:42:12.210557 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176abf3-9804-42be-9724-6bcb2eb980b3 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:12.284223 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176abf3-9804-42be-9724-6bcb2eb980b3 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:12.289333 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c218feb-7279-4ae8-a936-e999e61dcbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:12.290112 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c218feb-7279-4ae8-a936-e999e61dcbda admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:12.290396 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c218feb-7279-4ae8-a936-e999e61dcbda admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:12.290754 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c218feb-7279-4ae8-a936-e999e61dcbda admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:12.291728 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c218feb-7279-4ae8-a936-e999e61dcbda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:12.293680 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c218feb-7279-4ae8-a936-e999e61dcbda admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:12.321868 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1177/2384] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:42:12 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:42:12.327415 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd8c5a-1119-4c3b-aba4-10f66f3fb6bd None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:12.338069 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd8c5a-1119-4c3b-aba4-10f66f3fb6bd None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:12.401737 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683cccd-a085-4967-bfef-51d8bc4f5da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:12.402902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683cccd-a085-4967-bfef-51d8bc4f5da3 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:12.403214 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683cccd-a085-4967-bfef-51d8bc4f5da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:12.403539 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683cccd-a085-4967-bfef-51d8bc4f5da3 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:12.404186 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683cccd-a085-4967-bfef-51d8bc4f5da3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:12.406281 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683cccd-a085-4967-bfef-51d8bc4f5da3 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:12.438530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1208/2385] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:42:12 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:42:12.439421 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c218feb-7279-4ae8-a936-e999e61dcbda admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:12.451474 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c218feb-7279-4ae8-a936-e999e61dcbda admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:12.456313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3753d-81ad-44d4-945b-9386684f4cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:12.457070 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3753d-81ad-44d4-945b-9386684f4cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:12.457394 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3753d-81ad-44d4-945b-9386684f4cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:12.457731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d3753d-81ad-44d4-945b-9386684f4cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:12.458500 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3753d-81ad-44d4-945b-9386684f4cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:12.460489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d3753d-81ad-44d4-945b-9386684f4cc8 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:12.477062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1178/2386] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:42:12.482063 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683cccd-a085-4967-bfef-51d8bc4f5da3 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:12.493261 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683cccd-a085-4967-bfef-51d8bc4f5da3 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:12.498992 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b20668-c014-4059-9829-c62a06db82c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:12.499233 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b20668-c014-4059-9829-c62a06db82c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:12.499570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b20668-c014-4059-9829-c62a06db82c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:12.499849 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b20668-c014-4059-9829-c62a06db82c1 admin admin] PATH_INFO: `/v3/projects/b3100600d8144c77b175a0706586c3bd/users/5af062aae84d4dc097abdd6cd074de6c/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:12.517500 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b20668-c014-4059-9829-c62a06db82c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3100600d8144c77b175a0706586c3bd, user_id=5af062aae84d4dc097abdd6cd074de6c, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:12.520162 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b20668-c014-4059-9829-c62a06db82c1 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:12.533694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1209/2387] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:42:12 2022] PUT /identity/v3/projects/b3100600d8144c77b175a0706586c3bd/users/5af062aae84d4dc097abdd6cd074de6c/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:12.537694 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3753d-81ad-44d4-945b-9386684f4cc8 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:12.549357 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d3753d-81ad-44d4-945b-9386684f4cc8 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:12.612742 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829c515-c3d5-4c47-a2ca-fc1818d56827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:12.613676 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829c515-c3d5-4c47-a2ca-fc1818d56827 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:12.614172 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829c515-c3d5-4c47-a2ca-fc1818d56827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:12.614649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829c515-c3d5-4c47-a2ca-fc1818d56827 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:12.615528 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829c515-c3d5-4c47-a2ca-fc1818d56827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:12.618159 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829c515-c3d5-4c47-a2ca-fc1818d56827 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:12.630163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1179/2388] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:42:12.635041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b20668-c014-4059-9829-c62a06db82c1 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:12.645321 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b20668-c014-4059-9829-c62a06db82c1 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:12.649950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ed498-6b3f-4430-afe0-ce6c0e03c582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:12.651187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ed498-6b3f-4430-afe0-ce6c0e03c582 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:12.651663 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ed498-6b3f-4430-afe0-ce6c0e03c582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:12.651946 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ed498-6b3f-4430-afe0-ce6c0e03c582 admin admin] PATH_INFO: `/v3/projects/b3100600d8144c77b175a0706586c3bd/users/5af062aae84d4dc097abdd6cd074de6c/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:12.653882 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ed498-6b3f-4430-afe0-ce6c0e03c582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3100600d8144c77b175a0706586c3bd, user_id=5af062aae84d4dc097abdd6cd074de6c, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:12.656592 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ed498-6b3f-4430-afe0-ce6c0e03c582 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:12.667998 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1210/2389] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:42:12 2022] PUT /identity/v3/projects/b3100600d8144c77b175a0706586c3bd/users/5af062aae84d4dc097abdd6cd074de6c/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:12.679350 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971dee9-f001-4b68-93b7-c0e6ccf102ab None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:12.679688 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971dee9-f001-4b68-93b7-c0e6ccf102ab None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:12.679971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4971dee9-f001-4b68-93b7-c0e6ccf102ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:12.710511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-4971dee9-f001-4b68-93b7-c0e6ccf102ab None None] MFA Rules not processed for user `5af062aae84d4dc097abdd6cd074de6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:12.711801 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-4971dee9-f001-4b68-93b7-c0e6ccf102ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:12.761097 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:12.801909 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1180/2390] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:12.814715 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ed498-6b3f-4430-afe0-ce6c0e03c582 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:12.816470 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-be3ed498-6b3f-4430-afe0-ce6c0e03c582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:12.880363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ed498-6b3f-4430-afe0-ce6c0e03c582 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:12.884284 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770e9a5-9170-429a-95ce-08c483578046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:12.885142 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770e9a5-9170-429a-95ce-08c483578046 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:12.885443 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770e9a5-9170-429a-95ce-08c483578046 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:12.885689 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770e9a5-9170-429a-95ce-08c483578046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:12.896035 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770e9a5-9170-429a-95ce-08c483578046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:12.897637 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770e9a5-9170-429a-95ce-08c483578046 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:12.908789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1211/2391] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:42:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:42:12.998975 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971dee9-f001-4b68-93b7-c0e6ccf102ab None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:13.009876 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4971dee9-f001-4b68-93b7-c0e6ccf102ab None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:13.014358 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efa849-6d7e-427a-b488-81618d6f789d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:13.015579 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efa849-6d7e-427a-b488-81618d6f789d service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:13.015579 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efa849-6d7e-427a-b488-81618d6f789d service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:13.015898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62efa849-6d7e-427a-b488-81618d6f789d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:13.088738 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efa849-6d7e-427a-b488-81618d6f789d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:13.089958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62efa849-6d7e-427a-b488-81618d6f789d service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:13.099955 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1181/2392] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:42:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:42:17.481078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02758b9f-f465-4780-a153-ec93321e209e None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:17.481553 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02758b9f-f465-4780-a153-ec93321e209e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:17.482218 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02758b9f-f465-4780-a153-ec93321e209e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:17.502073 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-02758b9f-f465-4780-a153-ec93321e209e None None] MFA Rules not processed for user `44342daa668c4516ae131d9f0160261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:17.503307 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-02758b9f-f465-4780-a153-ec93321e209e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:17.513156 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:17.570699 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1212/2393] 10.222.0.36 () {58 vars in 967 bytes} [Thu Oct 20 13:42:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:17.584148 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efa849-6d7e-427a-b488-81618d6f789d service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:17.585637 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-62efa849-6d7e-427a-b488-81618d6f789d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:17.662659 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62efa849-6d7e-427a-b488-81618d6f789d service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:17.668623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4aa14-344c-4378-9b89-0ee99f9ae57e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c893e6388ed340eca17da2e279ca34a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:17.669251 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4aa14-344c-4378-9b89-0ee99f9ae57e service swift] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:17.669534 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4aa14-344c-4378-9b89-0ee99f9ae57e service swift] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:17.669880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4aa14-344c-4378-9b89-0ee99f9ae57e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:17.679030 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4aa14-344c-4378-9b89-0ee99f9ae57e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:17.680880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4aa14-344c-4378-9b89-0ee99f9ae57e service swift] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:17.690100 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1182/2394] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Oct 20 13:42:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 13:42:19.205660 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02758b9f-f465-4780-a153-ec93321e209e None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:19.275031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02758b9f-f465-4780-a153-ec93321e209e None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:19.279790 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78836b2c-1e3d-4d41-bda6-47efaa4e3f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:19.280445 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78836b2c-1e3d-4d41-bda6-47efaa4e3f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:19.280733 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78836b2c-1e3d-4d41-bda6-47efaa4e3f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:19.281041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78836b2c-1e3d-4d41-bda6-47efaa4e3f85 admin admin] PATH_INFO: `/v3/users/fa6f9698a4f345408a61c746e248e4f3` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:19.282233 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78836b2c-1e3d-4d41-bda6-47efaa4e3f85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6f9698a4f345408a61c746e248e4f3)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:19.284224 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78836b2c-1e3d-4d41-bda6-47efaa4e3f85 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:19.340333 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-78836b2c-1e3d-4d41-bda6-47efaa4e3f85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6f9698a4f345408a61c746e248e4f3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:19.342404 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-78836b2c-1e3d-4d41-bda6-47efaa4e3f85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6f9698a4f345408a61c746e248e4f3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:19.349684 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-78836b2c-1e3d-4d41-bda6-47efaa4e3f85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6f9698a4f345408a61c746e248e4f3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:19.365331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-78836b2c-1e3d-4d41-bda6-47efaa4e3f85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6f9698a4f345408a61c746e248e4f3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:19.366302 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-78836b2c-1e3d-4d41-bda6-47efaa4e3f85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6f9698a4f345408a61c746e248e4f3'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:19.382991 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1213/2395] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:42:19 2022] DELETE /identity/v3/users/fa6f9698a4f345408a61c746e248e4f3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:19.387175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac135a89-fa34-4ab3-9f63-79a2f2c4e819 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:19.387978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac135a89-fa34-4ab3-9f63-79a2f2c4e819 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:19.388255 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac135a89-fa34-4ab3-9f63-79a2f2c4e819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:19.408098 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-ac135a89-fa34-4ab3-9f63-79a2f2c4e819 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:19.409566 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-ac135a89-fa34-4ab3-9f63-79a2f2c4e819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:19.472270 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:19.501560 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1183/2396] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:19.513172 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78836b2c-1e3d-4d41-bda6-47efaa4e3f85 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:19.514991 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-78836b2c-1e3d-4d41-bda6-47efaa4e3f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:19.561796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:19.579259 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78836b2c-1e3d-4d41-bda6-47efaa4e3f85 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:19.583122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2f9cd-1952-4078-a84e-3b2c628da583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:19.583742 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2f9cd-1952-4078-a84e-3b2c628da583 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:19.584026 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2f9cd-1952-4078-a84e-3b2c628da583 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:19.584307 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2f9cd-1952-4078-a84e-3b2c628da583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:19.593754 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2f9cd-1952-4078-a84e-3b2c628da583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:19.595244 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2f9cd-1952-4078-a84e-3b2c628da583 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:19.605649 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1214/2397] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:42:19.883446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac135a89-fa34-4ab3-9f63-79a2f2c4e819 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:19.884866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-ac135a89-fa34-4ab3-9f63-79a2f2c4e819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:19.899276 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac135a89-fa34-4ab3-9f63-79a2f2c4e819 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:19.903884 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:19.904521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:19.904796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:19.905068 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a admin admin] PATH_INFO: `/v3/projects/330600f052a147fbad7624893a769c36` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:19.906196 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=330600f052a147fbad7624893a769c36)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:19.908253 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:19.958554 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '330600f052a147fbad7624893a769c36', 'request_id': 'req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:19.965788 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '330600f052a147fbad7624893a769c36', 'request_id': 'req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:19.972434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '330600f052a147fbad7624893a769c36', 'request_id': 'req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:19.989937 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a admin admin] The token cache is being invalidate because project 330600f052a147fbad7624893a769c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:42:19.990278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:19.990865 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:19.992511 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1184/2398] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:42:19 2022] DELETE /identity/v3/projects/330600f052a147fbad7624893a769c36 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:19.997357 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2f9cd-1952-4078-a84e-3b2c628da583 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:20.007439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2f9cd-1952-4078-a84e-3b2c628da583 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:20.070055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038347df-60e7-4ecf-9036-a6bf9f90c166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:20.070698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038347df-60e7-4ecf-9036-a6bf9f90c166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:20.070999 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038347df-60e7-4ecf-9036-a6bf9f90c166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:20.071277 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038347df-60e7-4ecf-9036-a6bf9f90c166 admin admin] PATH_INFO: `/v3/users/5af062aae84d4dc097abdd6cd074de6c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:20.073111 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038347df-60e7-4ecf-9036-a6bf9f90c166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af062aae84d4dc097abdd6cd074de6c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:20.075177 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038347df-60e7-4ecf-9036-a6bf9f90c166 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:20.125259 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-038347df-60e7-4ecf-9036-a6bf9f90c166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af062aae84d4dc097abdd6cd074de6c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:20.125905 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-038347df-60e7-4ecf-9036-a6bf9f90c166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af062aae84d4dc097abdd6cd074de6c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:20.133182 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-038347df-60e7-4ecf-9036-a6bf9f90c166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af062aae84d4dc097abdd6cd074de6c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:20.145893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-038347df-60e7-4ecf-9036-a6bf9f90c166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af062aae84d4dc097abdd6cd074de6c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:20.146578 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-038347df-60e7-4ecf-9036-a6bf9f90c166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af062aae84d4dc097abdd6cd074de6c'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:20.163676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1215/2399] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:42:19 2022] DELETE /identity/v3/users/5af062aae84d4dc097abdd6cd074de6c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:20.441646 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:20.443151 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:20.456294 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ebd13-2595-4c72-8d7a-3c4c4d605b0a admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:20.514792 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428cbcd-76f0-4f1d-9542-d786cd109d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:20.515579 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428cbcd-76f0-4f1d-9542-d786cd109d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:20.515861 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428cbcd-76f0-4f1d-9542-d786cd109d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:20.516137 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428cbcd-76f0-4f1d-9542-d786cd109d37 admin admin] PATH_INFO: `/v3/projects/b3100600d8144c77b175a0706586c3bd` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:20.517436 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428cbcd-76f0-4f1d-9542-d786cd109d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3100600d8144c77b175a0706586c3bd)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:20.519571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428cbcd-76f0-4f1d-9542-d786cd109d37 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:20.569623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-2428cbcd-76f0-4f1d-9542-d786cd109d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3100600d8144c77b175a0706586c3bd', 'request_id': 'req-2428cbcd-76f0-4f1d-9542-d786cd109d37'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:20.576116 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-2428cbcd-76f0-4f1d-9542-d786cd109d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3100600d8144c77b175a0706586c3bd', 'request_id': 'req-2428cbcd-76f0-4f1d-9542-d786cd109d37'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:20.582144 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-2428cbcd-76f0-4f1d-9542-d786cd109d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3100600d8144c77b175a0706586c3bd', 'request_id': 'req-2428cbcd-76f0-4f1d-9542-d786cd109d37'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:20.598610 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-2428cbcd-76f0-4f1d-9542-d786cd109d37 admin admin] The token cache is being invalidate because project b3100600d8144c77b175a0706586c3bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:42:20.599018 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-2428cbcd-76f0-4f1d-9542-d786cd109d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:20.599745 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-2428cbcd-76f0-4f1d-9542-d786cd109d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:20.605769 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1185/2400] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:42:20 2022] DELETE /identity/v3/projects/b3100600d8144c77b175a0706586c3bd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:20.607297 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a092a38-bd8d-4f15-ae4a-b995a46db729 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:20.607776 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a092a38-bd8d-4f15-ae4a-b995a46db729 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:20.607892 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a092a38-bd8d-4f15-ae4a-b995a46db729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:20.627659 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-5a092a38-bd8d-4f15-ae4a-b995a46db729 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:20.628802 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5a092a38-bd8d-4f15-ae4a-b995a46db729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:20.692336 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1216/2401] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:20.701159 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6909862-1fac-47d0-b8ad-ffaf4e785fb0 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:20.701446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6909862-1fac-47d0-b8ad-ffaf4e785fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:20.701745 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6909862-1fac-47d0-b8ad-ffaf4e785fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:20.721440 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-d6909862-1fac-47d0-b8ad-ffaf4e785fb0 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:20.722644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d6909862-1fac-47d0-b8ad-ffaf4e785fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:20.731268 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1186/2402] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:20.735444 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a092a38-bd8d-4f15-ae4a-b995a46db729 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:20.740258 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:20.747289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a092a38-bd8d-4f15-ae4a-b995a46db729 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:20.752741 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3b779-a0ce-4243-a6c8-5da3fa2ba3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:20.753340 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3b779-a0ce-4243-a6c8-5da3fa2ba3be admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:20.753618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3b779-a0ce-4243-a6c8-5da3fa2ba3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:20.753890 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3b779-a0ce-4243-a6c8-5da3fa2ba3be admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:20.754526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3b779-a0ce-4243-a6c8-5da3fa2ba3be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:42:20.754834 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3b779-a0ce-4243-a6c8-5da3fa2ba3be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:20.756514 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3b779-a0ce-4243-a6c8-5da3fa2ba3be admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:20.768195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1217/2403] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:42:20.772458 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6909862-1fac-47d0-b8ad-ffaf4e785fb0 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:20.777237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:20.783388 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6909862-1fac-47d0-b8ad-ffaf4e785fb0 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:20.788786 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac846f6c-bab7-41af-a608-0dfde5c18dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:20.789381 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac846f6c-bab7-41af-a608-0dfde5c18dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:20.789660 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac846f6c-bab7-41af-a608-0dfde5c18dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:20.789933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac846f6c-bab7-41af-a608-0dfde5c18dd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:20.790571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac846f6c-bab7-41af-a608-0dfde5c18dd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:20.793359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac846f6c-bab7-41af-a608-0dfde5c18dd9 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:20.819663 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1187/2404] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:42:20 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:42:20.824446 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3b779-a0ce-4243-a6c8-5da3fa2ba3be admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:20.834303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3b779-a0ce-4243-a6c8-5da3fa2ba3be admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:20.894941 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db264c38-7e13-4248-9623-8738db85002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:20.895506 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db264c38-7e13-4248-9623-8738db85002c admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:20.895787 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db264c38-7e13-4248-9623-8738db85002c admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:20.896060 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db264c38-7e13-4248-9623-8738db85002c admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:20.896693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db264c38-7e13-4248-9623-8738db85002c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:20.898642 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db264c38-7e13-4248-9623-8738db85002c admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:20.919829 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1218/2405] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:42:20 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:42:20.924081 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac846f6c-bab7-41af-a608-0dfde5c18dd9 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:20.934799 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac846f6c-bab7-41af-a608-0dfde5c18dd9 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:20.939389 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c461e80-2894-421a-a653-0d28ebcead0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:20.939980 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c461e80-2894-421a-a653-0d28ebcead0a admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:20.940257 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c461e80-2894-421a-a653-0d28ebcead0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:20.940526 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c461e80-2894-421a-a653-0d28ebcead0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:20.941165 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c461e80-2894-421a-a653-0d28ebcead0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:20.942732 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c461e80-2894-421a-a653-0d28ebcead0a admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:20.953280 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1188/2406] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:42:20.957148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db264c38-7e13-4248-9623-8738db85002c admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:20.967573 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db264c38-7e13-4248-9623-8738db85002c admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:20.972116 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eae349-2c18-4201-bd8e-13b7032afd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:20.972704 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eae349-2c18-4201-bd8e-13b7032afd7a admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:20.972984 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eae349-2c18-4201-bd8e-13b7032afd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:20.973257 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eae349-2c18-4201-bd8e-13b7032afd7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:20.973888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eae349-2c18-4201-bd8e-13b7032afd7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:20.975586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eae349-2c18-4201-bd8e-13b7032afd7a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:20.985978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1219/2407] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:42:20.990010 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c461e80-2894-421a-a653-0d28ebcead0a admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:21.000640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c461e80-2894-421a-a653-0d28ebcead0a admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:21.005206 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c75996-02bf-45a6-82cb-7526342c5eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:21.005843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c75996-02bf-45a6-82cb-7526342c5eba admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:21.006118 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c75996-02bf-45a6-82cb-7526342c5eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:21.006389 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c75996-02bf-45a6-82cb-7526342c5eba admin admin] PATH_INFO: `/v3/projects/cf54fad506564452b15030ce6ccf9926/users/268b3388cdbe4e86b7d2e3924b05f3e2/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:21.020951 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c75996-02bf-45a6-82cb-7526342c5eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf54fad506564452b15030ce6ccf9926, user_id=268b3388cdbe4e86b7d2e3924b05f3e2, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:21.023615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c75996-02bf-45a6-82cb-7526342c5eba admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:21.037264 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1189/2408] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:42:20 2022] PUT /identity/v3/projects/cf54fad506564452b15030ce6ccf9926/users/268b3388cdbe4e86b7d2e3924b05f3e2/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:21.049286 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac89ae-6441-4230-b9f2-f14102aafc41 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:21.049577 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac89ae-6441-4230-b9f2-f14102aafc41 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:21.049866 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac89ae-6441-4230-b9f2-f14102aafc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:21.077712 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-bfac89ae-6441-4230-b9f2-f14102aafc41 None None] MFA Rules not processed for user `268b3388cdbe4e86b7d2e3924b05f3e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:21.078935 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-bfac89ae-6441-4230-b9f2-f14102aafc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:21.144338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1220/2409] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:21.148957 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c75996-02bf-45a6-82cb-7526342c5eba admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:21.225275 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c75996-02bf-45a6-82cb-7526342c5eba admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:21.230499 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5413f2-a6b8-4a01-935e-ecb4ff70e0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:21.231162 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5413f2-a6b8-4a01-935e-ecb4ff70e0d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:21.231434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5413f2-a6b8-4a01-935e-ecb4ff70e0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:21.231732 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5413f2-a6b8-4a01-935e-ecb4ff70e0d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:21.232370 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5413f2-a6b8-4a01-935e-ecb4ff70e0d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:21.234437 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5413f2-a6b8-4a01-935e-ecb4ff70e0d3 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:21.265637 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1190/2410] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:42:21 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:42:21.269780 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac89ae-6441-4230-b9f2-f14102aafc41 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:21.281393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac89ae-6441-4230-b9f2-f14102aafc41 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:21.334325 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:21.341631 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e157d3-822c-42ec-bb8a-b93b7ac042b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:21.342423 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e157d3-822c-42ec-bb8a-b93b7ac042b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:21.342899 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e157d3-822c-42ec-bb8a-b93b7ac042b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:21.343381 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e157d3-822c-42ec-bb8a-b93b7ac042b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:21.344018 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e157d3-822c-42ec-bb8a-b93b7ac042b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:21.346008 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e157d3-822c-42ec-bb8a-b93b7ac042b5 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:21.367094 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1221/2411] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:42:21 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:42:21.371804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5413f2-a6b8-4a01-935e-ecb4ff70e0d3 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:21.381994 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5413f2-a6b8-4a01-935e-ecb4ff70e0d3 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:21.387732 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfebd1d-ba10-43a7-9d4a-fdcf61053beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:21.388371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfebd1d-ba10-43a7-9d4a-fdcf61053beb admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:21.388647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfebd1d-ba10-43a7-9d4a-fdcf61053beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:21.388916 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfebd1d-ba10-43a7-9d4a-fdcf61053beb admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:21.389580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfebd1d-ba10-43a7-9d4a-fdcf61053beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:21.391204 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfebd1d-ba10-43a7-9d4a-fdcf61053beb admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:21.403169 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1191/2412] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:42:21.407190 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e157d3-822c-42ec-bb8a-b93b7ac042b5 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:21.417058 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e157d3-822c-42ec-bb8a-b93b7ac042b5 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:21.421635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43402e6-ff9a-4127-8826-62a47183b942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:21.422273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43402e6-ff9a-4127-8826-62a47183b942 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:21.422551 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43402e6-ff9a-4127-8826-62a47183b942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:21.422825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43402e6-ff9a-4127-8826-62a47183b942 admin admin] PATH_INFO: `/v3/projects/d46199e061ac4a799e8c1ae4d2631e5f/users/de97c661bfd14eefb2444c08ee5a29fc/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:21.437922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43402e6-ff9a-4127-8826-62a47183b942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46199e061ac4a799e8c1ae4d2631e5f, user_id=de97c661bfd14eefb2444c08ee5a29fc, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:21.440619 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43402e6-ff9a-4127-8826-62a47183b942 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:21.453323 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1222/2413] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:42:21 2022] PUT /identity/v3/projects/d46199e061ac4a799e8c1ae4d2631e5f/users/de97c661bfd14eefb2444c08ee5a29fc/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:21.457250 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfebd1d-ba10-43a7-9d4a-fdcf61053beb admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:21.467644 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfebd1d-ba10-43a7-9d4a-fdcf61053beb admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:21.522570 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce591ef-5d6a-4d7b-aeef-cd84673629ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:21.523283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce591ef-5d6a-4d7b-aeef-cd84673629ba admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:21.523563 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce591ef-5d6a-4d7b-aeef-cd84673629ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:21.523836 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce591ef-5d6a-4d7b-aeef-cd84673629ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:21.524465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce591ef-5d6a-4d7b-aeef-cd84673629ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:21.526623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce591ef-5d6a-4d7b-aeef-cd84673629ba admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:21.536089 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1192/2414] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:42:21.540166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43402e6-ff9a-4127-8826-62a47183b942 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:21.550814 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43402e6-ff9a-4127-8826-62a47183b942 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:21.555700 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8833350-4800-4669-876e-b5faa5a25160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:21.556338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8833350-4800-4669-876e-b5faa5a25160 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:21.556615 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8833350-4800-4669-876e-b5faa5a25160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:21.556913 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8833350-4800-4669-876e-b5faa5a25160 admin admin] PATH_INFO: `/v3/projects/d46199e061ac4a799e8c1ae4d2631e5f/users/de97c661bfd14eefb2444c08ee5a29fc/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:21.559132 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8833350-4800-4669-876e-b5faa5a25160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46199e061ac4a799e8c1ae4d2631e5f, user_id=de97c661bfd14eefb2444c08ee5a29fc, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:21.561771 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8833350-4800-4669-876e-b5faa5a25160 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:21.574208 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1223/2415] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:42:21 2022] PUT /identity/v3/projects/d46199e061ac4a799e8c1ae4d2631e5f/users/de97c661bfd14eefb2444c08ee5a29fc/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:21.585691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113947-24a3-45e8-9dc7-14da5c126000 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:21.586097 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113947-24a3-45e8-9dc7-14da5c126000 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:21.586383 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d113947-24a3-45e8-9dc7-14da5c126000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:21.617556 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-0d113947-24a3-45e8-9dc7-14da5c126000 None None] MFA Rules not processed for user `de97c661bfd14eefb2444c08ee5a29fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:21.618770 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0d113947-24a3-45e8-9dc7-14da5c126000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:21.623009 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:21.690485 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1193/2416] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:21 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:21.702170 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8833350-4800-4669-876e-b5faa5a25160 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:21.704427 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-b8833350-4800-4669-876e-b5faa5a25160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:21.771946 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8833350-4800-4669-876e-b5faa5a25160 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:21.775796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4e3a3-04d7-427d-a94b-3740514758e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:21.776400 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4e3a3-04d7-427d-a94b-3740514758e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:21.776702 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4e3a3-04d7-427d-a94b-3740514758e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:21.776972 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4e3a3-04d7-427d-a94b-3740514758e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:21.785863 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4e3a3-04d7-427d-a94b-3740514758e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:21.787314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4e3a3-04d7-427d-a94b-3740514758e2 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:21.797436 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1224/2417] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:42:21 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:42:21.846022 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d113947-24a3-45e8-9dc7-14da5c126000 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:21.847435 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0d113947-24a3-45e8-9dc7-14da5c126000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:21.859776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d113947-24a3-45e8-9dc7-14da5c126000 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:21.863636 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5fe3d-5b9c-4a33-818e-7cdc913b2671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:21.864241 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5fe3d-5b9c-4a33-818e-7cdc913b2671 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:21.864522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5fe3d-5b9c-4a33-818e-7cdc913b2671 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:21.864794 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5fe3d-5b9c-4a33-818e-7cdc913b2671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:21.930636 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5fe3d-5b9c-4a33-818e-7cdc913b2671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:21.931431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5fe3d-5b9c-4a33-818e-7cdc913b2671 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:21.941686 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1194/2418] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:42:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:42:25.295457 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4e3a3-04d7-427d-a94b-3740514758e2 service cinder] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:25.373342 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4e3a3-04d7-427d-a94b-3740514758e2 service cinder] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:25.377949 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572b06a-a729-48cd-a584-b2a1b921859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:25.378716 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572b06a-a729-48cd-a584-b2a1b921859b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:25.379078 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572b06a-a729-48cd-a584-b2a1b921859b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:25.379360 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572b06a-a729-48cd-a584-b2a1b921859b admin admin] PATH_INFO: `/v3/users/268b3388cdbe4e86b7d2e3924b05f3e2` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:25.381641 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572b06a-a729-48cd-a584-b2a1b921859b admin admin] RBAC: Authorizing `identity:delete_user(user_id=268b3388cdbe4e86b7d2e3924b05f3e2)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:25.383687 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572b06a-a729-48cd-a584-b2a1b921859b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:25.433574 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f572b06a-a729-48cd-a584-b2a1b921859b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '268b3388cdbe4e86b7d2e3924b05f3e2'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:25.434294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f572b06a-a729-48cd-a584-b2a1b921859b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '268b3388cdbe4e86b7d2e3924b05f3e2'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:25.439671 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:25.442341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f572b06a-a729-48cd-a584-b2a1b921859b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '268b3388cdbe4e86b7d2e3924b05f3e2'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:25.457038 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f572b06a-a729-48cd-a584-b2a1b921859b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '268b3388cdbe4e86b7d2e3924b05f3e2'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:25.457856 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-f572b06a-a729-48cd-a584-b2a1b921859b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '268b3388cdbe4e86b7d2e3924b05f3e2'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:25.471578 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1225/2419] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:42:25 2022] DELETE /identity/v3/users/268b3388cdbe4e86b7d2e3924b05f3e2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:25.476101 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51174b35-ce0b-4254-8c9d-b7439621c987 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:25.476580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51174b35-ce0b-4254-8c9d-b7439621c987 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:25.476704 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51174b35-ce0b-4254-8c9d-b7439621c987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:25.496293 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-51174b35-ce0b-4254-8c9d-b7439621c987 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:25.497523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-51174b35-ce0b-4254-8c9d-b7439621c987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:25.556313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1195/2420] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:25.566106 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572b06a-a729-48cd-a584-b2a1b921859b admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:25.567566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f572b06a-a729-48cd-a584-b2a1b921859b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:25.624922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572b06a-a729-48cd-a584-b2a1b921859b admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:25.628677 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88683977-805a-4b85-9f82-70d3ff7fb6c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:25.629422 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88683977-805a-4b85-9f82-70d3ff7fb6c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:25.629587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88683977-805a-4b85-9f82-70d3ff7fb6c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:25.629847 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88683977-805a-4b85-9f82-70d3ff7fb6c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:25.639838 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88683977-805a-4b85-9f82-70d3ff7fb6c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:25.641259 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88683977-805a-4b85-9f82-70d3ff7fb6c6 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:25.650615 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1226/2421] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:42:25.956571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51174b35-ce0b-4254-8c9d-b7439621c987 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:25.958015 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-51174b35-ce0b-4254-8c9d-b7439621c987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:25.970415 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51174b35-ce0b-4254-8c9d-b7439621c987 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:25.975075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:25.975716 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:25.975999 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:25.976287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496 admin admin] PATH_INFO: `/v3/projects/cf54fad506564452b15030ce6ccf9926` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:25.977407 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf54fad506564452b15030ce6ccf9926)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:25.979939 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:26.020457 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:26.031655 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf54fad506564452b15030ce6ccf9926', 'request_id': 'req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:26.038173 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf54fad506564452b15030ce6ccf9926', 'request_id': 'req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:26.044673 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf54fad506564452b15030ce6ccf9926', 'request_id': 'req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:26.058793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496 admin admin] The token cache is being invalidate because project cf54fad506564452b15030ce6ccf9926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:42:26.059026 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:26.059653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:26.061185 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1196/2422] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:42:25 2022] DELETE /identity/v3/projects/cf54fad506564452b15030ce6ccf9926 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:26.065224 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88683977-805a-4b85-9f82-70d3ff7fb6c6 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:26.075389 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88683977-805a-4b85-9f82-70d3ff7fb6c6 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:26.133524 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f5ee6-7647-4041-85b9-5e766d08988b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:26.134244 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f5ee6-7647-4041-85b9-5e766d08988b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:26.134526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f5ee6-7647-4041-85b9-5e766d08988b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:26.134804 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f5ee6-7647-4041-85b9-5e766d08988b admin admin] PATH_INFO: `/v3/users/de97c661bfd14eefb2444c08ee5a29fc` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:26.136623 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f5ee6-7647-4041-85b9-5e766d08988b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de97c661bfd14eefb2444c08ee5a29fc)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:26.138572 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f5ee6-7647-4041-85b9-5e766d08988b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:26.185504 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-e76f5ee6-7647-4041-85b9-5e766d08988b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de97c661bfd14eefb2444c08ee5a29fc'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:26.186166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-e76f5ee6-7647-4041-85b9-5e766d08988b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de97c661bfd14eefb2444c08ee5a29fc'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:26.194301 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-e76f5ee6-7647-4041-85b9-5e766d08988b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de97c661bfd14eefb2444c08ee5a29fc'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:26.207090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-e76f5ee6-7647-4041-85b9-5e766d08988b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de97c661bfd14eefb2444c08ee5a29fc'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:26.207765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-e76f5ee6-7647-4041-85b9-5e766d08988b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de97c661bfd14eefb2444c08ee5a29fc'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:26.210525 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:26.224776 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1227/2423] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:42:26 2022] DELETE /identity/v3/users/de97c661bfd14eefb2444c08ee5a29fc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:42:26.565101 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:26.567164 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:26.590655 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba76bb-3c3c-4b79-9dc4-d3a814c5f496 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:26.652129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d27b12e-59a7-42ca-83ea-c82b4eb11adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:26.652808 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27b12e-59a7-42ca-83ea-c82b4eb11adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:26.653096 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27b12e-59a7-42ca-83ea-c82b4eb11adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:26.653373 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d27b12e-59a7-42ca-83ea-c82b4eb11adf admin admin] PATH_INFO: `/v3/projects/d46199e061ac4a799e8c1ae4d2631e5f` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:26.654521 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27b12e-59a7-42ca-83ea-c82b4eb11adf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46199e061ac4a799e8c1ae4d2631e5f)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:26.656465 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d27b12e-59a7-42ca-83ea-c82b4eb11adf admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:26.706531 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-4d27b12e-59a7-42ca-83ea-c82b4eb11adf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46199e061ac4a799e8c1ae4d2631e5f', 'request_id': 'req-4d27b12e-59a7-42ca-83ea-c82b4eb11adf'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:26.714533 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-4d27b12e-59a7-42ca-83ea-c82b4eb11adf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46199e061ac4a799e8c1ae4d2631e5f', 'request_id': 'req-4d27b12e-59a7-42ca-83ea-c82b4eb11adf'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:26.721077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-4d27b12e-59a7-42ca-83ea-c82b4eb11adf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46199e061ac4a799e8c1ae4d2631e5f', 'request_id': 'req-4d27b12e-59a7-42ca-83ea-c82b4eb11adf'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:26.733910 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-4d27b12e-59a7-42ca-83ea-c82b4eb11adf admin admin] The token cache is being invalidate because project d46199e061ac4a799e8c1ae4d2631e5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:42:26.734344 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-4d27b12e-59a7-42ca-83ea-c82b4eb11adf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:26.735154 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-4d27b12e-59a7-42ca-83ea-c82b4eb11adf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:26.736687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1197/2424] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:42:26 2022] DELETE /identity/v3/projects/d46199e061ac4a799e8c1ae4d2631e5f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:26.741668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5252d-c915-4e77-be67-b620f0f53d7c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:26.742176 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5252d-c915-4e77-be67-b620f0f53d7c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:26.742288 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5252d-c915-4e77-be67-b620f0f53d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:26.764513 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-22a5252d-c915-4e77-be67-b620f0f53d7c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:26.765819 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-22a5252d-c915-4e77-be67-b620f0f53d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:26.827372 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1228/2425] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:26.835103 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5152ce-7e3c-46c7-85ef-fe6716b4072e None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:26.835363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5152ce-7e3c-46c7-85ef-fe6716b4072e None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:26.835637 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5152ce-7e3c-46c7-85ef-fe6716b4072e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:26.856233 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-9a5152ce-7e3c-46c7-85ef-fe6716b4072e None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:26.857388 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9a5152ce-7e3c-46c7-85ef-fe6716b4072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:26.865389 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1198/2426] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:26.870436 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5252d-c915-4e77-be67-b620f0f53d7c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:26.881014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5252d-c915-4e77-be67-b620f0f53d7c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:26.886789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aecfd-aa8a-4edc-92b3-9a9449badf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:26.887444 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aecfd-aa8a-4edc-92b3-9a9449badf12 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:26.887734 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aecfd-aa8a-4edc-92b3-9a9449badf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:26.888012 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aecfd-aa8a-4edc-92b3-9a9449badf12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:26.888658 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aecfd-aa8a-4edc-92b3-9a9449badf12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:42:26.888968 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aecfd-aa8a-4edc-92b3-9a9449badf12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:26.890671 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461aecfd-aa8a-4edc-92b3-9a9449badf12 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:26.907132 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1229/2427] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:42:26.908408 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5152ce-7e3c-46c7-85ef-fe6716b4072e None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:26.918436 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5152ce-7e3c-46c7-85ef-fe6716b4072e None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:26.923190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4419e8e-bfd6-4aba-9cdf-725ab56f5988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:26.923905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4419e8e-bfd6-4aba-9cdf-725ab56f5988 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:26.924190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4419e8e-bfd6-4aba-9cdf-725ab56f5988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:26.924460 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4419e8e-bfd6-4aba-9cdf-725ab56f5988 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:26.925208 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4419e8e-bfd6-4aba-9cdf-725ab56f5988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:26.927548 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4419e8e-bfd6-4aba-9cdf-725ab56f5988 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:26.959059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1199/2428] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:42:26 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:42:26.964126 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aecfd-aa8a-4edc-92b3-9a9449badf12 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:26.975439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aecfd-aa8a-4edc-92b3-9a9449badf12 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:27.034151 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6a2f4-e4cc-4d04-97aa-a1cf3020ef8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:27.034753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6a2f4-e4cc-4d04-97aa-a1cf3020ef8a admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:27.035066 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6a2f4-e4cc-4d04-97aa-a1cf3020ef8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:27.035345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6a2f4-e4cc-4d04-97aa-a1cf3020ef8a admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:27.035993 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6a2f4-e4cc-4d04-97aa-a1cf3020ef8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:27.037962 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb6a2f4-e4cc-4d04-97aa-a1cf3020ef8a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:27.067374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1230/2429] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:42:26 2022] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:42:27.068662 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4419e8e-bfd6-4aba-9cdf-725ab56f5988 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:27.080768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4419e8e-bfd6-4aba-9cdf-725ab56f5988 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:27.086198 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e227cea-70d9-4a99-8bd9-86884d52c61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:27.086903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e227cea-70d9-4a99-8bd9-86884d52c61a admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:27.087382 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e227cea-70d9-4a99-8bd9-86884d52c61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:27.087516 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e227cea-70d9-4a99-8bd9-86884d52c61a admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:27.088859 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e227cea-70d9-4a99-8bd9-86884d52c61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:27.090578 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e227cea-70d9-4a99-8bd9-86884d52c61a admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:27.105062 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1200/2430] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:42:27.106232 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6a2f4-e4cc-4d04-97aa-a1cf3020ef8a admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:27.117569 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6a2f4-e4cc-4d04-97aa-a1cf3020ef8a admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:27.124754 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf355dd-1054-4bb6-9d34-31cffe0d1162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:27.125571 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf355dd-1054-4bb6-9d34-31cffe0d1162 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:27.125848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf355dd-1054-4bb6-9d34-31cffe0d1162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:27.126118 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf355dd-1054-4bb6-9d34-31cffe0d1162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:27.126765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf355dd-1054-4bb6-9d34-31cffe0d1162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:27.128666 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf355dd-1054-4bb6-9d34-31cffe0d1162 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:27.129255 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8dcf3-d223-47b0-bc2f-c572c05f1e8e None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:27.129543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8dcf3-d223-47b0-bc2f-c572c05f1e8e None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:27.129821 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8dcf3-d223-47b0-bc2f-c572c05f1e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:27.140864 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1231/2431] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:42:27.145022 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf355dd-1054-4bb6-9d34-31cffe0d1162 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:27.151647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-38e8dcf3-d223-47b0-bc2f-c572c05f1e8e None None] MFA Rules not processed for user `44342daa668c4516ae131d9f0160261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:27.152985 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-38e8dcf3-d223-47b0-bc2f-c572c05f1e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:27.155606 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf355dd-1054-4bb6-9d34-31cffe0d1162 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:27.160991 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf01469-64e2-4694-8d5b-b03b46089290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:27.161654 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf01469-64e2-4694-8d5b-b03b46089290 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:27.162062 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf01469-64e2-4694-8d5b-b03b46089290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:27.162215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf01469-64e2-4694-8d5b-b03b46089290 admin admin] PATH_INFO: `/v3/projects/224ddf11780a4b23a32ff2d41fba6026/users/3e8a8e553ee54dc9afaad63d8e8d56a5/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:27.163203 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:27.188669 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf01469-64e2-4694-8d5b-b03b46089290 admin admin] RBAC: Authorizing `identity:create_grant(project_id=224ddf11780a4b23a32ff2d41fba6026, user_id=3e8a8e553ee54dc9afaad63d8e8d56a5, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:27.191751 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf01469-64e2-4694-8d5b-b03b46089290 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:27.211930 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1232/2432] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:42:27 2022] PUT /identity/v3/projects/224ddf11780a4b23a32ff2d41fba6026/users/3e8a8e553ee54dc9afaad63d8e8d56a5/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:27.239744 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1201/2433] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Oct 20 13:42:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:42:27.256331 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf01469-64e2-4694-8d5b-b03b46089290 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:27.258927 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-cdf01469-64e2-4694-8d5b-b03b46089290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:27.286230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12e25c-0c33-467a-a462-0d1bbb0f2e6c None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:27.286534 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12e25c-0c33-467a-a462-0d1bbb0f2e6c None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:27.286791 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12e25c-0c33-467a-a462-0d1bbb0f2e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:27.322978 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:27.324205 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-db12e25c-0c33-467a-a462-0d1bbb0f2e6c None None] MFA Rules not processed for user `3e8a8e553ee54dc9afaad63d8e8d56a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:27.325835 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-db12e25c-0c33-467a-a462-0d1bbb0f2e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:27.360062 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf01469-64e2-4694-8d5b-b03b46089290 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:27.368629 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaeaa5-1c65-407a-be71-d035f17516d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c893e6388ed340eca17da2e279ca34a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:27.369353 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaeaa5-1c65-407a-be71-d035f17516d3 service swift] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:27.369835 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaeaa5-1c65-407a-be71-d035f17516d3 service swift] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:27.370121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aaeaa5-1c65-407a-be71-d035f17516d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:27.407112 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1202/2434] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:42:27.409839 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12e25c-0c33-467a-a462-0d1bbb0f2e6c None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:27.438872 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aaeaa5-1c65-407a-be71-d035f17516d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:27.440588 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aaeaa5-1c65-407a-be71-d035f17516d3 service swift] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:27.449413 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1233/2435] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Oct 20 13:42:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 13:42:27.477938 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12e25c-0c33-467a-a462-0d1bbb0f2e6c None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:27.483707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544f127-2041-4374-94b5-3453f67a278d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:27.484316 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544f127-2041-4374-94b5-3453f67a278d admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:27.484593 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544f127-2041-4374-94b5-3453f67a278d admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:27.484991 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544f127-2041-4374-94b5-3453f67a278d admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:27.485699 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544f127-2041-4374-94b5-3453f67a278d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:27.487637 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544f127-2041-4374-94b5-3453f67a278d admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:27.519123 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1203/2436] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:42:27 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:42:27.522839 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaeaa5-1c65-407a-be71-d035f17516d3 service swift] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:27.537519 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aaeaa5-1c65-407a-be71-d035f17516d3 service swift] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:27.628142 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49290707-0d14-410a-b503-b7265d60ec68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:27.630052 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49290707-0d14-410a-b503-b7265d60ec68 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:27.630761 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49290707-0d14-410a-b503-b7265d60ec68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:27.631310 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49290707-0d14-410a-b503-b7265d60ec68 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:27.632414 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49290707-0d14-410a-b503-b7265d60ec68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:27.636887 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49290707-0d14-410a-b503-b7265d60ec68 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:27.668180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1234/2437] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:42:27 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:42:27.670175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544f127-2041-4374-94b5-3453f67a278d admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:27.682734 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544f127-2041-4374-94b5-3453f67a278d admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:27.689833 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b91ecf-8d27-4006-a54e-8a0810be7c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:27.690220 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b91ecf-8d27-4006-a54e-8a0810be7c0e admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:27.690513 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b91ecf-8d27-4006-a54e-8a0810be7c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:27.690788 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b91ecf-8d27-4006-a54e-8a0810be7c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:27.691557 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b91ecf-8d27-4006-a54e-8a0810be7c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:27.693232 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b91ecf-8d27-4006-a54e-8a0810be7c0e admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:27.710354 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1204/2438] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:42:27.711161 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49290707-0d14-410a-b503-b7265d60ec68 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:27.721450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49290707-0d14-410a-b503-b7265d60ec68 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:27.726541 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb044232-68a5-483b-8b48-eedbb1058a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:27.727250 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb044232-68a5-483b-8b48-eedbb1058a8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:27.727533 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb044232-68a5-483b-8b48-eedbb1058a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:27.727809 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb044232-68a5-483b-8b48-eedbb1058a8b admin admin] PATH_INFO: `/v3/projects/6565340583554f64b6f3313bd2346f94/users/7c9db785b97849cdaa9bd170835d5597/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:27.751593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb044232-68a5-483b-8b48-eedbb1058a8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6565340583554f64b6f3313bd2346f94, user_id=7c9db785b97849cdaa9bd170835d5597, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:27.754504 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb044232-68a5-483b-8b48-eedbb1058a8b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:27.771549 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1235/2439] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:42:27 2022] PUT /identity/v3/projects/6565340583554f64b6f3313bd2346f94/users/7c9db785b97849cdaa9bd170835d5597/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:42:27.775640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b91ecf-8d27-4006-a54e-8a0810be7c0e admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:27.787229 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b91ecf-8d27-4006-a54e-8a0810be7c0e admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:27.813692 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:27.883739 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83551abb-79bb-4c44-bf75-bb9430458fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:27.884490 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83551abb-79bb-4c44-bf75-bb9430458fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:27.884869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83551abb-79bb-4c44-bf75-bb9430458fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:27.885359 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83551abb-79bb-4c44-bf75-bb9430458fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:27.886276 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83551abb-79bb-4c44-bf75-bb9430458fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:27.888051 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83551abb-79bb-4c44-bf75-bb9430458fe1 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:27.899753 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1205/2440] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:42:27.905659 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb044232-68a5-483b-8b48-eedbb1058a8b admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:27.918533 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb044232-68a5-483b-8b48-eedbb1058a8b admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:27.924190 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0430b5-4d31-4dd6-9181-c627412af8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:27.925087 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0430b5-4d31-4dd6-9181-c627412af8c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:27.925515 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0430b5-4d31-4dd6-9181-c627412af8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:27.926028 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0430b5-4d31-4dd6-9181-c627412af8c4 admin admin] PATH_INFO: `/v3/projects/6565340583554f64b6f3313bd2346f94/users/7c9db785b97849cdaa9bd170835d5597/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:27.928183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0430b5-4d31-4dd6-9181-c627412af8c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6565340583554f64b6f3313bd2346f94, user_id=7c9db785b97849cdaa9bd170835d5597, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:27.931088 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0430b5-4d31-4dd6-9181-c627412af8c4 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:27.943074 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1236/2441] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:42:27 2022] PUT /identity/v3/projects/6565340583554f64b6f3313bd2346f94/users/7c9db785b97849cdaa9bd170835d5597/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:27.953807 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e69987-9996-403d-8a52-995927b64821 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:27.954091 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e69987-9996-403d-8a52-995927b64821 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:27.954549 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e69987-9996-403d-8a52-995927b64821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:27.985962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-67e69987-9996-403d-8a52-995927b64821 None None] MFA Rules not processed for user `7c9db785b97849cdaa9bd170835d5597`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:27.987222 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-67e69987-9996-403d-8a52-995927b64821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:28.047559 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3c857-f93d-48a8-8377-a9abdf360664 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:28.047846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3c857-f93d-48a8-8377-a9abdf360664 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:28.048385 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3c857-f93d-48a8-8377-a9abdf360664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:28.069232 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-46c3c857-f93d-48a8-8377-a9abdf360664 None None] MFA Rules not processed for user `44342daa668c4516ae131d9f0160261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:28.070459 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-46c3c857-f93d-48a8-8377-a9abdf360664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:28.074280 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1206/2442] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:27 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:28.082665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e69987-9996-403d-8a52-995927b64821 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:28.084616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-67e69987-9996-403d-8a52-995927b64821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:28.097161 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:28.136179 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1237/2443] 10.222.0.36 () {58 vars in 967 bytes} [Thu Oct 20 13:42:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:42:28.149026 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e69987-9996-403d-8a52-995927b64821 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:28.149719 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3c857-f93d-48a8-8377-a9abdf360664 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:28.153280 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74916a10-5b92-4531-a6bb-7b964657964d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:28.153928 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74916a10-5b92-4531-a6bb-7b964657964d service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:28.154343 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74916a10-5b92-4531-a6bb-7b964657964d service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:28.154484 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74916a10-5b92-4531-a6bb-7b964657964d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:28.166063 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74916a10-5b92-4531-a6bb-7b964657964d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:28.168528 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74916a10-5b92-4531-a6bb-7b964657964d service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:28.183716 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1207/2444] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:42:28 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:42:28.232215 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3c857-f93d-48a8-8377-a9abdf360664 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:28.237948 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7f3f7-eb2e-417e-9364-b34be79770a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c893e6388ed340eca17da2e279ca34a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:28.239016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7f3f7-eb2e-417e-9364-b34be79770a7 service swift] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:28.239297 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7f3f7-eb2e-417e-9364-b34be79770a7 service swift] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:28.239569 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7f3f7-eb2e-417e-9364-b34be79770a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:28.254727 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7f3f7-eb2e-417e-9364-b34be79770a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:28.256339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7f3f7-eb2e-417e-9364-b34be79770a7 service swift] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:28.267539 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1238/2445] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Oct 20 13:42:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 20 13:42:28.326561 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74916a10-5b92-4531-a6bb-7b964657964d service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:28.380849 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:28.396721 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74916a10-5b92-4531-a6bb-7b964657964d service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:28.401748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f47f2-31d6-4c09-9bad-a87674e36112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:28.402455 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f47f2-31d6-4c09-9bad-a87674e36112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:28.402741 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f47f2-31d6-4c09-9bad-a87674e36112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:28.403053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f47f2-31d6-4c09-9bad-a87674e36112 admin admin] PATH_INFO: `/v3/users/3e8a8e553ee54dc9afaad63d8e8d56a5` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:28.404328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f47f2-31d6-4c09-9bad-a87674e36112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e8a8e553ee54dc9afaad63d8e8d56a5)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:28.406302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240f47f2-31d6-4c09-9bad-a87674e36112 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:28.456206 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-240f47f2-31d6-4c09-9bad-a87674e36112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e8a8e553ee54dc9afaad63d8e8d56a5'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:28.457059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-240f47f2-31d6-4c09-9bad-a87674e36112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e8a8e553ee54dc9afaad63d8e8d56a5'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:28.464113 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-240f47f2-31d6-4c09-9bad-a87674e36112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e8a8e553ee54dc9afaad63d8e8d56a5'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:28.476078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-240f47f2-31d6-4c09-9bad-a87674e36112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e8a8e553ee54dc9afaad63d8e8d56a5'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:28.476983 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-240f47f2-31d6-4c09-9bad-a87674e36112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e8a8e553ee54dc9afaad63d8e8d56a5'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:28.490504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1208/2446] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:42:28 2022] DELETE /identity/v3/users/3e8a8e553ee54dc9afaad63d8e8d56a5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:28.495875 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8b935-312a-4a8c-87ca-7c2d9728125f None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:28.496161 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8b935-312a-4a8c-87ca-7c2d9728125f None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:28.496430 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8b935-312a-4a8c-87ca-7c2d9728125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:28.506721 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a5158-8b2a-472b-b143-3c2664bde1df None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:28.507059 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a5158-8b2a-472b-b143-3c2664bde1df None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:28.507342 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a5158-8b2a-472b-b143-3c2664bde1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:28.516939 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-d9b8b935-312a-4a8c-87ca-7c2d9728125f None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:28.518126 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d9b8b935-312a-4a8c-87ca-7c2d9728125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:28.527699 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-ec3a5158-8b2a-472b-b143-3c2664bde1df None None] MFA Rules not processed for user `44342daa668c4516ae131d9f0160261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:28.528892 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-ec3a5158-8b2a-472b-b143-3c2664bde1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:28.577845 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1239/2447] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:28.585777 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1209/2448] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Oct 20 13:42:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:42:28.589113 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8b935-312a-4a8c-87ca-7c2d9728125f None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:28.590453 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d9b8b935-312a-4a8c-87ca-7c2d9728125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:28.599121 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a5158-8b2a-472b-b143-3c2664bde1df None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:28.600448 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-ec3a5158-8b2a-472b-b143-3c2664bde1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:28.649798 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8b935-312a-4a8c-87ca-7c2d9728125f None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:28.654097 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7ecfe-f51d-4d1c-af1c-d1c2b221567b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:28.654710 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7ecfe-f51d-4d1c-af1c-d1c2b221567b service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:28.655020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7ecfe-f51d-4d1c-af1c-d1c2b221567b service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:28.655320 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7ecfe-f51d-4d1c-af1c-d1c2b221567b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:28.664885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7ecfe-f51d-4d1c-af1c-d1c2b221567b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:28.666376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7ecfe-f51d-4d1c-af1c-d1c2b221567b service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:28.671614 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a5158-8b2a-472b-b143-3c2664bde1df None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:28.676289 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1240/2449] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:42:28.676703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc717ca-322b-4a64-b27b-f67afda61323 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c893e6388ed340eca17da2e279ca34a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:28.677316 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc717ca-322b-4a64-b27b-f67afda61323 service swift] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:28.677600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc717ca-322b-4a64-b27b-f67afda61323 service swift] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:28.677898 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc717ca-322b-4a64-b27b-f67afda61323 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:28.687081 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc717ca-322b-4a64-b27b-f67afda61323 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:28.688677 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc717ca-322b-4a64-b27b-f67afda61323 service swift] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:28.693515 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:28.697744 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1210/2450] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Oct 20 13:42:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 20 13:42:29.018866 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7ecfe-f51d-4d1c-af1c-d1c2b221567b service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:29.021230 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-89e7ecfe-f51d-4d1c-af1c-d1c2b221567b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:29.046623 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7ecfe-f51d-4d1c-af1c-d1c2b221567b service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:29.051488 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b588b-ef75-4b42-99b5-c000ecb23022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:29.052121 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b588b-ef75-4b42-99b5-c000ecb23022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:29.052398 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b588b-ef75-4b42-99b5-c000ecb23022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:29.052670 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b588b-ef75-4b42-99b5-c000ecb23022 admin admin] PATH_INFO: `/v3/projects/224ddf11780a4b23a32ff2d41fba6026` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:29.055204 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf3df8-e01b-4907-b392-7a4c018dc36b None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:29.055745 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf3df8-e01b-4907-b392-7a4c018dc36b None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:29.055856 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b588b-ef75-4b42-99b5-c000ecb23022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=224ddf11780a4b23a32ff2d41fba6026)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:29.056013 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf3df8-e01b-4907-b392-7a4c018dc36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:29.058479 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b588b-ef75-4b42-99b5-c000ecb23022 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:29.060295 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=100 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:29.076299 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-7caf3df8-e01b-4907-b392-7a4c018dc36b None None] MFA Rules not processed for user `44342daa668c4516ae131d9f0160261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:29.077523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7caf3df8-e01b-4907-b392-7a4c018dc36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:29.085552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1211/2451] 10.222.0.36 () {58 vars in 967 bytes} [Thu Oct 20 13:42:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:29.098584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf3df8-e01b-4907-b392-7a4c018dc36b None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:29.111369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf3df8-e01b-4907-b392-7a4c018dc36b None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:29.112452 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d21b588b-ef75-4b42-99b5-c000ecb23022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '224ddf11780a4b23a32ff2d41fba6026', 'request_id': 'req-d21b588b-ef75-4b42-99b5-c000ecb23022'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:29.121115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d21b588b-ef75-4b42-99b5-c000ecb23022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '224ddf11780a4b23a32ff2d41fba6026', 'request_id': 'req-d21b588b-ef75-4b42-99b5-c000ecb23022'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:29.127885 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d21b588b-ef75-4b42-99b5-c000ecb23022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '224ddf11780a4b23a32ff2d41fba6026', 'request_id': 'req-d21b588b-ef75-4b42-99b5-c000ecb23022'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:29.139227 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d21b588b-ef75-4b42-99b5-c000ecb23022 admin admin] The token cache is being invalidate because project 224ddf11780a4b23a32ff2d41fba6026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:42:29.139519 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d21b588b-ef75-4b42-99b5-c000ecb23022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:29.140161 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-d21b588b-ef75-4b42-99b5-c000ecb23022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:29.141645 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1241/2452] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:42:29 2022] DELETE /identity/v3/projects/224ddf11780a4b23a32ff2d41fba6026 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:29.145496 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b588b-ef75-4b42-99b5-c000ecb23022 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:29.146923 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-d21b588b-ef75-4b42-99b5-c000ecb23022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:29.177832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cea26-e389-460f-808d-d8fa51c2f662 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c893e6388ed340eca17da2e279ca34a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:29.178548 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cea26-e389-460f-808d-d8fa51c2f662 service swift] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:29.178832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cea26-e389-460f-808d-d8fa51c2f662 service swift] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:29.179241 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cea26-e389-460f-808d-d8fa51c2f662 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:29.182756 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-846cea26-e389-460f-808d-d8fa51c2f662 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:29.235001 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b588b-ef75-4b42-99b5-c000ecb23022 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:29.240372 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4c732-3fdd-4cc2-8182-8e8460a97579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:29.241019 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4c732-3fdd-4cc2-8182-8e8460a97579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:29.241300 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4c732-3fdd-4cc2-8182-8e8460a97579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:29.241580 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4c732-3fdd-4cc2-8182-8e8460a97579 admin admin] PATH_INFO: `/v3/users/7c9db785b97849cdaa9bd170835d5597` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:29.242742 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4c732-3fdd-4cc2-8182-8e8460a97579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c9db785b97849cdaa9bd170835d5597)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:29.245329 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4c732-3fdd-4cc2-8182-8e8460a97579 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:29.265063 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cea26-e389-460f-808d-d8fa51c2f662 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:29.267091 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cea26-e389-460f-808d-d8fa51c2f662 service swift] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:29.278205 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1212/2453] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Oct 20 13:42:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 20 13:42:29.315580 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-50e4c732-3fdd-4cc2-8182-8e8460a97579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c9db785b97849cdaa9bd170835d5597'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:29.319366 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-50e4c732-3fdd-4cc2-8182-8e8460a97579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c9db785b97849cdaa9bd170835d5597'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:29.338688 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-50e4c732-3fdd-4cc2-8182-8e8460a97579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c9db785b97849cdaa9bd170835d5597'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:29.366165 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-50e4c732-3fdd-4cc2-8182-8e8460a97579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c9db785b97849cdaa9bd170835d5597'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:29.367083 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-50e4c732-3fdd-4cc2-8182-8e8460a97579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c9db785b97849cdaa9bd170835d5597'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:29.384628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1242/2454] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:42:29 2022] DELETE /identity/v3/users/7c9db785b97849cdaa9bd170835d5597 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:42:29.682773 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cea26-e389-460f-808d-d8fa51c2f662 service swift] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:29.698269 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cea26-e389-460f-808d-d8fa51c2f662 service swift] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:29.769197 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392b7e7-2ddf-4224-9624-8d44811393bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:29.769859 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392b7e7-2ddf-4224-9624-8d44811393bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:29.770143 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392b7e7-2ddf-4224-9624-8d44811393bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:29.770416 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392b7e7-2ddf-4224-9624-8d44811393bc admin admin] PATH_INFO: `/v3/projects/6565340583554f64b6f3313bd2346f94` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:29.771603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392b7e7-2ddf-4224-9624-8d44811393bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6565340583554f64b6f3313bd2346f94)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:29.773526 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392b7e7-2ddf-4224-9624-8d44811393bc admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:29.817164 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:29.827761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1392b7e7-2ddf-4224-9624-8d44811393bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6565340583554f64b6f3313bd2346f94', 'request_id': 'req-1392b7e7-2ddf-4224-9624-8d44811393bc'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:29.834229 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1392b7e7-2ddf-4224-9624-8d44811393bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6565340583554f64b6f3313bd2346f94', 'request_id': 'req-1392b7e7-2ddf-4224-9624-8d44811393bc'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:29.841206 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1392b7e7-2ddf-4224-9624-8d44811393bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6565340583554f64b6f3313bd2346f94', 'request_id': 'req-1392b7e7-2ddf-4224-9624-8d44811393bc'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:29.854197 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1392b7e7-2ddf-4224-9624-8d44811393bc admin admin] The token cache is being invalidate because project 6565340583554f64b6f3313bd2346f94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:42:29.854552 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1392b7e7-2ddf-4224-9624-8d44811393bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:29.855429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1392b7e7-2ddf-4224-9624-8d44811393bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:29.856999 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1213/2455] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:42:29 2022] DELETE /identity/v3/projects/6565340583554f64b6f3313bd2346f94 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:31.477278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4c732-3fdd-4cc2-8182-8e8460a97579 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:31.478728 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-50e4c732-3fdd-4cc2-8182-8e8460a97579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:31.491769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4c732-3fdd-4cc2-8182-8e8460a97579 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:31.496980 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:31.550363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b3bbd-a33c-46eb-98c4-2912910cb287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:31.551024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b3bbd-a33c-46eb-98c4-2912910cb287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:31.551309 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b3bbd-a33c-46eb-98c4-2912910cb287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:31.551586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b3bbd-a33c-46eb-98c4-2912910cb287 admin admin] PATH_INFO: `/v3/users/64e1f9c52ce54b22a2bb56f8afeb5029` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:31.552727 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b3bbd-a33c-46eb-98c4-2912910cb287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64e1f9c52ce54b22a2bb56f8afeb5029)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:31.554643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2b3bbd-a33c-46eb-98c4-2912910cb287 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:31.602287 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ef2b3bbd-a33c-46eb-98c4-2912910cb287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64e1f9c52ce54b22a2bb56f8afeb5029'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:31.602935 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ef2b3bbd-a33c-46eb-98c4-2912910cb287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64e1f9c52ce54b22a2bb56f8afeb5029'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:31.609922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ef2b3bbd-a33c-46eb-98c4-2912910cb287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64e1f9c52ce54b22a2bb56f8afeb5029'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:31.622965 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ef2b3bbd-a33c-46eb-98c4-2912910cb287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64e1f9c52ce54b22a2bb56f8afeb5029'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:31.623686 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-ef2b3bbd-a33c-46eb-98c4-2912910cb287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64e1f9c52ce54b22a2bb56f8afeb5029'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:31.639753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1243/2456] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:42:31 2022] DELETE /identity/v3/users/64e1f9c52ce54b22a2bb56f8afeb5029 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:42:31.644370 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6988935-7028-45c8-9846-2f516f376759 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:31.644842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6988935-7028-45c8-9846-2f516f376759 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:31.644967 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6988935-7028-45c8-9846-2f516f376759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:31.663983 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-d6988935-7028-45c8-9846-2f516f376759 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:31.665211 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d6988935-7028-45c8-9846-2f516f376759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:31.726703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1214/2457] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:31.736682 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b3bbd-a33c-46eb-98c4-2912910cb287 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:31.738204 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ef2b3bbd-a33c-46eb-98c4-2912910cb287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:31.797006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b3bbd-a33c-46eb-98c4-2912910cb287 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:31.800727 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebed203-adcf-42bd-acdd-0c4ddac3af03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:31.801357 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebed203-adcf-42bd-acdd-0c4ddac3af03 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:31.801637 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebed203-adcf-42bd-acdd-0c4ddac3af03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:31.801907 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebed203-adcf-42bd-acdd-0c4ddac3af03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:31.811206 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebed203-adcf-42bd-acdd-0c4ddac3af03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:31.812618 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebed203-adcf-42bd-acdd-0c4ddac3af03 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:31.822140 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1244/2458] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:42:31.991136 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6988935-7028-45c8-9846-2f516f376759 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:31.992843 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d6988935-7028-45c8-9846-2f516f376759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:32.006139 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6988935-7028-45c8-9846-2f516f376759 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:32.011380 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657855bb-a601-4159-b912-4a15e36f6e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:32.012009 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657855bb-a601-4159-b912-4a15e36f6e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:32.012287 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657855bb-a601-4159-b912-4a15e36f6e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:32.012583 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657855bb-a601-4159-b912-4a15e36f6e9d admin admin] PATH_INFO: `/v3/projects/d424808db0cc4918bfc411a6de608d33` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:32.013675 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657855bb-a601-4159-b912-4a15e36f6e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d424808db0cc4918bfc411a6de608d33)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:32.015640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657855bb-a601-4159-b912-4a15e36f6e9d admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:32.062186 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-657855bb-a601-4159-b912-4a15e36f6e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd424808db0cc4918bfc411a6de608d33', 'request_id': 'req-657855bb-a601-4159-b912-4a15e36f6e9d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:32.068253 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-657855bb-a601-4159-b912-4a15e36f6e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd424808db0cc4918bfc411a6de608d33', 'request_id': 'req-657855bb-a601-4159-b912-4a15e36f6e9d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:32.073903 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-657855bb-a601-4159-b912-4a15e36f6e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd424808db0cc4918bfc411a6de608d33', 'request_id': 'req-657855bb-a601-4159-b912-4a15e36f6e9d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:32.086217 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-657855bb-a601-4159-b912-4a15e36f6e9d admin admin] The token cache is being invalidate because project d424808db0cc4918bfc411a6de608d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:42:32.086498 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-657855bb-a601-4159-b912-4a15e36f6e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:32.087147 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-657855bb-a601-4159-b912-4a15e36f6e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:42:32.089105 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1215/2459] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:42:31 2022] DELETE /identity/v3/projects/d424808db0cc4918bfc411a6de608d33 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:42:41.817746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=75,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:42.083220 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=65,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:42:59.465339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72872ab0-ae72-451f-b04a-294c98154757 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:59.465857 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72872ab0-ae72-451f-b04a-294c98154757 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:59.465857 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72872ab0-ae72-451f-b04a-294c98154757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:59.485160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-72872ab0-ae72-451f-b04a-294c98154757 None None] MFA Rules not processed for user `0a2ac1496c0b410e96d13e7e0a8b51c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:42:59.486336 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-72872ab0-ae72-451f-b04a-294c98154757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:59.539280 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1245/2460] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:42:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:42:59.840212 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657855bb-a601-4159-b912-4a15e36f6e9d admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:42:59.841782 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-657855bb-a601-4159-b912-4a15e36f6e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:59.898298 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657855bb-a601-4159-b912-4a15e36f6e9d admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:42:59.902431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15bd85-9cc9-446b-a099-24bb6c5ccbb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:42:59.903053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15bd85-9cc9-446b-a099-24bb6c5ccbb0 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:42:59.903329 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15bd85-9cc9-446b-a099-24bb6c5ccbb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:42:59.903593 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15bd85-9cc9-446b-a099-24bb6c5ccbb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:42:59.905307 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0f15bd85-9cc9-446b-a099-24bb6c5ccbb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:42:59.914491 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15bd85-9cc9-446b-a099-24bb6c5ccbb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:42:59.915929 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15bd85-9cc9-446b-a099-24bb6c5ccbb0 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:42:59.923831 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1216/2461] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:42:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:43:09.532561 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=25 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:43:09.920446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=26 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:43:10.762497 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72872ab0-ae72-451f-b04a-294c98154757 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:43:10.763954 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-72872ab0-ae72-451f-b04a-294c98154757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:43:10.842703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72872ab0-ae72-451f-b04a-294c98154757 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:43:10.848353 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcec0a-83f8-4d36-926b-917c78f2f53a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:43:10.849017 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcec0a-83f8-4d36-926b-917c78f2f53a service nova] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:43:10.849302 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcec0a-83f8-4d36-926b-917c78f2f53a service nova] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:43:10.849576 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcec0a-83f8-4d36-926b-917c78f2f53a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:43:10.851405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-cedcec0a-83f8-4d36-926b-917c78f2f53a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:43:10.865010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcec0a-83f8-4d36-926b-917c78f2f53a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:43:10.866625 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcec0a-83f8-4d36-926b-917c78f2f53a service nova] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:43:10.879846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1246/2462] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:43:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:43:20.874718 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=34 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:43:51.855901 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15bd85-9cc9-446b-a099-24bb6c5ccbb0 service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:43:51.857889 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-0f15bd85-9cc9-446b-a099-24bb6c5ccbb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:43:52.050175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15bd85-9cc9-446b-a099-24bb6c5ccbb0 service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:43:52.056930 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aee22b-2721-4697-8b4c-66f2e160ea6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a00f0b4cee8d49a48a95317aec9f647c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:43:52.058100 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aee22b-2721-4697-8b4c-66f2e160ea6a service placement] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:43:52.058561 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aee22b-2721-4697-8b4c-66f2e160ea6a service placement] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:43:52.063002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aee22b-2721-4697-8b4c-66f2e160ea6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:43:52.065741 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-84aee22b-2721-4697-8b4c-66f2e160ea6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:43:52.079889 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aee22b-2721-4697-8b4c-66f2e160ea6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:43:52.081448 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aee22b-2721-4697-8b4c-66f2e160ea6a service placement] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:43:52.102556 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1217/2463] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:43:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:43:55.421986 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcec0a-83f8-4d36-926b-917c78f2f53a service nova] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:43:55.423476 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-cedcec0a-83f8-4d36-926b-917c78f2f53a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:43:55.550580 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcec0a-83f8-4d36-926b-917c78f2f53a service nova] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:43:55.555371 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2deaf-6f56-43dc-a0e9-68d984a4a684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:43:55.555986 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2deaf-6f56-43dc-a0e9-68d984a4a684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:43:55.556259 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2deaf-6f56-43dc-a0e9-68d984a4a684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:43:55.556528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2deaf-6f56-43dc-a0e9-68d984a4a684 admin admin] PATH_INFO: `/v3/users/05a08e72fd6b426699b47d178020560a` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:43:55.557633 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2deaf-6f56-43dc-a0e9-68d984a4a684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a08e72fd6b426699b47d178020560a)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:43:55.560297 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2deaf-6f56-43dc-a0e9-68d984a4a684 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:43:55.606979 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-fed2deaf-6f56-43dc-a0e9-68d984a4a684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a08e72fd6b426699b47d178020560a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:55.607550 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-fed2deaf-6f56-43dc-a0e9-68d984a4a684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a08e72fd6b426699b47d178020560a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:55.614314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-fed2deaf-6f56-43dc-a0e9-68d984a4a684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a08e72fd6b426699b47d178020560a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:55.625938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-fed2deaf-6f56-43dc-a0e9-68d984a4a684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a08e72fd6b426699b47d178020560a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:55.626558 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-fed2deaf-6f56-43dc-a0e9-68d984a4a684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a08e72fd6b426699b47d178020560a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:55.639528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1247/2464] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:43:55 2022] DELETE /identity/v3/users/05a08e72fd6b426699b47d178020560a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:43:55.894475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aee22b-2721-4697-8b4c-66f2e160ea6a service placement] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:43:55.912742 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aee22b-2721-4697-8b4c-66f2e160ea6a service placement] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:43:55.970980 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:43:55.971615 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:43:55.971895 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:43:55.972170 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a admin admin] PATH_INFO: `/v3/projects/91e7e29ffa52470d80815870b0d6fc1f` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:43:55.973278 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=91e7e29ffa52470d80815870b0d6fc1f)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:43:55.975196 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:43:55.999793 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:43:56.022523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91e7e29ffa52470d80815870b0d6fc1f', 'request_id': 'req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:56.028869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91e7e29ffa52470d80815870b0d6fc1f', 'request_id': 'req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:56.034434 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91e7e29ffa52470d80815870b0d6fc1f', 'request_id': 'req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:56.046842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a admin admin] The token cache is being invalidate because project 91e7e29ffa52470d80815870b0d6fc1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:43:56.047165 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:56.047774 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:56.049222 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1218/2465] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:43:55 2022] DELETE /identity/v3/projects/91e7e29ffa52470d80815870b0d6fc1f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:43:56.053266 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2deaf-6f56-43dc-a0e9-68d984a4a684 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:43:56.054701 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-fed2deaf-6f56-43dc-a0e9-68d984a4a684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:43:56.068427 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2deaf-6f56-43dc-a0e9-68d984a4a684 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:43:56.080833 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:43:56.126548 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacc651-b9ae-49b2-a217-6557919337ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:43:56.127129 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacc651-b9ae-49b2-a217-6557919337ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:43:56.127409 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacc651-b9ae-49b2-a217-6557919337ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:43:56.127680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacc651-b9ae-49b2-a217-6557919337ca admin admin] PATH_INFO: `/v3/users/477a7c8335a5446d86d9a1812d88760b` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:43:56.128801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacc651-b9ae-49b2-a217-6557919337ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=477a7c8335a5446d86d9a1812d88760b)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:43:56.130699 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacc651-b9ae-49b2-a217-6557919337ca admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:43:56.176329 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-7cacc651-b9ae-49b2-a217-6557919337ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '477a7c8335a5446d86d9a1812d88760b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:56.176970 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-7cacc651-b9ae-49b2-a217-6557919337ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '477a7c8335a5446d86d9a1812d88760b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:56.184695 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-7cacc651-b9ae-49b2-a217-6557919337ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '477a7c8335a5446d86d9a1812d88760b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:56.196420 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-7cacc651-b9ae-49b2-a217-6557919337ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '477a7c8335a5446d86d9a1812d88760b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:56.197049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-7cacc651-b9ae-49b2-a217-6557919337ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '477a7c8335a5446d86d9a1812d88760b'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:56.209471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1248/2466] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:43:56 2022] DELETE /identity/v3/users/477a7c8335a5446d86d9a1812d88760b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:43:56.378104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:43:56.379517 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:43:56.392547 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb435d6f-5b12-4163-9c27-f3b4015a5d1a admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:43:56.449778 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:43:56.450436 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:43:56.450712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:43:56.451012 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2 admin admin] PATH_INFO: `/v3/projects/a8c2110bbf5b4311b70348debfb9c379` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:43:56.452109 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c2110bbf5b4311b70348debfb9c379)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:43:56.453988 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:43:56.500035 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c2110bbf5b4311b70348debfb9c379', 'request_id': 'req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:56.505962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c2110bbf5b4311b70348debfb9c379', 'request_id': 'req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:56.511443 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c2110bbf5b4311b70348debfb9c379', 'request_id': 'req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:56.523962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2 admin admin] The token cache is being invalidate because project a8c2110bbf5b4311b70348debfb9c379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:43:56.524251 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:56.524872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:43:56.526365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1219/2467] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:43:56 2022] DELETE /identity/v3/projects/a8c2110bbf5b4311b70348debfb9c379 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:44:06.206074 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:44:06.520856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=66,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:44:10.814098 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e3b27-817e-4e83-8809-49516749a942 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:44:10.814557 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e3b27-817e-4e83-8809-49516749a942 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:44:10.814651 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e3b27-817e-4e83-8809-49516749a942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:44:10.844717 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-1e6e3b27-817e-4e83-8809-49516749a942 None None] MFA Rules not processed for user `44342daa668c4516ae131d9f0160261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:44:10.845926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1e6e3b27-817e-4e83-8809-49516749a942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:44:10.908019 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1249/2468] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Oct 20 13:44:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:44:10.953715 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:44:10.955158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:44:11.027857 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a15e8-49b8-4993-9e5b-b64b3cc4aca2 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:44:11.032804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60399d37-b7aa-4dce-ac43-12e7e37acbe9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c893e6388ed340eca17da2e279ca34a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:44:11.033405 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60399d37-b7aa-4dce-ac43-12e7e37acbe9 service swift] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:44:11.033685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60399d37-b7aa-4dce-ac43-12e7e37acbe9 service swift] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:44:11.033952 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60399d37-b7aa-4dce-ac43-12e7e37acbe9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:44:11.042706 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60399d37-b7aa-4dce-ac43-12e7e37acbe9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:44:11.044322 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60399d37-b7aa-4dce-ac43-12e7e37acbe9 service swift] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:44:11.052728 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1220/2469] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Oct 20 13:44:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 13:44:20.901157 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=32 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:44:21.049220 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=32 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:44:22.177800 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e3b27-817e-4e83-8809-49516749a942 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:44:22.179225 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1e6e3b27-817e-4e83-8809-49516749a942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:44:22.246490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e3b27-817e-4e83-8809-49516749a942 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:44:22.251353 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cc762-26d6-464f-a281-3268c29af485 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a00f0b4cee8d49a48a95317aec9f647c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:44:22.251950 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cc762-26d6-464f-a281-3268c29af485 service placement] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:44:22.252226 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cc762-26d6-464f-a281-3268c29af485 service placement] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:44:22.252494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cc762-26d6-464f-a281-3268c29af485 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:44:22.254188 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-e93cc762-26d6-464f-a281-3268c29af485 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:44:22.265759 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cc762-26d6-464f-a281-3268c29af485 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:44:22.267346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cc762-26d6-464f-a281-3268c29af485 service placement] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:44:22.277683 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1250/2470] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:44:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:44:25.667139 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874ba58-6a57-47d5-a24c-2b4044dba98c None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:44:25.667643 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874ba58-6a57-47d5-a24c-2b4044dba98c None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:44:25.667810 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874ba58-6a57-47d5-a24c-2b4044dba98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:44:25.688314 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-1874ba58-6a57-47d5-a24c-2b4044dba98c None None] MFA Rules not processed for user `44342daa668c4516ae131d9f0160261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:44:25.689507 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-1874ba58-6a57-47d5-a24c-2b4044dba98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:44:25.696647 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1221/2471] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Oct 20 13:44:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:44:25.709463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cc762-26d6-464f-a281-3268c29af485 service placement] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:44:25.720509 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cc762-26d6-464f-a281-3268c29af485 service placement] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:44:25.725429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1030352-d8b2-41c5-a41a-c9e777f66686 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c893e6388ed340eca17da2e279ca34a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:44:25.726017 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1030352-d8b2-41c5-a41a-c9e777f66686 service swift] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:44:25.726296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1030352-d8b2-41c5-a41a-c9e777f66686 service swift] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:44:25.726569 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1030352-d8b2-41c5-a41a-c9e777f66686 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:44:25.734346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1030352-d8b2-41c5-a41a-c9e777f66686 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:44:25.735914 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1030352-d8b2-41c5-a41a-c9e777f66686 service swift] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:44:25.743743 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1251/2472] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Oct 20 13:44:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 13:44:35.682482 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:44:35.740564 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=38 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:44:41.204091 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05020fdc-dcbd-4b23-819b-53820569cacb None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:44:41.204568 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05020fdc-dcbd-4b23-819b-53820569cacb None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:44:41.204675 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05020fdc-dcbd-4b23-819b-53820569cacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:44:41.223826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-05020fdc-dcbd-4b23-819b-53820569cacb None None] MFA Rules not processed for user `44342daa668c4516ae131d9f0160261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:44:41.225023 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-05020fdc-dcbd-4b23-819b-53820569cacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:44:41.233150 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1222/2473] 10.222.0.36 () {58 vars in 967 bytes} [Thu Oct 20 13:44:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:44:41.246179 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1030352-d8b2-41c5-a41a-c9e777f66686 service swift] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:44:41.256587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1030352-d8b2-41c5-a41a-c9e777f66686 service swift] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:44:41.261568 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939b36a-7634-4ad4-ad9e-eae6b03e32b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c893e6388ed340eca17da2e279ca34a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:44:41.262154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b36a-7634-4ad4-ad9e-eae6b03e32b7 service swift] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:44:41.262433 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b36a-7634-4ad4-ad9e-eae6b03e32b7 service swift] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:44:41.262703 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b36a-7634-4ad4-ad9e-eae6b03e32b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:44:41.270435 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939b36a-7634-4ad4-ad9e-eae6b03e32b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:44:41.272041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939b36a-7634-4ad4-ad9e-eae6b03e32b7 service swift] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:44:41.280641 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1252/2474] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Oct 20 13:44:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 20 13:44:51.218717 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:44:51.276682 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=6 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:20.804075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05020fdc-dcbd-4b23-819b-53820569cacb None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:20.805776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-05020fdc-dcbd-4b23-819b-53820569cacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:20.873365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05020fdc-dcbd-4b23-819b-53820569cacb None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:20.878153 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44794160-6e74-4e4c-9ede-bbd1daf29fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:20.878827 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44794160-6e74-4e4c-9ede-bbd1daf29fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:20.879141 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44794160-6e74-4e4c-9ede-bbd1daf29fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:20.879419 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44794160-6e74-4e4c-9ede-bbd1daf29fb5 admin admin] PATH_INFO: `/v3/users/0a2ac1496c0b410e96d13e7e0a8b51c3` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:20.880610 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44794160-6e74-4e4c-9ede-bbd1daf29fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2ac1496c0b410e96d13e7e0a8b51c3)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:20.882537 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44794160-6e74-4e4c-9ede-bbd1daf29fb5 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:20.931653 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-44794160-6e74-4e4c-9ede-bbd1daf29fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2ac1496c0b410e96d13e7e0a8b51c3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:20.932367 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-44794160-6e74-4e4c-9ede-bbd1daf29fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2ac1496c0b410e96d13e7e0a8b51c3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:20.939683 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-44794160-6e74-4e4c-9ede-bbd1daf29fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2ac1496c0b410e96d13e7e0a8b51c3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:20.951634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-44794160-6e74-4e4c-9ede-bbd1daf29fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2ac1496c0b410e96d13e7e0a8b51c3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:20.952354 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-44794160-6e74-4e4c-9ede-bbd1daf29fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2ac1496c0b410e96d13e7e0a8b51c3'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:20.964377 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1223/2475] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:45:20 2022] DELETE /identity/v3/users/0a2ac1496c0b410e96d13e7e0a8b51c3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:21.136490 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939b36a-7634-4ad4-ad9e-eae6b03e32b7 service swift] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:21.148939 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939b36a-7634-4ad4-ad9e-eae6b03e32b7 service swift] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:21.207825 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6f658-20a3-420a-9228-102f0176ba68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:21.208497 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6f658-20a3-420a-9228-102f0176ba68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:21.208772 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6f658-20a3-420a-9228-102f0176ba68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:21.209042 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6f658-20a3-420a-9228-102f0176ba68 admin admin] PATH_INFO: `/v3/projects/95a0fa8aa4bd45d2a62778c6d32490bd` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:21.210170 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6f658-20a3-420a-9228-102f0176ba68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a0fa8aa4bd45d2a62778c6d32490bd)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:21.212109 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6f658-20a3-420a-9228-102f0176ba68 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:21.258144 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-93a6f658-20a3-420a-9228-102f0176ba68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a0fa8aa4bd45d2a62778c6d32490bd', 'request_id': 'req-93a6f658-20a3-420a-9228-102f0176ba68'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:21.265114 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-93a6f658-20a3-420a-9228-102f0176ba68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a0fa8aa4bd45d2a62778c6d32490bd', 'request_id': 'req-93a6f658-20a3-420a-9228-102f0176ba68'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:21.271433 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-93a6f658-20a3-420a-9228-102f0176ba68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a0fa8aa4bd45d2a62778c6d32490bd', 'request_id': 'req-93a6f658-20a3-420a-9228-102f0176ba68'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:21.281541 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-93a6f658-20a3-420a-9228-102f0176ba68 admin admin] The token cache is being invalidate because project 95a0fa8aa4bd45d2a62778c6d32490bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:45:21.281827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-93a6f658-20a3-420a-9228-102f0176ba68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:21.282450 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-93a6f658-20a3-420a-9228-102f0176ba68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:21.283936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1253/2476] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:45:21 2022] DELETE /identity/v3/projects/95a0fa8aa4bd45d2a62778c6d32490bd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:21.289046 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fdc41-351a-45e3-b166-4c428036fb64 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:21.289329 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fdc41-351a-45e3-b166-4c428036fb64 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:21.289600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fdc41-351a-45e3-b166-4c428036fb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:21.347893 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-957fdc41-351a-45e3-b166-4c428036fb64 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:21.349122 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-957fdc41-351a-45e3-b166-4c428036fb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:21.391776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:21.408476 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1224/2477] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:21.416346 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70749656-1357-434c-b257-99aaaff698d6 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:21.416628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70749656-1357-434c-b257-99aaaff698d6 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:21.416902 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70749656-1357-434c-b257-99aaaff698d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:21.438115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-70749656-1357-434c-b257-99aaaff698d6 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:21.439336 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-70749656-1357-434c-b257-99aaaff698d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:21.447236 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1254/2478] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:21.451533 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fdc41-351a-45e3-b166-4c428036fb64 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:21.461103 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fdc41-351a-45e3-b166-4c428036fb64 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:21.466175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4da66e-2d63-422f-907b-834ff8ed1b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:21.466764 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4da66e-2d63-422f-907b-834ff8ed1b37 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:21.467070 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4da66e-2d63-422f-907b-834ff8ed1b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:21.467338 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4da66e-2d63-422f-907b-834ff8ed1b37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:21.467998 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4da66e-2d63-422f-907b-834ff8ed1b37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:45:21.468294 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4da66e-2d63-422f-907b-834ff8ed1b37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:21.469853 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4da66e-2d63-422f-907b-834ff8ed1b37 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:21.481730 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1225/2479] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:45:21.485883 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70749656-1357-434c-b257-99aaaff698d6 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:21.494794 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70749656-1357-434c-b257-99aaaff698d6 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:21.500006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631a42e-f18d-43c3-bf22-0bec23884399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:21.500591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631a42e-f18d-43c3-bf22-0bec23884399 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:21.500867 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631a42e-f18d-43c3-bf22-0bec23884399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:21.501136 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631a42e-f18d-43c3-bf22-0bec23884399 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:21.501755 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631a42e-f18d-43c3-bf22-0bec23884399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:21.503661 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631a42e-f18d-43c3-bf22-0bec23884399 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:21.531561 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1255/2480] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:45:21 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:45:21.535687 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4da66e-2d63-422f-907b-834ff8ed1b37 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:21.545874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4da66e-2d63-422f-907b-834ff8ed1b37 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:21.601678 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89261508-3d95-484a-955d-0e1b2c15a3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:21.602289 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89261508-3d95-484a-955d-0e1b2c15a3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:21.602570 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89261508-3d95-484a-955d-0e1b2c15a3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:21.602848 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89261508-3d95-484a-955d-0e1b2c15a3f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:21.603520 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89261508-3d95-484a-955d-0e1b2c15a3f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:21.605475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89261508-3d95-484a-955d-0e1b2c15a3f0 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:21.628564 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1226/2481] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:45:21 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:45:21.631093 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631a42e-f18d-43c3-bf22-0bec23884399 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:21.641745 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631a42e-f18d-43c3-bf22-0bec23884399 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:21.647404 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdd038-00a5-49c7-9ea1-6625bf9dd1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:21.647994 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdd038-00a5-49c7-9ea1-6625bf9dd1ba admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:21.648266 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdd038-00a5-49c7-9ea1-6625bf9dd1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:21.648535 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdd038-00a5-49c7-9ea1-6625bf9dd1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:21.649168 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdd038-00a5-49c7-9ea1-6625bf9dd1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:21.650739 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdd038-00a5-49c7-9ea1-6625bf9dd1ba admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:21.661351 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1256/2482] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:45:21.665285 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89261508-3d95-484a-955d-0e1b2c15a3f0 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:21.675082 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89261508-3d95-484a-955d-0e1b2c15a3f0 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:21.679840 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad0a17-aad8-4c02-ac49-0533eb8aa587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:21.680451 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad0a17-aad8-4c02-ac49-0533eb8aa587 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:21.680729 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad0a17-aad8-4c02-ac49-0533eb8aa587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:21.680999 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad0a17-aad8-4c02-ac49-0533eb8aa587 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:21.681635 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad0a17-aad8-4c02-ac49-0533eb8aa587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:21.683247 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad0a17-aad8-4c02-ac49-0533eb8aa587 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:21.694076 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1227/2483] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:45:21.697976 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdd038-00a5-49c7-9ea1-6625bf9dd1ba admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:21.708299 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdd038-00a5-49c7-9ea1-6625bf9dd1ba admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:21.712936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383c47e-eda6-44fd-a751-9d5179859896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:21.713570 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383c47e-eda6-44fd-a751-9d5179859896 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:21.713845 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383c47e-eda6-44fd-a751-9d5179859896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:21.714116 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383c47e-eda6-44fd-a751-9d5179859896 admin admin] PATH_INFO: `/v3/projects/8c39332d9c2b4c46a972c86c8399e2c0/users/302cc3c3abf649a2948315872bb4d871/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:21.728452 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383c47e-eda6-44fd-a751-9d5179859896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c39332d9c2b4c46a972c86c8399e2c0, user_id=302cc3c3abf649a2948315872bb4d871, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:21.731635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383c47e-eda6-44fd-a751-9d5179859896 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:21.744441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1257/2484] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:45:21 2022] PUT /identity/v3/projects/8c39332d9c2b4c46a972c86c8399e2c0/users/302cc3c3abf649a2948315872bb4d871/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:45:21.755518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba926e-250a-4fe7-a84b-4f15d6651418 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:21.755802 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba926e-250a-4fe7-a84b-4f15d6651418 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:21.756073 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba926e-250a-4fe7-a84b-4f15d6651418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:21.783195 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-4bba926e-250a-4fe7-a84b-4f15d6651418 None None] MFA Rules not processed for user `302cc3c3abf649a2948315872bb4d871`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:21.784321 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-4bba926e-250a-4fe7-a84b-4f15d6651418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:21.847451 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1228/2485] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:21.851897 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383c47e-eda6-44fd-a751-9d5179859896 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:21.882307 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:21.916452 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383c47e-eda6-44fd-a751-9d5179859896 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:21.922098 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e248c-dfcf-4852-a7e7-d10e40141b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:21.922696 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e248c-dfcf-4852-a7e7-d10e40141b78 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:21.923002 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e248c-dfcf-4852-a7e7-d10e40141b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:21.923277 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e248c-dfcf-4852-a7e7-d10e40141b78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:21.923908 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e248c-dfcf-4852-a7e7-d10e40141b78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:21.925786 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e248c-dfcf-4852-a7e7-d10e40141b78 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:21.954119 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1258/2486] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:45:21 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:45:21.958007 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba926e-250a-4fe7-a84b-4f15d6651418 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:21.968943 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba926e-250a-4fe7-a84b-4f15d6651418 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:22.009123 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:22.024099 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b552cca-4979-4389-b131-43855c6e75d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:22.024700 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552cca-4979-4389-b131-43855c6e75d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:22.024978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552cca-4979-4389-b131-43855c6e75d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:22.025249 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b552cca-4979-4389-b131-43855c6e75d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:22.025877 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b552cca-4979-4389-b131-43855c6e75d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:22.027915 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b552cca-4979-4389-b131-43855c6e75d4 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:22.049021 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1229/2487] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:45:21 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:45:22.052867 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e248c-dfcf-4852-a7e7-d10e40141b78 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:22.064273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e248c-dfcf-4852-a7e7-d10e40141b78 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:22.068896 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30454a-e40f-43ca-8cad-033cc657b33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:22.069491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30454a-e40f-43ca-8cad-033cc657b33b admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:22.069774 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30454a-e40f-43ca-8cad-033cc657b33b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:22.070052 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30454a-e40f-43ca-8cad-033cc657b33b admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:22.070694 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30454a-e40f-43ca-8cad-033cc657b33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:22.072319 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30454a-e40f-43ca-8cad-033cc657b33b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:22.082693 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1259/2488] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:45:22.086779 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b552cca-4979-4389-b131-43855c6e75d4 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:22.097108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b552cca-4979-4389-b131-43855c6e75d4 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:22.101707 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346317e-799e-4e0a-b1ee-ea57b67484bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:22.102349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346317e-799e-4e0a-b1ee-ea57b67484bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:22.102628 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346317e-799e-4e0a-b1ee-ea57b67484bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:22.102902 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346317e-799e-4e0a-b1ee-ea57b67484bf admin admin] PATH_INFO: `/v3/projects/1e1a9d4f9ec64191a1e9fb65325a11e0/users/bf7e2dd29ce44bc895e389881e12cce9/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:22.117595 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346317e-799e-4e0a-b1ee-ea57b67484bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1a9d4f9ec64191a1e9fb65325a11e0, user_id=bf7e2dd29ce44bc895e389881e12cce9, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:22.120233 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346317e-799e-4e0a-b1ee-ea57b67484bf admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:22.133575 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1230/2489] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:45:22 2022] PUT /identity/v3/projects/1e1a9d4f9ec64191a1e9fb65325a11e0/users/bf7e2dd29ce44bc895e389881e12cce9/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:22.138362 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30454a-e40f-43ca-8cad-033cc657b33b admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:22.148279 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30454a-e40f-43ca-8cad-033cc657b33b admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:22.204244 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27555df-9029-4eaf-8fe7-1a6ee2ae5a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:22.204877 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27555df-9029-4eaf-8fe7-1a6ee2ae5a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:22.205154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27555df-9029-4eaf-8fe7-1a6ee2ae5a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:22.205422 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27555df-9029-4eaf-8fe7-1a6ee2ae5a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:22.206051 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27555df-9029-4eaf-8fe7-1a6ee2ae5a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:22.207653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27555df-9029-4eaf-8fe7-1a6ee2ae5a91 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:22.217770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1260/2490] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:45:22.222028 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346317e-799e-4e0a-b1ee-ea57b67484bf admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:22.232341 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346317e-799e-4e0a-b1ee-ea57b67484bf admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:22.236857 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6e803-fd00-43f1-b226-5a931ffa1309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:22.237498 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6e803-fd00-43f1-b226-5a931ffa1309 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:22.237776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6e803-fd00-43f1-b226-5a931ffa1309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:22.238048 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6e803-fd00-43f1-b226-5a931ffa1309 admin admin] PATH_INFO: `/v3/projects/1e1a9d4f9ec64191a1e9fb65325a11e0/users/bf7e2dd29ce44bc895e389881e12cce9/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:22.239952 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6e803-fd00-43f1-b226-5a931ffa1309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1a9d4f9ec64191a1e9fb65325a11e0, user_id=bf7e2dd29ce44bc895e389881e12cce9, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:22.242543 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6e803-fd00-43f1-b226-5a931ffa1309 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:22.256659 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1231/2491] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:45:22 2022] PUT /identity/v3/projects/1e1a9d4f9ec64191a1e9fb65325a11e0/users/bf7e2dd29ce44bc895e389881e12cce9/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:22.269337 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83828c-cddd-4ed3-9317-ad71f9e925de None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:22.269617 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83828c-cddd-4ed3-9317-ad71f9e925de None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:22.269889 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83828c-cddd-4ed3-9317-ad71f9e925de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:22.297267 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-dc83828c-cddd-4ed3-9317-ad71f9e925de None None] MFA Rules not processed for user `bf7e2dd29ce44bc895e389881e12cce9`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:22.298469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-dc83828c-cddd-4ed3-9317-ad71f9e925de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:22.365022 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1261/2492] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:22.376970 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6e803-fd00-43f1-b226-5a931ffa1309 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:22.378665 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-cbc6e803-fd00-43f1-b226-5a931ffa1309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:22.457792 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6e803-fd00-43f1-b226-5a931ffa1309 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:22.462717 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3c719-1967-4025-ade0-6a47a9132afb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:22.463363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3c719-1967-4025-ade0-6a47a9132afb service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:22.463640 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3c719-1967-4025-ade0-6a47a9132afb service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:22.463908 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3c719-1967-4025-ade0-6a47a9132afb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:22.474900 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3c719-1967-4025-ade0-6a47a9132afb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:22.476368 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3c719-1967-4025-ade0-6a47a9132afb service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:22.486460 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1232/2493] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:45:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:45:22.897880 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83828c-cddd-4ed3-9317-ad71f9e925de None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:22.923368 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:22.961868 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83828c-cddd-4ed3-9317-ad71f9e925de None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:22.966865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf93a0-6c44-42a8-a3c8-d446f2b2fabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:22.967523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf93a0-6c44-42a8-a3c8-d446f2b2fabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:22.967803 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf93a0-6c44-42a8-a3c8-d446f2b2fabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:22.968080 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf93a0-6c44-42a8-a3c8-d446f2b2fabe admin admin] PATH_INFO: `/v3/users/302cc3c3abf649a2948315872bb4d871` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:22.969203 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf93a0-6c44-42a8-a3c8-d446f2b2fabe admin admin] RBAC: Authorizing `identity:delete_user(user_id=302cc3c3abf649a2948315872bb4d871)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:22.971160 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf93a0-6c44-42a8-a3c8-d446f2b2fabe admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:23.016323 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6abf93a0-6c44-42a8-a3c8-d446f2b2fabe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302cc3c3abf649a2948315872bb4d871'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:23.016987 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6abf93a0-6c44-42a8-a3c8-d446f2b2fabe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302cc3c3abf649a2948315872bb4d871'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:23.023714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6abf93a0-6c44-42a8-a3c8-d446f2b2fabe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302cc3c3abf649a2948315872bb4d871'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:23.035324 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6abf93a0-6c44-42a8-a3c8-d446f2b2fabe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302cc3c3abf649a2948315872bb4d871'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:23.035964 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-6abf93a0-6c44-42a8-a3c8-d446f2b2fabe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302cc3c3abf649a2948315872bb4d871'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:23.048508 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1262/2494] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:45:22 2022] DELETE /identity/v3/users/302cc3c3abf649a2948315872bb4d871 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:23.052917 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64774b-2f06-4143-bb34-7002c54764e7 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:23.053382 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64774b-2f06-4143-bb34-7002c54764e7 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:23.053489 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64774b-2f06-4143-bb34-7002c54764e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:23.072778 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-7b64774b-2f06-4143-bb34-7002c54764e7 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:23.073962 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7b64774b-2f06-4143-bb34-7002c54764e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:23.131809 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1233/2495] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:23.141544 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf93a0-6c44-42a8-a3c8-d446f2b2fabe admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:23.142900 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-6abf93a0-6c44-42a8-a3c8-d446f2b2fabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:23.220442 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf93a0-6c44-42a8-a3c8-d446f2b2fabe admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:23.224117 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0eb3ae-b01c-4a21-ac98-4eeed98899be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:23.224714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0eb3ae-b01c-4a21-ac98-4eeed98899be service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:23.224998 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0eb3ae-b01c-4a21-ac98-4eeed98899be service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:23.225271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0eb3ae-b01c-4a21-ac98-4eeed98899be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:23.234678 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0eb3ae-b01c-4a21-ac98-4eeed98899be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:23.236133 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0eb3ae-b01c-4a21-ac98-4eeed98899be service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:23.245342 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1263/2496] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:45:23.506261 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64774b-2f06-4143-bb34-7002c54764e7 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:23.507702 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-7b64774b-2f06-4143-bb34-7002c54764e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:23.520600 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64774b-2f06-4143-bb34-7002c54764e7 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:23.525778 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:23.526472 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:23.526751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:23.527055 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430 admin admin] PATH_INFO: `/v3/projects/8c39332d9c2b4c46a972c86c8399e2c0` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:23.528826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c39332d9c2b4c46a972c86c8399e2c0)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:23.530720 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:23.546925 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:23.580486 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c39332d9c2b4c46a972c86c8399e2c0', 'request_id': 'req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:23.586690 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c39332d9c2b4c46a972c86c8399e2c0', 'request_id': 'req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:23.593119 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c39332d9c2b4c46a972c86c8399e2c0', 'request_id': 'req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:23.605253 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430 admin admin] The token cache is being invalidate because project 8c39332d9c2b4c46a972c86c8399e2c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:45:23.605536 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:23.606301 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:23.607825 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1234/2497] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:45:23 2022] DELETE /identity/v3/projects/8c39332d9c2b4c46a972c86c8399e2c0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:45:23.611844 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0eb3ae-b01c-4a21-ac98-4eeed98899be service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:23.621743 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0eb3ae-b01c-4a21-ac98-4eeed98899be service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:23.641586 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:23.679844 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4e917-db51-4b7c-bc31-c59d836cfcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:23.680388 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e917-db51-4b7c-bc31-c59d836cfcd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:23.680692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e917-db51-4b7c-bc31-c59d836cfcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:23.680959 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4e917-db51-4b7c-bc31-c59d836cfcd0 admin admin] PATH_INFO: `/v3/users/bf7e2dd29ce44bc895e389881e12cce9` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:23.682063 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4e917-db51-4b7c-bc31-c59d836cfcd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7e2dd29ce44bc895e389881e12cce9)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:23.684621 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4e917-db51-4b7c-bc31-c59d836cfcd0 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:23.731587 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-83e4e917-db51-4b7c-bc31-c59d836cfcd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7e2dd29ce44bc895e389881e12cce9'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:23.732227 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-83e4e917-db51-4b7c-bc31-c59d836cfcd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7e2dd29ce44bc895e389881e12cce9'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:23.739304 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-83e4e917-db51-4b7c-bc31-c59d836cfcd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7e2dd29ce44bc895e389881e12cce9'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:23.751632 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-83e4e917-db51-4b7c-bc31-c59d836cfcd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7e2dd29ce44bc895e389881e12cce9'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:23.752271 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-83e4e917-db51-4b7c-bc31-c59d836cfcd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7e2dd29ce44bc895e389881e12cce9'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:23.764563 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1264/2498] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:45:23 2022] DELETE /identity/v3/users/bf7e2dd29ce44bc895e389881e12cce9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:24.036911 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:24.038365 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:24.052873 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9c2ea-2609-4a64-b69e-d9abe4ee5430 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:24.111529 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59bd389-47ba-48b5-a9ec-62d3d2649e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:24.112158 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bd389-47ba-48b5-a9ec-62d3d2649e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:24.112431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bd389-47ba-48b5-a9ec-62d3d2649e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:24.112703 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59bd389-47ba-48b5-a9ec-62d3d2649e35 admin admin] PATH_INFO: `/v3/projects/1e1a9d4f9ec64191a1e9fb65325a11e0` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:24.113805 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59bd389-47ba-48b5-a9ec-62d3d2649e35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1a9d4f9ec64191a1e9fb65325a11e0)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:24.115808 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59bd389-47ba-48b5-a9ec-62d3d2649e35 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:24.163577 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a59bd389-47ba-48b5-a9ec-62d3d2649e35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1a9d4f9ec64191a1e9fb65325a11e0', 'request_id': 'req-a59bd389-47ba-48b5-a9ec-62d3d2649e35'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:24.169714 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a59bd389-47ba-48b5-a9ec-62d3d2649e35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1a9d4f9ec64191a1e9fb65325a11e0', 'request_id': 'req-a59bd389-47ba-48b5-a9ec-62d3d2649e35'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:24.175319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a59bd389-47ba-48b5-a9ec-62d3d2649e35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1a9d4f9ec64191a1e9fb65325a11e0', 'request_id': 'req-a59bd389-47ba-48b5-a9ec-62d3d2649e35'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:24.187401 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a59bd389-47ba-48b5-a9ec-62d3d2649e35 admin admin] The token cache is being invalidate because project 1e1a9d4f9ec64191a1e9fb65325a11e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:45:24.187685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a59bd389-47ba-48b5-a9ec-62d3d2649e35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:24.188303 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a59bd389-47ba-48b5-a9ec-62d3d2649e35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:24.189747 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1235/2499] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:45:24 2022] DELETE /identity/v3/projects/1e1a9d4f9ec64191a1e9fb65325a11e0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:24.194599 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b5bb0-cc1b-490c-9c13-bea8f4be774c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:24.195085 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b5bb0-cc1b-490c-9c13-bea8f4be774c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:24.195180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b5bb0-cc1b-490c-9c13-bea8f4be774c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:24.215723 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-f31b5bb0-cc1b-490c-9c13-bea8f4be774c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:24.216990 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-f31b5bb0-cc1b-490c-9c13-bea8f4be774c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:24.276126 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1265/2500] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:24.286222 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c5590-cba1-4928-b543-b3a4d17ed067 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:24.286504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c5590-cba1-4928-b543-b3a4d17ed067 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:24.286772 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c5590-cba1-4928-b543-b3a4d17ed067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:24.306632 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-797c5590-cba1-4928-b543-b3a4d17ed067 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:24.307874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-797c5590-cba1-4928-b543-b3a4d17ed067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:24.315776 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1236/2501] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:24.319922 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b5bb0-cc1b-490c-9c13-bea8f4be774c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:24.330345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b5bb0-cc1b-490c-9c13-bea8f4be774c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:24.334974 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7573551-1e68-43bc-9346-01d9a85994d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:24.335573 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7573551-1e68-43bc-9346-01d9a85994d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:24.335851 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7573551-1e68-43bc-9346-01d9a85994d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:24.336120 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7573551-1e68-43bc-9346-01d9a85994d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:24.336749 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7573551-1e68-43bc-9346-01d9a85994d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81427) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:45:24.337049 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7573551-1e68-43bc-9346-01d9a85994d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:24.338619 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7573551-1e68-43bc-9346-01d9a85994d2 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:24.350714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1266/2502] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:45:24.354775 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c5590-cba1-4928-b543-b3a4d17ed067 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:24.364522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797c5590-cba1-4928-b543-b3a4d17ed067 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:24.369104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c68b6-2c6f-4b84-876c-9727b856e472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:24.369693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c68b6-2c6f-4b84-876c-9727b856e472 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:24.369970 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c68b6-2c6f-4b84-876c-9727b856e472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:24.370236 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c68b6-2c6f-4b84-876c-9727b856e472 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:24.370856 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c68b6-2c6f-4b84-876c-9727b856e472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:24.373306 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c68b6-2c6f-4b84-876c-9727b856e472 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:24.400404 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1237/2503] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:45:24 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:45:24.404547 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7573551-1e68-43bc-9346-01d9a85994d2 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:24.414334 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7573551-1e68-43bc-9346-01d9a85994d2 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:24.442963 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:24.472550 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b2af6-481c-4c5a-9dc3-0fb69496ad75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:24.473079 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b2af6-481c-4c5a-9dc3-0fb69496ad75 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:24.473361 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b2af6-481c-4c5a-9dc3-0fb69496ad75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:24.473628 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b2af6-481c-4c5a-9dc3-0fb69496ad75 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:24.474274 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b2af6-481c-4c5a-9dc3-0fb69496ad75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:24.476192 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b2af6-481c-4c5a-9dc3-0fb69496ad75 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:24.496155 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1267/2504] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:45:24 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:45:24.500995 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c68b6-2c6f-4b84-876c-9727b856e472 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:24.507564 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:24.511389 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c68b6-2c6f-4b84-876c-9727b856e472 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:24.518317 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1572e85-850c-42b1-acfb-9bc64fe9d77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:24.519128 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1572e85-850c-42b1-acfb-9bc64fe9d77a admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:24.519601 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1572e85-850c-42b1-acfb-9bc64fe9d77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:24.519930 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1572e85-850c-42b1-acfb-9bc64fe9d77a admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:24.520704 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1572e85-850c-42b1-acfb-9bc64fe9d77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:24.522503 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1572e85-850c-42b1-acfb-9bc64fe9d77a admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:24.532545 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1238/2505] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:45:24.536518 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b2af6-481c-4c5a-9dc3-0fb69496ad75 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:24.546235 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b2af6-481c-4c5a-9dc3-0fb69496ad75 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:24.550846 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c804e-daaf-4a7d-98ad-c26fd5827bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:24.551465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c804e-daaf-4a7d-98ad-c26fd5827bbb admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:24.551743 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c804e-daaf-4a7d-98ad-c26fd5827bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:24.552016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c804e-daaf-4a7d-98ad-c26fd5827bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:24.552648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c804e-daaf-4a7d-98ad-c26fd5827bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:24.554225 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c804e-daaf-4a7d-98ad-c26fd5827bbb admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:24.564698 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1268/2506] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:45:24.568848 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1572e85-850c-42b1-acfb-9bc64fe9d77a admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:24.579894 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1572e85-850c-42b1-acfb-9bc64fe9d77a admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:24.584432 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2f491-4bea-42bf-b851-595f4e991d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:24.585101 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2f491-4bea-42bf-b851-595f4e991d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:24.585380 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2f491-4bea-42bf-b851-595f4e991d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:24.585652 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2f491-4bea-42bf-b851-595f4e991d5e admin admin] PATH_INFO: `/v3/projects/fa34dcc2a985407daa06637a9c0f1bed/users/f901f2e150594fda8f24ad710c35ade4/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:24.600295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2f491-4bea-42bf-b851-595f4e991d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa34dcc2a985407daa06637a9c0f1bed, user_id=f901f2e150594fda8f24ad710c35ade4, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:24.602927 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2f491-4bea-42bf-b851-595f4e991d5e admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:24.615854 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1239/2507] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:45:24 2022] PUT /identity/v3/projects/fa34dcc2a985407daa06637a9c0f1bed/users/f901f2e150594fda8f24ad710c35ade4/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:24.626576 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095f0d0-c4e6-4c0b-8ad2-bde4bcec3b5a None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:24.626865 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095f0d0-c4e6-4c0b-8ad2-bde4bcec3b5a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:24.627185 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095f0d0-c4e6-4c0b-8ad2-bde4bcec3b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:24.656232 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-1095f0d0-c4e6-4c0b-8ad2-bde4bcec3b5a None None] MFA Rules not processed for user `f901f2e150594fda8f24ad710c35ade4`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:24.657472 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1095f0d0-c4e6-4c0b-8ad2-bde4bcec3b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:24.723685 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1269/2508] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:24.728118 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2f491-4bea-42bf-b851-595f4e991d5e admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:24.790315 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2f491-4bea-42bf-b851-595f4e991d5e admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:24.795623 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4c0e4-8f3c-488b-87aa-117b5a0d9f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:24.796221 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4c0e4-8f3c-488b-87aa-117b5a0d9f53 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:24.796496 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4c0e4-8f3c-488b-87aa-117b5a0d9f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:24.796764 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4c0e4-8f3c-488b-87aa-117b5a0d9f53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:24.797382 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4c0e4-8f3c-488b-87aa-117b5a0d9f53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:24.799295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4c0e4-8f3c-488b-87aa-117b5a0d9f53 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:24.825550 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1240/2509] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:45:24 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:45:24.829706 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095f0d0-c4e6-4c0b-8ad2-bde4bcec3b5a None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:24.840499 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095f0d0-c4e6-4c0b-8ad2-bde4bcec3b5a None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:24.900231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b7f7c-8d29-4b34-946f-aa8a03668626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:24.900840 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b7f7c-8d29-4b34-946f-aa8a03668626 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:24.901118 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b7f7c-8d29-4b34-946f-aa8a03668626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:24.901390 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b7f7c-8d29-4b34-946f-aa8a03668626 admin admin] PATH_INFO: `/v3/users` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:24.902030 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b7f7c-8d29-4b34-946f-aa8a03668626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:24.904458 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b7f7c-8d29-4b34-946f-aa8a03668626 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:24.925528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1270/2510] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:45:24 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:45:24.929778 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4c0e4-8f3c-488b-87aa-117b5a0d9f53 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:24.940691 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4c0e4-8f3c-488b-87aa-117b5a0d9f53 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:24.945475 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c1edb-0640-4d8b-91e2-020ff3b62a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:24.946074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c1edb-0640-4d8b-91e2-020ff3b62a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:24.946356 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c1edb-0640-4d8b-91e2-020ff3b62a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:24.946631 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c1edb-0640-4d8b-91e2-020ff3b62a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:24.947313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c1edb-0640-4d8b-91e2-020ff3b62a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:24.948900 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c1edb-0640-4d8b-91e2-020ff3b62a24 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:24.959468 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1241/2511] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:45:24.963465 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b7f7c-8d29-4b34-946f-aa8a03668626 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:24.973359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b7f7c-8d29-4b34-946f-aa8a03668626 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:24.978032 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a71468-3214-41ec-8a18-206fe1c8075a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:24.978619 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a71468-3214-41ec-8a18-206fe1c8075a admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:24.978899 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a71468-3214-41ec-8a18-206fe1c8075a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:24.979277 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a71468-3214-41ec-8a18-206fe1c8075a admin admin] PATH_INFO: `/v3/projects/9b83ffbf8f4f437394a7d5a1c454916a/users/ef091641144746e7b29058fc10696143/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:24.994511 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a71468-3214-41ec-8a18-206fe1c8075a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b83ffbf8f4f437394a7d5a1c454916a, user_id=ef091641144746e7b29058fc10696143, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:24.997822 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a71468-3214-41ec-8a18-206fe1c8075a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:25.010468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1271/2512] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:45:24 2022] PUT /identity/v3/projects/9b83ffbf8f4f437394a7d5a1c454916a/users/ef091641144746e7b29058fc10696143/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:25.014383 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c1edb-0640-4d8b-91e2-020ff3b62a24 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:25.024208 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c1edb-0640-4d8b-91e2-020ff3b62a24 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:25.080983 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c245a-d387-4822-b5d2-eb9dbc1821cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:25.081592 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c245a-d387-4822-b5d2-eb9dbc1821cc admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:25.081909 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c245a-d387-4822-b5d2-eb9dbc1821cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:25.082187 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c245a-d387-4822-b5d2-eb9dbc1821cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:25.082829 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c245a-d387-4822-b5d2-eb9dbc1821cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:25.084492 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c245a-d387-4822-b5d2-eb9dbc1821cc admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:25.094670 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1242/2513] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:45:25.098759 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a71468-3214-41ec-8a18-206fe1c8075a admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:25.105318 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:25.110200 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a71468-3214-41ec-8a18-206fe1c8075a admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:25.115895 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd89e56-2231-417c-a337-56851bcb1ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:25.117265 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89e56-2231-417c-a337-56851bcb1ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:25.117549 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89e56-2231-417c-a337-56851bcb1ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:25.117851 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd89e56-2231-417c-a337-56851bcb1ba8 admin admin] PATH_INFO: `/v3/projects/9b83ffbf8f4f437394a7d5a1c454916a/users/ef091641144746e7b29058fc10696143/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:25.119836 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd89e56-2231-417c-a337-56851bcb1ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b83ffbf8f4f437394a7d5a1c454916a, user_id=ef091641144746e7b29058fc10696143, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:25.123988 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd89e56-2231-417c-a337-56851bcb1ba8 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:25.134127 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1272/2514] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:45:25 2022] PUT /identity/v3/projects/9b83ffbf8f4f437394a7d5a1c454916a/users/ef091641144746e7b29058fc10696143/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:25.145688 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787715f3-c53f-406e-9a87-21955d3c318c None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:25.146215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787715f3-c53f-406e-9a87-21955d3c318c None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:25.146215 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787715f3-c53f-406e-9a87-21955d3c318c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:25.175089 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-787715f3-c53f-406e-9a87-21955d3c318c None None] MFA Rules not processed for user `ef091641144746e7b29058fc10696143`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:25.176294 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-787715f3-c53f-406e-9a87-21955d3c318c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:25.204678 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:25.244394 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1243/2515] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:25 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:25.255112 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd89e56-2231-417c-a337-56851bcb1ba8 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:25.256863 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-1fd89e56-2231-417c-a337-56851bcb1ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:25.318769 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd89e56-2231-417c-a337-56851bcb1ba8 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:25.322456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cceeae-13ad-417e-a787-7597b9a39106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:25.323199 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cceeae-13ad-417e-a787-7597b9a39106 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:25.323482 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cceeae-13ad-417e-a787-7597b9a39106 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:25.323760 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cceeae-13ad-417e-a787-7597b9a39106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:25.333016 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cceeae-13ad-417e-a787-7597b9a39106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:25.334456 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cceeae-13ad-417e-a787-7597b9a39106 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:25.344328 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1273/2516] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:45:25 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:45:25.890750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787715f3-c53f-406e-9a87-21955d3c318c None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:25.956717 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787715f3-c53f-406e-9a87-21955d3c318c None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:25.961378 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b4c6f-db1b-434e-8966-6c6733218eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:25.962001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4c6f-db1b-434e-8966-6c6733218eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:25.962274 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4c6f-db1b-434e-8966-6c6733218eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:25.962542 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b4c6f-db1b-434e-8966-6c6733218eff admin admin] PATH_INFO: `/v3/users/f901f2e150594fda8f24ad710c35ade4` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:25.963670 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b4c6f-db1b-434e-8966-6c6733218eff admin admin] RBAC: Authorizing `identity:delete_user(user_id=f901f2e150594fda8f24ad710c35ade4)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:25.965773 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b4c6f-db1b-434e-8966-6c6733218eff admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:26.011874 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-2a0b4c6f-db1b-434e-8966-6c6733218eff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f901f2e150594fda8f24ad710c35ade4'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:26.012518 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-2a0b4c6f-db1b-434e-8966-6c6733218eff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f901f2e150594fda8f24ad710c35ade4'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:26.019790 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-2a0b4c6f-db1b-434e-8966-6c6733218eff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f901f2e150594fda8f24ad710c35ade4'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:26.032326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-2a0b4c6f-db1b-434e-8966-6c6733218eff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f901f2e150594fda8f24ad710c35ade4'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:26.032990 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-2a0b4c6f-db1b-434e-8966-6c6733218eff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f901f2e150594fda8f24ad710c35ade4'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:26.047111 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1244/2517] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:45:25 2022] DELETE /identity/v3/users/f901f2e150594fda8f24ad710c35ade4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:26.051705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c9542-3010-4f52-b538-06618f2fb195 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:26.052021 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c9542-3010-4f52-b538-06618f2fb195 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:26.052303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c9542-3010-4f52-b538-06618f2fb195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:26.071830 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-0a8c9542-3010-4f52-b538-06618f2fb195 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:26.073034 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0a8c9542-3010-4f52-b538-06618f2fb195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:26.131817 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1274/2518] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:26.141655 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b4c6f-db1b-434e-8966-6c6733218eff admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:26.143078 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-2a0b4c6f-db1b-434e-8966-6c6733218eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:26.189249 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:26.201140 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b4c6f-db1b-434e-8966-6c6733218eff admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:26.204994 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cae1d-0c5e-4dae-bff4-175428004c0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:26.205590 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cae1d-0c5e-4dae-bff4-175428004c0e service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:26.205866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cae1d-0c5e-4dae-bff4-175428004c0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:26.206133 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cae1d-0c5e-4dae-bff4-175428004c0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:26.214930 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cae1d-0c5e-4dae-bff4-175428004c0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:26.216364 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cae1d-0c5e-4dae-bff4-175428004c0e service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:26.225619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1245/2519] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:45:26.493949 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c9542-3010-4f52-b538-06618f2fb195 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:26.495459 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-0a8c9542-3010-4f52-b538-06618f2fb195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:26.507962 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c9542-3010-4f52-b538-06618f2fb195 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:26.513153 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95c399-aa3f-4e28-96e4-4f68245c93dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:26.514463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95c399-aa3f-4e28-96e4-4f68245c93dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:26.514749 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95c399-aa3f-4e28-96e4-4f68245c93dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:26.515282 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95c399-aa3f-4e28-96e4-4f68245c93dc admin admin] PATH_INFO: `/v3/projects/fa34dcc2a985407daa06637a9c0f1bed` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:26.516417 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95c399-aa3f-4e28-96e4-4f68245c93dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa34dcc2a985407daa06637a9c0f1bed)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:26.518367 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95c399-aa3f-4e28-96e4-4f68245c93dc admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:26.566237 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-4a95c399-aa3f-4e28-96e4-4f68245c93dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa34dcc2a985407daa06637a9c0f1bed', 'request_id': 'req-4a95c399-aa3f-4e28-96e4-4f68245c93dc'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:26.572722 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-4a95c399-aa3f-4e28-96e4-4f68245c93dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa34dcc2a985407daa06637a9c0f1bed', 'request_id': 'req-4a95c399-aa3f-4e28-96e4-4f68245c93dc'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:26.580090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-4a95c399-aa3f-4e28-96e4-4f68245c93dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa34dcc2a985407daa06637a9c0f1bed', 'request_id': 'req-4a95c399-aa3f-4e28-96e4-4f68245c93dc'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:26.590938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-4a95c399-aa3f-4e28-96e4-4f68245c93dc admin admin] The token cache is being invalidate because project fa34dcc2a985407daa06637a9c0f1bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:45:26.591248 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-4a95c399-aa3f-4e28-96e4-4f68245c93dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:26.591890 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-4a95c399-aa3f-4e28-96e4-4f68245c93dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:26.593383 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1275/2520] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:45:26 2022] DELETE /identity/v3/projects/fa34dcc2a985407daa06637a9c0f1bed => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:26.597363 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cae1d-0c5e-4dae-bff4-175428004c0e service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:26.606862 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cae1d-0c5e-4dae-bff4-175428004c0e service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:26.663166 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a8404-29c1-45b2-ab20-c931a6bda997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:26.663796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8404-29c1-45b2-ab20-c931a6bda997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:26.664076 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8404-29c1-45b2-ab20-c931a6bda997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:26.664348 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8404-29c1-45b2-ab20-c931a6bda997 admin admin] PATH_INFO: `/v3/users/ef091641144746e7b29058fc10696143` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:26.665584 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a8404-29c1-45b2-ab20-c931a6bda997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef091641144746e7b29058fc10696143)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:26.667609 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a8404-29c1-45b2-ab20-c931a6bda997 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:26.714085 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a35a8404-29c1-45b2-ab20-c931a6bda997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef091641144746e7b29058fc10696143'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:26.714744 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a35a8404-29c1-45b2-ab20-c931a6bda997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef091641144746e7b29058fc10696143'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:26.721748 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a35a8404-29c1-45b2-ab20-c931a6bda997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef091641144746e7b29058fc10696143'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:26.733728 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a35a8404-29c1-45b2-ab20-c931a6bda997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef091641144746e7b29058fc10696143'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:26.734372 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-a35a8404-29c1-45b2-ab20-c931a6bda997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef091641144746e7b29058fc10696143'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:26.748387 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1246/2521] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:45:26 2022] DELETE /identity/v3/users/ef091641144746e7b29058fc10696143 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:27.021152 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95c399-aa3f-4e28-96e4-4f68245c93dc admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:27.022590 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-4a95c399-aa3f-4e28-96e4-4f68245c93dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:27.036552 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95c399-aa3f-4e28-96e4-4f68245c93dc admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:27.049501 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:27.096439 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066770c-0c7d-42e1-9c3f-a7e13d0c6c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:27.097074 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066770c-0c7d-42e1-9c3f-a7e13d0c6c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:27.097354 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066770c-0c7d-42e1-9c3f-a7e13d0c6c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:27.097627 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066770c-0c7d-42e1-9c3f-a7e13d0c6c84 admin admin] PATH_INFO: `/v3/projects/9b83ffbf8f4f437394a7d5a1c454916a` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:27.098786 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066770c-0c7d-42e1-9c3f-a7e13d0c6c84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b83ffbf8f4f437394a7d5a1c454916a)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:27.100665 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066770c-0c7d-42e1-9c3f-a7e13d0c6c84 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:27.145338 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-9066770c-0c7d-42e1-9c3f-a7e13d0c6c84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b83ffbf8f4f437394a7d5a1c454916a', 'request_id': 'req-9066770c-0c7d-42e1-9c3f-a7e13d0c6c84'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:27.152128 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-9066770c-0c7d-42e1-9c3f-a7e13d0c6c84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b83ffbf8f4f437394a7d5a1c454916a', 'request_id': 'req-9066770c-0c7d-42e1-9c3f-a7e13d0c6c84'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:27.159086 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-9066770c-0c7d-42e1-9c3f-a7e13d0c6c84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b83ffbf8f4f437394a7d5a1c454916a', 'request_id': 'req-9066770c-0c7d-42e1-9c3f-a7e13d0c6c84'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:27.170150 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-9066770c-0c7d-42e1-9c3f-a7e13d0c6c84 admin admin] The token cache is being invalidate because project 9b83ffbf8f4f437394a7d5a1c454916a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:45:27.170433 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-9066770c-0c7d-42e1-9c3f-a7e13d0c6c84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:27.171108 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-9066770c-0c7d-42e1-9c3f-a7e13d0c6c84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:27.172636 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1276/2522] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:45:27 2022] DELETE /identity/v3/projects/9b83ffbf8f4f437394a7d5a1c454916a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:27.177393 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb353cb-5ef6-4a0b-bd8b-7b2e5d7c3503 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:27.177681 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb353cb-5ef6-4a0b-bd8b-7b2e5d7c3503 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:27.178235 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb353cb-5ef6-4a0b-bd8b-7b2e5d7c3503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:27.198018 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-2cb353cb-5ef6-4a0b-bd8b-7b2e5d7c3503 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:27.199732 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-2cb353cb-5ef6-4a0b-bd8b-7b2e5d7c3503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:27.258989 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1247/2523] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:27.267303 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e476245-724c-4e37-be8d-f7a1c716d677 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:27.267591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e476245-724c-4e37-be8d-f7a1c716d677 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:27.267964 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e476245-724c-4e37-be8d-f7a1c716d677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:27.289012 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-3e476245-724c-4e37-be8d-f7a1c716d677 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:27.290269 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3e476245-724c-4e37-be8d-f7a1c716d677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:27.298341 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1277/2524] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:27.302555 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb353cb-5ef6-4a0b-bd8b-7b2e5d7c3503 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:27.312477 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb353cb-5ef6-4a0b-bd8b-7b2e5d7c3503 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:27.316978 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2b3a-fb00-45a3-a816-328885c0474d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:27.317571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2b3a-fb00-45a3-a816-328885c0474d admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:27.317847 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2b3a-fb00-45a3-a816-328885c0474d admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:27.318116 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2b3a-fb00-45a3-a816-328885c0474d admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:27.318768 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2b3a-fb00-45a3-a816-328885c0474d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:45:27.319104 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2b3a-fb00-45a3-a816-328885c0474d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:27.320683 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2b3a-fb00-45a3-a816-328885c0474d admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:27.322163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:27.334726 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1248/2525] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:45:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:45:27.338841 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e476245-724c-4e37-be8d-f7a1c716d677 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:27.348676 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e476245-724c-4e37-be8d-f7a1c716d677 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:27.353396 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998359d-dba0-4ad1-8b96-4c4b76ae542d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:27.353931 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998359d-dba0-4ad1-8b96-4c4b76ae542d admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:27.354228 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998359d-dba0-4ad1-8b96-4c4b76ae542d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:27.354502 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998359d-dba0-4ad1-8b96-4c4b76ae542d admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:27.355157 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998359d-dba0-4ad1-8b96-4c4b76ae542d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:27.357089 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998359d-dba0-4ad1-8b96-4c4b76ae542d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:27.386167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1278/2526] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:45:27 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:45:27.391041 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2b3a-fb00-45a3-a816-328885c0474d admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:27.400895 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2b3a-fb00-45a3-a816-328885c0474d admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:27.456077 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca927896-e604-4bf1-888c-37aa5cd1c3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:27.456674 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca927896-e604-4bf1-888c-37aa5cd1c3fe admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:27.456951 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca927896-e604-4bf1-888c-37aa5cd1c3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:27.457252 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca927896-e604-4bf1-888c-37aa5cd1c3fe admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:27.457870 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca927896-e604-4bf1-888c-37aa5cd1c3fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:27.459816 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca927896-e604-4bf1-888c-37aa5cd1c3fe admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:27.480876 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1249/2527] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:45:27 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:45:27.484985 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998359d-dba0-4ad1-8b96-4c4b76ae542d admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:27.495625 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998359d-dba0-4ad1-8b96-4c4b76ae542d admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:27.501200 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd5c00-3c09-4568-8389-e2c5bcc7c99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:27.501797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd5c00-3c09-4568-8389-e2c5bcc7c99b admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:27.502075 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd5c00-3c09-4568-8389-e2c5bcc7c99b admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:27.502345 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd5c00-3c09-4568-8389-e2c5bcc7c99b admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:27.503013 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd5c00-3c09-4568-8389-e2c5bcc7c99b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:27.504600 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bd5c00-3c09-4568-8389-e2c5bcc7c99b admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:27.514828 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1279/2528] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:45:27.518611 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca927896-e604-4bf1-888c-37aa5cd1c3fe admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:27.529107 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca927896-e604-4bf1-888c-37aa5cd1c3fe admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:27.533636 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5207b1a-5227-44d6-a5df-9e3806b310d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:27.534216 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5207b1a-5227-44d6-a5df-9e3806b310d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:27.534492 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5207b1a-5227-44d6-a5df-9e3806b310d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:27.534761 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5207b1a-5227-44d6-a5df-9e3806b310d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:27.535430 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5207b1a-5227-44d6-a5df-9e3806b310d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:27.537002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5207b1a-5227-44d6-a5df-9e3806b310d6 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:27.548094 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1250/2529] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:45:27.552114 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd5c00-3c09-4568-8389-e2c5bcc7c99b admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:27.562405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd5c00-3c09-4568-8389-e2c5bcc7c99b admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:27.567024 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dd1a2-1eb4-401b-8151-a9ff9cd8fc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:27.567677 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dd1a2-1eb4-401b-8151-a9ff9cd8fc47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:27.567955 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dd1a2-1eb4-401b-8151-a9ff9cd8fc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:27.568225 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dd1a2-1eb4-401b-8151-a9ff9cd8fc47 admin admin] PATH_INFO: `/v3/projects/1d3ae5766dd640f69fb8b140b04990a3/users/b08a5f34dfc84d61bbbfa9e1959d9e91/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:27.582668 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1dd1a2-1eb4-401b-8151-a9ff9cd8fc47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3ae5766dd640f69fb8b140b04990a3, user_id=b08a5f34dfc84d61bbbfa9e1959d9e91, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:27.585334 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1dd1a2-1eb4-401b-8151-a9ff9cd8fc47 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:27.598824 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1280/2530] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:45:27 2022] PUT /identity/v3/projects/1d3ae5766dd640f69fb8b140b04990a3/users/b08a5f34dfc84d61bbbfa9e1959d9e91/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:27.611182 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538f9d2-bbbb-436c-9c51-ef1d676590ab None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:27.611405 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538f9d2-bbbb-436c-9c51-ef1d676590ab None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:27.611679 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538f9d2-bbbb-436c-9c51-ef1d676590ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:27.638832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-3538f9d2-bbbb-436c-9c51-ef1d676590ab None None] MFA Rules not processed for user `b08a5f34dfc84d61bbbfa9e1959d9e91`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:27.640071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-3538f9d2-bbbb-436c-9c51-ef1d676590ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:27.704048 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1251/2531] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:27.708474 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dd1a2-1eb4-401b-8151-a9ff9cd8fc47 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:27.752711 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:27.770603 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dd1a2-1eb4-401b-8151-a9ff9cd8fc47 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:27.775344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b47869-0c0f-4a95-b6a8-5a61a01f7b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:27.775945 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b47869-0c0f-4a95-b6a8-5a61a01f7b7e admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:27.776221 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b47869-0c0f-4a95-b6a8-5a61a01f7b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:27.776491 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b47869-0c0f-4a95-b6a8-5a61a01f7b7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:27.777113 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b47869-0c0f-4a95-b6a8-5a61a01f7b7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:27.779260 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b47869-0c0f-4a95-b6a8-5a61a01f7b7e admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:27.805281 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1281/2532] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:45:27 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:45:27.809547 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538f9d2-bbbb-436c-9c51-ef1d676590ab None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:27.820072 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538f9d2-bbbb-436c-9c51-ef1d676590ab None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:27.875755 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faef70d-d5d0-4a39-bbd2-4ffdd2de9462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:27.876371 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faef70d-d5d0-4a39-bbd2-4ffdd2de9462 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:27.876655 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faef70d-d5d0-4a39-bbd2-4ffdd2de9462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:27.876935 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faef70d-d5d0-4a39-bbd2-4ffdd2de9462 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:27.877580 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faef70d-d5d0-4a39-bbd2-4ffdd2de9462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:27.879566 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faef70d-d5d0-4a39-bbd2-4ffdd2de9462 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:27.889313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:27.902069 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1252/2533] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:45:27 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:45:27.906928 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b47869-0c0f-4a95-b6a8-5a61a01f7b7e admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:27.917098 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b47869-0c0f-4a95-b6a8-5a61a01f7b7e admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:27.921758 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af249be-5680-478d-8259-c8e43becfc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:27.922350 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af249be-5680-478d-8259-c8e43becfc1a admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:27.922624 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af249be-5680-478d-8259-c8e43becfc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:27.922893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af249be-5680-478d-8259-c8e43becfc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:27.923568 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af249be-5680-478d-8259-c8e43becfc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:27.925141 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af249be-5680-478d-8259-c8e43becfc1a admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:27.935647 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1282/2534] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:45:27.939554 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faef70d-d5d0-4a39-bbd2-4ffdd2de9462 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:27.949876 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faef70d-d5d0-4a39-bbd2-4ffdd2de9462 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:27.954656 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e499d-91df-4cab-ac79-31da5b5e3670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:27.955329 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e499d-91df-4cab-ac79-31da5b5e3670 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:27.955610 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e499d-91df-4cab-ac79-31da5b5e3670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:27.955885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e499d-91df-4cab-ac79-31da5b5e3670 admin admin] PATH_INFO: `/v3/projects/b6ba2fc7fdbb42b68ac6e113119508fc/users/95a4676c34704d71888673ac2e20ee98/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:27.972168 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e499d-91df-4cab-ac79-31da5b5e3670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ba2fc7fdbb42b68ac6e113119508fc, user_id=95a4676c34704d71888673ac2e20ee98, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:27.974792 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e499d-91df-4cab-ac79-31da5b5e3670 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:27.987325 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1253/2535] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:45:27 2022] PUT /identity/v3/projects/b6ba2fc7fdbb42b68ac6e113119508fc/users/95a4676c34704d71888673ac2e20ee98/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:27.991282 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af249be-5680-478d-8259-c8e43becfc1a admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:28.001542 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af249be-5680-478d-8259-c8e43becfc1a admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:28.058173 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e685b2-0ba9-42c7-87a6-ec8245adf302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:28.058804 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e685b2-0ba9-42c7-87a6-ec8245adf302 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:28.059115 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e685b2-0ba9-42c7-87a6-ec8245adf302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:28.059386 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e685b2-0ba9-42c7-87a6-ec8245adf302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:28.060014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e685b2-0ba9-42c7-87a6-ec8245adf302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:28.061584 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e685b2-0ba9-42c7-87a6-ec8245adf302 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:28.071599 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1283/2536] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:45:28.076237 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e499d-91df-4cab-ac79-31da5b5e3670 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:28.086523 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e499d-91df-4cab-ac79-31da5b5e3670 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:28.091888 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445891bb-9d59-4821-bb1b-53c03ff308b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:28.092548 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445891bb-9d59-4821-bb1b-53c03ff308b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:28.092826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445891bb-9d59-4821-bb1b-53c03ff308b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:28.093098 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445891bb-9d59-4821-bb1b-53c03ff308b5 admin admin] PATH_INFO: `/v3/projects/b6ba2fc7fdbb42b68ac6e113119508fc/users/95a4676c34704d71888673ac2e20ee98/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:28.095009 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445891bb-9d59-4821-bb1b-53c03ff308b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ba2fc7fdbb42b68ac6e113119508fc, user_id=95a4676c34704d71888673ac2e20ee98, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:28.097659 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445891bb-9d59-4821-bb1b-53c03ff308b5 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:28.107883 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1254/2537] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:45:28 2022] PUT /identity/v3/projects/b6ba2fc7fdbb42b68ac6e113119508fc/users/95a4676c34704d71888673ac2e20ee98/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:45:28.170407 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176a7cf-2ad3-46bb-8cc9-1eae2ef9579e None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:28.170623 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176a7cf-2ad3-46bb-8cc9-1eae2ef9579e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:28.171041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176a7cf-2ad3-46bb-8cc9-1eae2ef9579e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:28.199225 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-3176a7cf-2ad3-46bb-8cc9-1eae2ef9579e None None] MFA Rules not processed for user `95a4676c34704d71888673ac2e20ee98`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:28.200429 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3176a7cf-2ad3-46bb-8cc9-1eae2ef9579e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:28.268118 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1284/2538] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:28.280234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445891bb-9d59-4821-bb1b-53c03ff308b5 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:28.282001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-445891bb-9d59-4821-bb1b-53c03ff308b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:28.341431 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445891bb-9d59-4821-bb1b-53c03ff308b5 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:28.345128 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97895f-32b2-4f3d-8dfa-46c55aa1d885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:28.345731 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97895f-32b2-4f3d-8dfa-46c55aa1d885 service cinder] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:28.346013 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97895f-32b2-4f3d-8dfa-46c55aa1d885 service cinder] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:28.346284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97895f-32b2-4f3d-8dfa-46c55aa1d885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:28.355190 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97895f-32b2-4f3d-8dfa-46c55aa1d885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:28.357207 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97895f-32b2-4f3d-8dfa-46c55aa1d885 service cinder] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:28.366495 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1255/2539] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:45:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:45:28.440173 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176a7cf-2ad3-46bb-8cc9-1eae2ef9579e None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:28.449967 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176a7cf-2ad3-46bb-8cc9-1eae2ef9579e None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:28.453606 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2b933-c72a-43a9-9d8a-12c828940cdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:28.454218 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2b933-c72a-43a9-9d8a-12c828940cdd service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:28.454479 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2b933-c72a-43a9-9d8a-12c828940cdd service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:28.454749 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2b933-c72a-43a9-9d8a-12c828940cdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:28.494463 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:28.514131 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2b933-c72a-43a9-9d8a-12c828940cdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:28.515624 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2b933-c72a-43a9-9d8a-12c828940cdd service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:28.524355 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1285/2540] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:45:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 20 13:45:28.782944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97895f-32b2-4f3d-8dfa-46c55aa1d885 service cinder] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:28.843675 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97895f-32b2-4f3d-8dfa-46c55aa1d885 service cinder] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:28.848071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f29d5a-0201-4dbd-85d2-13b9a71da3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:28.848685 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f29d5a-0201-4dbd-85d2-13b9a71da3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:28.848960 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f29d5a-0201-4dbd-85d2-13b9a71da3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:28.849230 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f29d5a-0201-4dbd-85d2-13b9a71da3ff admin admin] PATH_INFO: `/v3/users/b08a5f34dfc84d61bbbfa9e1959d9e91` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:28.850328 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f29d5a-0201-4dbd-85d2-13b9a71da3ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08a5f34dfc84d61bbbfa9e1959d9e91)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:28.852246 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f29d5a-0201-4dbd-85d2-13b9a71da3ff admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:28.899693 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b5f29d5a-0201-4dbd-85d2-13b9a71da3ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08a5f34dfc84d61bbbfa9e1959d9e91'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:28.900350 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b5f29d5a-0201-4dbd-85d2-13b9a71da3ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08a5f34dfc84d61bbbfa9e1959d9e91'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:28.907225 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b5f29d5a-0201-4dbd-85d2-13b9a71da3ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08a5f34dfc84d61bbbfa9e1959d9e91'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:28.909108 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:28.921673 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b5f29d5a-0201-4dbd-85d2-13b9a71da3ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08a5f34dfc84d61bbbfa9e1959d9e91'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:28.922341 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-b5f29d5a-0201-4dbd-85d2-13b9a71da3ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08a5f34dfc84d61bbbfa9e1959d9e91'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:28.936136 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1256/2541] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:45:28 2022] DELETE /identity/v3/users/b08a5f34dfc84d61bbbfa9e1959d9e91 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:28.940808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d699b0-822c-4f22-ab79-2f595d644b0c None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:28.941118 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d699b0-822c-4f22-ab79-2f595d644b0c None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:28.941396 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d699b0-822c-4f22-ab79-2f595d644b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:28.960613 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-49d699b0-822c-4f22-ab79-2f595d644b0c None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:28.961785 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-49d699b0-822c-4f22-ab79-2f595d644b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:29.019970 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1286/2542] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:45:29.029612 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f29d5a-0201-4dbd-85d2-13b9a71da3ff admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:29.031118 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-b5f29d5a-0201-4dbd-85d2-13b9a71da3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:29.088878 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f29d5a-0201-4dbd-85d2-13b9a71da3ff admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:29.092906 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c910a-6927-468a-b220-378a994bc05d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:29.093513 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c910a-6927-468a-b220-378a994bc05d service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:29.093797 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c910a-6927-468a-b220-378a994bc05d service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:29.094074 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c910a-6927-468a-b220-378a994bc05d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:29.102974 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c910a-6927-468a-b220-378a994bc05d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:29.104409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c910a-6927-468a-b220-378a994bc05d service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:29.113804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1257/2543] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:45:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:45:29.380359 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d699b0-822c-4f22-ab79-2f595d644b0c None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:29.381938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-49d699b0-822c-4f22-ab79-2f595d644b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:29.394420 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d699b0-822c-4f22-ab79-2f595d644b0c None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:29.398942 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a92a2-d19e-459e-824a-1aa74db444a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:29.399593 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a92a2-d19e-459e-824a-1aa74db444a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:29.399869 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a92a2-d19e-459e-824a-1aa74db444a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:29.400140 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a92a2-d19e-459e-824a-1aa74db444a2 admin admin] PATH_INFO: `/v3/projects/1d3ae5766dd640f69fb8b140b04990a3` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:29.401364 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a92a2-d19e-459e-824a-1aa74db444a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3ae5766dd640f69fb8b140b04990a3)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:29.403949 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a92a2-d19e-459e-824a-1aa74db444a2 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:29.450789 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-319a92a2-d19e-459e-824a-1aa74db444a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3ae5766dd640f69fb8b140b04990a3', 'request_id': 'req-319a92a2-d19e-459e-824a-1aa74db444a2'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:29.458018 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-319a92a2-d19e-459e-824a-1aa74db444a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3ae5766dd640f69fb8b140b04990a3', 'request_id': 'req-319a92a2-d19e-459e-824a-1aa74db444a2'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:29.465187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-319a92a2-d19e-459e-824a-1aa74db444a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3ae5766dd640f69fb8b140b04990a3', 'request_id': 'req-319a92a2-d19e-459e-824a-1aa74db444a2'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:29.475326 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-319a92a2-d19e-459e-824a-1aa74db444a2 admin admin] The token cache is being invalidate because project 1d3ae5766dd640f69fb8b140b04990a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:45:29.475613 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-319a92a2-d19e-459e-824a-1aa74db444a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:29.476231 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-319a92a2-d19e-459e-824a-1aa74db444a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:29.477701 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1287/2544] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:45:29 2022] DELETE /identity/v3/projects/1d3ae5766dd640f69fb8b140b04990a3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:29.482229 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c910a-6927-468a-b220-378a994bc05d service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:29.491810 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c910a-6927-468a-b220-378a994bc05d service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:29.547940 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793ff1f0-d460-4ddb-8d88-6322a791bff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:29.548567 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ff1f0-d460-4ddb-8d88-6322a791bff8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:29.548897 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ff1f0-d460-4ddb-8d88-6322a791bff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:29.549171 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793ff1f0-d460-4ddb-8d88-6322a791bff8 admin admin] PATH_INFO: `/v3/users/95a4676c34704d71888673ac2e20ee98` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:29.550284 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ff1f0-d460-4ddb-8d88-6322a791bff8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a4676c34704d71888673ac2e20ee98)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:29.552213 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793ff1f0-d460-4ddb-8d88-6322a791bff8 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:29.597914 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-793ff1f0-d460-4ddb-8d88-6322a791bff8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a4676c34704d71888673ac2e20ee98'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:29.598570 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-793ff1f0-d460-4ddb-8d88-6322a791bff8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a4676c34704d71888673ac2e20ee98'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:29.606147 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-793ff1f0-d460-4ddb-8d88-6322a791bff8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a4676c34704d71888673ac2e20ee98'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:29.617949 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-793ff1f0-d460-4ddb-8d88-6322a791bff8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a4676c34704d71888673ac2e20ee98'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:29.618593 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-793ff1f0-d460-4ddb-8d88-6322a791bff8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a4676c34704d71888673ac2e20ee98'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:29.626777 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:29.632071 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1258/2545] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:45:29 2022] DELETE /identity/v3/users/95a4676c34704d71888673ac2e20ee98 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:29.905067 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a92a2-d19e-459e-824a-1aa74db444a2 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:29.906493 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-319a92a2-d19e-459e-824a-1aa74db444a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:29.920054 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a92a2-d19e-459e-824a-1aa74db444a2 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:29.976464 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa8214-3d20-468c-850a-82c26115671e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:29.977103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa8214-3d20-468c-850a-82c26115671e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:29.977398 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa8214-3d20-468c-850a-82c26115671e admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:29.977662 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa8214-3d20-468c-850a-82c26115671e admin admin] PATH_INFO: `/v3/projects/b6ba2fc7fdbb42b68ac6e113119508fc` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:29.978815 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa8214-3d20-468c-850a-82c26115671e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ba2fc7fdbb42b68ac6e113119508fc)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:29.980856 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa8214-3d20-468c-850a-82c26115671e admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:29.983126 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:30.027963 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-9faa8214-3d20-468c-850a-82c26115671e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ba2fc7fdbb42b68ac6e113119508fc', 'request_id': 'req-9faa8214-3d20-468c-850a-82c26115671e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:30.035014 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-9faa8214-3d20-468c-850a-82c26115671e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ba2fc7fdbb42b68ac6e113119508fc', 'request_id': 'req-9faa8214-3d20-468c-850a-82c26115671e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:30.041095 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-9faa8214-3d20-468c-850a-82c26115671e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ba2fc7fdbb42b68ac6e113119508fc', 'request_id': 'req-9faa8214-3d20-468c-850a-82c26115671e'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:30.052020 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-9faa8214-3d20-468c-850a-82c26115671e admin admin] The token cache is being invalidate because project b6ba2fc7fdbb42b68ac6e113119508fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:45:30.052311 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-9faa8214-3d20-468c-850a-82c26115671e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:30.052942 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-9faa8214-3d20-468c-850a-82c26115671e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:30.054655 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1288/2546] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:45:29 2022] DELETE /identity/v3/projects/b6ba2fc7fdbb42b68ac6e113119508fc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:30.060301 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a9225-d648-4189-a497-217aeca1488f None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:30.060588 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a9225-d648-4189-a497-217aeca1488f None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:30.060863 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a9225-d648-4189-a497-217aeca1488f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:30.080588 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-281a9225-d648-4189-a497-217aeca1488f None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:30.081755 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-281a9225-d648-4189-a497-217aeca1488f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:30.140009 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1259/2547] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:30.147977 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23e105-a615-473f-8414-219ad2b6103a None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:30.148249 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23e105-a615-473f-8414-219ad2b6103a None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:30.148528 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23e105-a615-473f-8414-219ad2b6103a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:30.168964 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-3b23e105-a615-473f-8414-219ad2b6103a None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:30.170167 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3b23e105-a615-473f-8414-219ad2b6103a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:30.177883 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1289/2548] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:30.182291 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a9225-d648-4189-a497-217aeca1488f None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:30.192524 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a9225-d648-4189-a497-217aeca1488f None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:30.197119 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161f227-a921-46df-8c41-98ac1b2436ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:30.197719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161f227-a921-46df-8c41-98ac1b2436ea admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:30.198001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161f227-a921-46df-8c41-98ac1b2436ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:30.198275 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0161f227-a921-46df-8c41-98ac1b2436ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:30.198975 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161f227-a921-46df-8c41-98ac1b2436ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:45:30.199293 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161f227-a921-46df-8c41-98ac1b2436ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:30.200885 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0161f227-a921-46df-8c41-98ac1b2436ea admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:30.212224 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1260/2549] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:45:30.217103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23e105-a615-473f-8414-219ad2b6103a None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:30.226166 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23e105-a615-473f-8414-219ad2b6103a None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:30.231746 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c81a32-4a50-4c7b-8253-46e94cc74ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:30.232339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c81a32-4a50-4c7b-8253-46e94cc74ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:30.232634 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c81a32-4a50-4c7b-8253-46e94cc74ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:30.232903 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c81a32-4a50-4c7b-8253-46e94cc74ba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:30.233514 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c81a32-4a50-4c7b-8253-46e94cc74ba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:30.235427 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c81a32-4a50-4c7b-8253-46e94cc74ba1 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:30.263361 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1290/2550] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:45:30 2022] POST /identity/v3/projects => generated 361 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:45:30.267719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161f227-a921-46df-8c41-98ac1b2436ea admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:30.277832 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0161f227-a921-46df-8c41-98ac1b2436ea admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:30.335142 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245bd7c-7f4c-4406-bc25-99902c36c19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:30.335674 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245bd7c-7f4c-4406-bc25-99902c36c19a admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:30.335958 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245bd7c-7f4c-4406-bc25-99902c36c19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:30.336234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245bd7c-7f4c-4406-bc25-99902c36c19a admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:30.336870 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245bd7c-7f4c-4406-bc25-99902c36c19a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:30.338774 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245bd7c-7f4c-4406-bc25-99902c36c19a admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:30.360261 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1261/2551] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:45:30 2022] POST /identity/v3/users => generated 281 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:45:30.364485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c81a32-4a50-4c7b-8253-46e94cc74ba1 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:30.375356 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c81a32-4a50-4c7b-8253-46e94cc74ba1 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:30.379951 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9137a0-8e1b-4c3c-851d-c7232de3ad23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:30.380545 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9137a0-8e1b-4c3c-851d-c7232de3ad23 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:30.380827 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9137a0-8e1b-4c3c-851d-c7232de3ad23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:30.381101 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9137a0-8e1b-4c3c-851d-c7232de3ad23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:30.381737 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9137a0-8e1b-4c3c-851d-c7232de3ad23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:30.383356 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9137a0-8e1b-4c3c-851d-c7232de3ad23 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:30.393807 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1291/2552] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:45:30.397775 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245bd7c-7f4c-4406-bc25-99902c36c19a admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:30.407844 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245bd7c-7f4c-4406-bc25-99902c36c19a admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:30.412470 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970679e-ea7b-4e0c-a152-485a711b44b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:30.413092 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970679e-ea7b-4e0c-a152-485a711b44b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:30.413375 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970679e-ea7b-4e0c-a152-485a711b44b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:30.413649 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970679e-ea7b-4e0c-a152-485a711b44b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:30.414286 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970679e-ea7b-4e0c-a152-485a711b44b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:30.415923 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b970679e-ea7b-4e0c-a152-485a711b44b9 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:30.426488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1262/2553] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:45:30.430616 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9137a0-8e1b-4c3c-851d-c7232de3ad23 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:30.441010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9137a0-8e1b-4c3c-851d-c7232de3ad23 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:30.445643 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f8212-b916-4b4f-849d-aab202818ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:30.446287 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f8212-b916-4b4f-849d-aab202818ce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:30.446572 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f8212-b916-4b4f-849d-aab202818ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:30.446852 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f8212-b916-4b4f-849d-aab202818ce1 admin admin] PATH_INFO: `/v3/projects/7180e74c16744d93a6cdb79030081d5a/users/dfdbffeb4deb4bb0a0a0817de9f6ee2d/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:30.461723 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f8212-b916-4b4f-849d-aab202818ce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7180e74c16744d93a6cdb79030081d5a, user_id=dfdbffeb4deb4bb0a0a0817de9f6ee2d, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:30.464410 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f8212-b916-4b4f-849d-aab202818ce1 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:30.477661 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1292/2554] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:45:30 2022] PUT /identity/v3/projects/7180e74c16744d93a6cdb79030081d5a/users/dfdbffeb4deb4bb0a0a0817de9f6ee2d/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:30.489133 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13343bfe-96f4-4a0b-b34c-3d3a5e047634 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:30.489616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13343bfe-96f4-4a0b-b34c-3d3a5e047634 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:30.489714 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13343bfe-96f4-4a0b-b34c-3d3a5e047634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:30.518726 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-13343bfe-96f4-4a0b-b34c-3d3a5e047634 None None] MFA Rules not processed for user `dfdbffeb4deb4bb0a0a0817de9f6ee2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:30.519966 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-13343bfe-96f4-4a0b-b34c-3d3a5e047634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:30.573295 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:30.584540 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1263/2555] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:30.618933 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f8212-b916-4b4f-849d-aab202818ce1 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:30.620666 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-7d0f8212-b916-4b4f-849d-aab202818ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:30.677876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f8212-b916-4b4f-849d-aab202818ce1 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:30.681808 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a27fbe-50b4-4c4f-b1e1-a3edfaa082d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:30.682412 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a27fbe-50b4-4c4f-b1e1-a3edfaa082d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:30.682691 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a27fbe-50b4-4c4f-b1e1-a3edfaa082d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:30.682985 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a27fbe-50b4-4c4f-b1e1-a3edfaa082d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:30.691296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a27fbe-50b4-4c4f-b1e1-a3edfaa082d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:30.692701 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a27fbe-50b4-4c4f-b1e1-a3edfaa082d1 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:30.701466 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1293/2556] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:45:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:45:30.717969 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13343bfe-96f4-4a0b-b34c-3d3a5e047634 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:30.780804 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13343bfe-96f4-4a0b-b34c-3d3a5e047634 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:30.785360 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94165d64-f2af-40fe-9069-a2679be5efe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:30.785991 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94165d64-f2af-40fe-9069-a2679be5efe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:30.786274 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94165d64-f2af-40fe-9069-a2679be5efe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:30.786551 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94165d64-f2af-40fe-9069-a2679be5efe9 admin admin] PATH_INFO: `/v3/users/dfdbffeb4deb4bb0a0a0817de9f6ee2d` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:30.787719 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94165d64-f2af-40fe-9069-a2679be5efe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfdbffeb4deb4bb0a0a0817de9f6ee2d)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:30.789634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94165d64-f2af-40fe-9069-a2679be5efe9 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:30.835054 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-94165d64-f2af-40fe-9069-a2679be5efe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfdbffeb4deb4bb0a0a0817de9f6ee2d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:30.835704 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-94165d64-f2af-40fe-9069-a2679be5efe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfdbffeb4deb4bb0a0a0817de9f6ee2d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:30.843192 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-94165d64-f2af-40fe-9069-a2679be5efe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfdbffeb4deb4bb0a0a0817de9f6ee2d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:30.855058 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-94165d64-f2af-40fe-9069-a2679be5efe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfdbffeb4deb4bb0a0a0817de9f6ee2d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:30.855935 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-94165d64-f2af-40fe-9069-a2679be5efe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfdbffeb4deb4bb0a0a0817de9f6ee2d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:30.868968 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1264/2557] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:45:30 2022] DELETE /identity/v3/users/dfdbffeb4deb4bb0a0a0817de9f6ee2d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:30.873809 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2511f3-18cc-455a-8bd3-da377438c935 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:30.874648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2511f3-18cc-455a-8bd3-da377438c935 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:30.874648 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2511f3-18cc-455a-8bd3-da377438c935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:30.894203 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-dc2511f3-18cc-455a-8bd3-da377438c935 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:30.895428 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-dc2511f3-18cc-455a-8bd3-da377438c935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:30.924159 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:30.957661 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1294/2558] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:30.967996 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94165d64-f2af-40fe-9069-a2679be5efe9 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:30.969384 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-94165d64-f2af-40fe-9069-a2679be5efe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:31.024869 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94165d64-f2af-40fe-9069-a2679be5efe9 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:31.029123 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01dc567-c5dc-46ae-b116-070ecbb8d115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:31.029725 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dc567-c5dc-46ae-b116-070ecbb8d115 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:31.030002 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dc567-c5dc-46ae-b116-070ecbb8d115 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:31.030269 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01dc567-c5dc-46ae-b116-070ecbb8d115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:31.039244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dc567-c5dc-46ae-b116-070ecbb8d115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:31.040652 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01dc567-c5dc-46ae-b116-070ecbb8d115 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:31.049911 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1265/2559] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:45:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:45:31.317253 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2511f3-18cc-455a-8bd3-da377438c935 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:31.318688 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-dc2511f3-18cc-455a-8bd3-da377438c935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:31.332159 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2511f3-18cc-455a-8bd3-da377438c935 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:31.337227 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bbd16-8566-4c1e-846a-0fe20a144c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:31.337867 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bbd16-8566-4c1e-846a-0fe20a144c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:31.338146 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bbd16-8566-4c1e-846a-0fe20a144c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:31.338419 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bbd16-8566-4c1e-846a-0fe20a144c2d admin admin] PATH_INFO: `/v3/projects/7180e74c16744d93a6cdb79030081d5a` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:31.340241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304bbd16-8566-4c1e-846a-0fe20a144c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7180e74c16744d93a6cdb79030081d5a)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:31.342148 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304bbd16-8566-4c1e-846a-0fe20a144c2d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:31.389314 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-304bbd16-8566-4c1e-846a-0fe20a144c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7180e74c16744d93a6cdb79030081d5a', 'request_id': 'req-304bbd16-8566-4c1e-846a-0fe20a144c2d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:31.395725 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-304bbd16-8566-4c1e-846a-0fe20a144c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7180e74c16744d93a6cdb79030081d5a', 'request_id': 'req-304bbd16-8566-4c1e-846a-0fe20a144c2d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:31.401892 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-304bbd16-8566-4c1e-846a-0fe20a144c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7180e74c16744d93a6cdb79030081d5a', 'request_id': 'req-304bbd16-8566-4c1e-846a-0fe20a144c2d'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:31.412557 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-304bbd16-8566-4c1e-846a-0fe20a144c2d admin admin] The token cache is being invalidate because project 7180e74c16744d93a6cdb79030081d5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:45:31.412845 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-304bbd16-8566-4c1e-846a-0fe20a144c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:31.413470 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-304bbd16-8566-4c1e-846a-0fe20a144c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:31.415006 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1295/2560] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:45:31 2022] DELETE /identity/v3/projects/7180e74c16744d93a6cdb79030081d5a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:31.420409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c60f1-276a-4ca4-8188-ff212da47a27 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:31.420765 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c60f1-276a-4ca4-8188-ff212da47a27 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:31.421024 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c60f1-276a-4ca4-8188-ff212da47a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:31.440959 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-e56c60f1-276a-4ca4-8188-ff212da47a27 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:31.442163 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-e56c60f1-276a-4ca4-8188-ff212da47a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:31.451750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:31.503553 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1266/2561] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:31.511273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c66351-2ba4-4ee8-9b46-8bfaa72da9a1 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:31.512131 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c66351-2ba4-4ee8-9b46-8bfaa72da9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:31.512435 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c66351-2ba4-4ee8-9b46-8bfaa72da9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:31.532327 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-84c66351-2ba4-4ee8-9b46-8bfaa72da9a1 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:31.533510 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-84c66351-2ba4-4ee8-9b46-8bfaa72da9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:31.541154 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1296/2562] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:31.545484 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c60f1-276a-4ca4-8188-ff212da47a27 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:31.555326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c60f1-276a-4ca4-8188-ff212da47a27 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:31.559924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84656fbf-27e1-4381-85f3-07d19c6b3dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:31.560532 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84656fbf-27e1-4381-85f3-07d19c6b3dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:31.560817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84656fbf-27e1-4381-85f3-07d19c6b3dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:31.561095 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84656fbf-27e1-4381-85f3-07d19c6b3dc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:31.561737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84656fbf-27e1-4381-85f3-07d19c6b3dc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:45:31.562075 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84656fbf-27e1-4381-85f3-07d19c6b3dc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:31.563750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84656fbf-27e1-4381-85f3-07d19c6b3dc9 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:31.575851 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1267/2563] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:45:31.580041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c66351-2ba4-4ee8-9b46-8bfaa72da9a1 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:31.589010 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c66351-2ba4-4ee8-9b46-8bfaa72da9a1 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:31.596237 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6799dd9-8d4b-4aab-a125-081e6cdcdb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:31.596963 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6799dd9-8d4b-4aab-a125-081e6cdcdb24 admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:31.597277 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6799dd9-8d4b-4aab-a125-081e6cdcdb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:31.597552 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6799dd9-8d4b-4aab-a125-081e6cdcdb24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:31.598227 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6799dd9-8d4b-4aab-a125-081e6cdcdb24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:31.600173 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6799dd9-8d4b-4aab-a125-081e6cdcdb24 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:31.637202 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1297/2564] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:45:31 2022] POST /identity/v3/projects => generated 389 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:45:31.641478 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84656fbf-27e1-4381-85f3-07d19c6b3dc9 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:31.652001 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84656fbf-27e1-4381-85f3-07d19c6b3dc9 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:31.709165 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47650c1-9ae5-450e-8613-7532f74e8cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:31.709770 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47650c1-9ae5-450e-8613-7532f74e8cde admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:31.710076 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47650c1-9ae5-450e-8613-7532f74e8cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:31.710349 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47650c1-9ae5-450e-8613-7532f74e8cde admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:31.711003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47650c1-9ae5-450e-8613-7532f74e8cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:31.712911 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47650c1-9ae5-450e-8613-7532f74e8cde admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:31.734551 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1268/2565] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:45:31 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:45:31.738649 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6799dd9-8d4b-4aab-a125-081e6cdcdb24 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:31.749848 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6799dd9-8d4b-4aab-a125-081e6cdcdb24 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:31.754363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62058c27-5beb-4652-a4eb-24a31285f803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:31.754973 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62058c27-5beb-4652-a4eb-24a31285f803 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:31.755263 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62058c27-5beb-4652-a4eb-24a31285f803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:31.755536 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62058c27-5beb-4652-a4eb-24a31285f803 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:31.756294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62058c27-5beb-4652-a4eb-24a31285f803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:31.757875 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62058c27-5beb-4652-a4eb-24a31285f803 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:31.767831 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1298/2566] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:45:31.771910 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47650c1-9ae5-450e-8613-7532f74e8cde admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:31.782139 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47650c1-9ae5-450e-8613-7532f74e8cde admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:31.786711 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2e21fc-7f8c-4427-ad40-70302edd6110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:31.787339 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e21fc-7f8c-4427-ad40-70302edd6110 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:31.787616 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e21fc-7f8c-4427-ad40-70302edd6110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:31.787890 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e21fc-7f8c-4427-ad40-70302edd6110 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:31.788527 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e21fc-7f8c-4427-ad40-70302edd6110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:31.790102 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2e21fc-7f8c-4427-ad40-70302edd6110 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:31.801417 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1269/2567] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:45:31.805774 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62058c27-5beb-4652-a4eb-24a31285f803 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:31.816462 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62058c27-5beb-4652-a4eb-24a31285f803 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:31.821046 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d09fbf-e0d3-4222-b565-6fd02ba08c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:31.821682 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d09fbf-e0d3-4222-b565-6fd02ba08c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:31.821958 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d09fbf-e0d3-4222-b565-6fd02ba08c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:31.822233 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d09fbf-e0d3-4222-b565-6fd02ba08c2c admin admin] PATH_INFO: `/v3/projects/4b1a505dc13f437692b61f9f37d3acec/users/52ca1ebaf0e3491ab0d583f51880ff1d/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:31.836344 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d09fbf-e0d3-4222-b565-6fd02ba08c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1a505dc13f437692b61f9f37d3acec, user_id=52ca1ebaf0e3491ab0d583f51880ff1d, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:31.838936 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d09fbf-e0d3-4222-b565-6fd02ba08c2c admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:31.852796 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1299/2568] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:45:31 2022] PUT /identity/v3/projects/4b1a505dc13f437692b61f9f37d3acec/users/52ca1ebaf0e3491ab0d583f51880ff1d/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:45:31.863124 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9268bd-445f-4cb5-b066-330552842227 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:31.863411 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9268bd-445f-4cb5-b066-330552842227 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:31.863683 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9268bd-445f-4cb5-b066-330552842227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:31.892031 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-9d9268bd-445f-4cb5-b066-330552842227 None None] MFA Rules not processed for user `52ca1ebaf0e3491ab0d583f51880ff1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:31.893226 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-9d9268bd-445f-4cb5-b066-330552842227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:31.955833 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1270/2569] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:31.967031 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d09fbf-e0d3-4222-b565-6fd02ba08c2c admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:31.968768 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-25d09fbf-e0d3-4222-b565-6fd02ba08c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:32.014382 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:32.028136 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d09fbf-e0d3-4222-b565-6fd02ba08c2c admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:32.032251 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f76cbf-4f69-4a89-80ea-3c414d4fd678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a7a1006ff4b43c3be2cc011359abdd2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:32.032856 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f76cbf-4f69-4a89-80ea-3c414d4fd678 service cinder] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:32.033131 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f76cbf-4f69-4a89-80ea-3c414d4fd678 service cinder] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:32.033405 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f76cbf-4f69-4a89-80ea-3c414d4fd678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:32.041514 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f76cbf-4f69-4a89-80ea-3c414d4fd678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:32.043557 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f76cbf-4f69-4a89-80ea-3c414d4fd678 service cinder] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:32.052262 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1300/2570] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:45:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:45:41.952935 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:42.048352 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=7 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:42.290085 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9268bd-445f-4cb5-b066-330552842227 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:42.353429 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9268bd-445f-4cb5-b066-330552842227 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:42.358746 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475e99e-0dba-40a1-89e0-ea5c48158e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:42.359406 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475e99e-0dba-40a1-89e0-ea5c48158e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:42.359689 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475e99e-0dba-40a1-89e0-ea5c48158e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:42.359964 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475e99e-0dba-40a1-89e0-ea5c48158e3b admin admin] PATH_INFO: `/v3/users/52ca1ebaf0e3491ab0d583f51880ff1d` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:42.361082 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475e99e-0dba-40a1-89e0-ea5c48158e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ca1ebaf0e3491ab0d583f51880ff1d)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:42.363053 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475e99e-0dba-40a1-89e0-ea5c48158e3b admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:42.409178 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5475e99e-0dba-40a1-89e0-ea5c48158e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ca1ebaf0e3491ab0d583f51880ff1d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:42.409821 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5475e99e-0dba-40a1-89e0-ea5c48158e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ca1ebaf0e3491ab0d583f51880ff1d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:42.416762 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5475e99e-0dba-40a1-89e0-ea5c48158e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ca1ebaf0e3491ab0d583f51880ff1d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:42.430664 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5475e99e-0dba-40a1-89e0-ea5c48158e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ca1ebaf0e3491ab0d583f51880ff1d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:42.431350 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-5475e99e-0dba-40a1-89e0-ea5c48158e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ca1ebaf0e3491ab0d583f51880ff1d'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:42.444030 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1271/2571] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:45:42 2022] DELETE /identity/v3/users/52ca1ebaf0e3491ab0d583f51880ff1d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:45:42.448630 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a7b2a-b090-43dd-af5c-c606261585fe None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:42.449070 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a7b2a-b090-43dd-af5c-c606261585fe None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:42.449357 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a7b2a-b090-43dd-af5c-c606261585fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:42.468526 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-db0a7b2a-b090-43dd-af5c-c606261585fe None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:42.469725 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-db0a7b2a-b090-43dd-af5c-c606261585fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:42.527955 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1301/2572] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:42.537409 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475e99e-0dba-40a1-89e0-ea5c48158e3b admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:42.538828 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-5475e99e-0dba-40a1-89e0-ea5c48158e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:42.595953 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475e99e-0dba-40a1-89e0-ea5c48158e3b admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:42.599626 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92d916-3086-4b8f-a3e9-6ef276a1fb86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:42.600222 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92d916-3086-4b8f-a3e9-6ef276a1fb86 service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:42.600504 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92d916-3086-4b8f-a3e9-6ef276a1fb86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:42.600777 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92d916-3086-4b8f-a3e9-6ef276a1fb86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:42.610152 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92d916-3086-4b8f-a3e9-6ef276a1fb86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:42.611602 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92d916-3086-4b8f-a3e9-6ef276a1fb86 service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:42.621134 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1272/2573] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:45:43.099640 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a7b2a-b090-43dd-af5c-c606261585fe None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:43.101126 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-db0a7b2a-b090-43dd-af5c-c606261585fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:43.115376 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a7b2a-b090-43dd-af5c-c606261585fe None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:43.121110 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256731ae-772a-45e0-9977-182023a23532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:43.121770 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256731ae-772a-45e0-9977-182023a23532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:43.122146 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256731ae-772a-45e0-9977-182023a23532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:43.122292 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256731ae-772a-45e0-9977-182023a23532 admin admin] PATH_INFO: `/v3/projects/4b1a505dc13f437692b61f9f37d3acec` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:43.123727 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256731ae-772a-45e0-9977-182023a23532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1a505dc13f437692b61f9f37d3acec)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:43.125763 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256731ae-772a-45e0-9977-182023a23532 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:43.172363 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-256731ae-772a-45e0-9977-182023a23532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1a505dc13f437692b61f9f37d3acec', 'request_id': 'req-256731ae-772a-45e0-9977-182023a23532'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:43.180943 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-256731ae-772a-45e0-9977-182023a23532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1a505dc13f437692b61f9f37d3acec', 'request_id': 'req-256731ae-772a-45e0-9977-182023a23532'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:43.188172 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-256731ae-772a-45e0-9977-182023a23532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1a505dc13f437692b61f9f37d3acec', 'request_id': 'req-256731ae-772a-45e0-9977-182023a23532'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:43.198329 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-256731ae-772a-45e0-9977-182023a23532 admin admin] The token cache is being invalidate because project 4b1a505dc13f437692b61f9f37d3acec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81427) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:45:43.199310 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-256731ae-772a-45e0-9977-182023a23532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:43.199948 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-256731ae-772a-45e0-9977-182023a23532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:45:43.201441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1302/2574] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:45:43 2022] DELETE /identity/v3/projects/4b1a505dc13f437692b61f9f37d3acec => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:43.209191 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc338ec-e44e-461b-9b89-9ad5a9c781b5 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:43.209683 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc338ec-e44e-461b-9b89-9ad5a9c781b5 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:43.209784 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc338ec-e44e-461b-9b89-9ad5a9c781b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:43.228811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-cfc338ec-e44e-461b-9b89-9ad5a9c781b5 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:43.230061 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-cfc338ec-e44e-461b-9b89-9ad5a9c781b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:43.247129 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:43.290453 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1273/2575] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:43.298494 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b7897-e941-4cb0-bec1-81efa0cb9240 None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:43.298781 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b7897-e941-4cb0-bec1-81efa0cb9240 None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:43.299103 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b7897-e941-4cb0-bec1-81efa0cb9240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:43.319268 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-664b7897-e941-4cb0-bec1-81efa0cb9240 None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:43.320468 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-664b7897-e941-4cb0-bec1-81efa0cb9240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:43.328944 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1303/2576] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:43.333154 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc338ec-e44e-461b-9b89-9ad5a9c781b5 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:43.343003 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc338ec-e44e-461b-9b89-9ad5a9c781b5 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:43.347474 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61a194-3764-4726-8c4b-5c4737935b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:43.348063 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61a194-3764-4726-8c4b-5c4737935b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:43.348340 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61a194-3764-4726-8c4b-5c4737935b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:43.348608 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61a194-3764-4726-8c4b-5c4737935b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:43.349270 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61a194-3764-4726-8c4b-5c4737935b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81426) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 20 13:45:43.349571 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61a194-3764-4726-8c4b-5c4737935b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:43.351171 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61a194-3764-4726-8c4b-5c4737935b20 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:43.362392 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1274/2577] 10.222.0.36 () {58 vars in 1153 bytes} [Thu Oct 20 13:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 20 13:45:43.366487 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b7897-e941-4cb0-bec1-81efa0cb9240 None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:43.376180 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b7897-e941-4cb0-bec1-81efa0cb9240 None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:43.380813 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40ea37-7ce5-40a1-baa3-a3c5626df14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:43.381409 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40ea37-7ce5-40a1-baa3-a3c5626df14c admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:43.381691 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40ea37-7ce5-40a1-baa3-a3c5626df14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:43.381965 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40ea37-7ce5-40a1-baa3-a3c5626df14c admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:43.382598 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40ea37-7ce5-40a1-baa3-a3c5626df14c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:43.384523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40ea37-7ce5-40a1-baa3-a3c5626df14c admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:43.411635 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1304/2578] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:45:43 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:45:43.415712 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61a194-3764-4726-8c4b-5c4737935b20 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:43.425750 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61a194-3764-4726-8c4b-5c4737935b20 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:43.482826 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d7f41-0fc0-49d0-866f-29945847dd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:43.483488 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d7f41-0fc0-49d0-866f-29945847dd22 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:43.483764 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d7f41-0fc0-49d0-866f-29945847dd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:43.484035 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d7f41-0fc0-49d0-866f-29945847dd22 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:43.484675 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d7f41-0fc0-49d0-866f-29945847dd22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:43.486629 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d7f41-0fc0-49d0-866f-29945847dd22 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:43.507924 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1275/2579] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:45:43 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:45:43.512296 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40ea37-7ce5-40a1-baa3-a3c5626df14c admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:43.522381 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40ea37-7ce5-40a1-baa3-a3c5626df14c admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:43.527327 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ba570-2ba0-45fe-9133-57d4fdc193fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:43.527926 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ba570-2ba0-45fe-9133-57d4fdc193fe admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:43.528207 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ba570-2ba0-45fe-9133-57d4fdc193fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:43.528485 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ba570-2ba0-45fe-9133-57d4fdc193fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:43.529122 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ba570-2ba0-45fe-9133-57d4fdc193fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:43.530723 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ba570-2ba0-45fe-9133-57d4fdc193fe admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:43.540436 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1305/2580] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:45:43.544880 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d7f41-0fc0-49d0-866f-29945847dd22 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:43.555369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d7f41-0fc0-49d0-866f-29945847dd22 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:43.560591 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db99f7a5-13ef-45fe-8c06-e4444361cbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:43.561187 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99f7a5-13ef-45fe-8c06-e4444361cbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:43.561464 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99f7a5-13ef-45fe-8c06-e4444361cbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:43.561737 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99f7a5-13ef-45fe-8c06-e4444361cbf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:43.562369 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99f7a5-13ef-45fe-8c06-e4444361cbf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:43.563966 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db99f7a5-13ef-45fe-8c06-e4444361cbf7 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:43.574556 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1276/2581] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 20 13:45:43.578739 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ba570-2ba0-45fe-9133-57d4fdc193fe admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:43.588765 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ba570-2ba0-45fe-9133-57d4fdc193fe admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:43.593393 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f55e7-0e40-473b-b79c-afebb4c985e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:43.594040 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f55e7-0e40-473b-b79c-afebb4c985e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:43.594323 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f55e7-0e40-473b-b79c-afebb4c985e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:43.594604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f55e7-0e40-473b-b79c-afebb4c985e1 admin admin] PATH_INFO: `/v3/projects/c4b9c62edbf64a5da9318715156dc348/users/d2d41ebefb154e3f8d9f04825024dc2a/roles/233938f0e7e84b5098019470ad8cfb4e` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:43.609459 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f55e7-0e40-473b-b79c-afebb4c985e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b9c62edbf64a5da9318715156dc348, user_id=d2d41ebefb154e3f8d9f04825024dc2a, role_id=233938f0e7e84b5098019470ad8cfb4e)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:43.612135 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f55e7-0e40-473b-b79c-afebb4c985e1 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:43.625852 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1306/2582] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:45:43 2022] PUT /identity/v3/projects/c4b9c62edbf64a5da9318715156dc348/users/d2d41ebefb154e3f8d9f04825024dc2a/roles/233938f0e7e84b5098019470ad8cfb4e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:43.630767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb000-9816-4f9f-9297-b6c081a51adf None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:43.631067 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb000-9816-4f9f-9297-b6c081a51adf None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:43.631341 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eeb000-9816-4f9f-9297-b6c081a51adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:43.654347 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-79eeb000-9816-4f9f-9297-b6c081a51adf None None] MFA Rules not processed for user `7f166e0661794d2b8c2ad033390437ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:43.655579 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-79eeb000-9816-4f9f-9297-b6c081a51adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:43.714253 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1277/2583] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:43.724050 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f55e7-0e40-473b-b79c-afebb4c985e1 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:43.725771 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-3b7f55e7-0e40-473b-b79c-afebb4c985e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:43.748712 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:43.785912 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f55e7-0e40-473b-b79c-afebb4c985e1 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:43.789657 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7317a-109a-4891-be67-fcb4dbe2d007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:43.790263 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7317a-109a-4891-be67-fcb4dbe2d007 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:43.790544 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7317a-109a-4891-be67-fcb4dbe2d007 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:43.790820 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7317a-109a-4891-be67-fcb4dbe2d007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:43.800312 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7317a-109a-4891-be67-fcb4dbe2d007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:43.801723 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7317a-109a-4891-be67-fcb4dbe2d007 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:43.812038 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1307/2584] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:45:47.688695 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7c290-20ed-4f96-9005-645f100353e9 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:47.689234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7c290-20ed-4f96-9005-645f100353e9 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:47.689234 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7c290-20ed-4f96-9005-645f100353e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:47.720706 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-94c7c290-20ed-4f96-9005-645f100353e9 None None] MFA Rules not processed for user `d2d41ebefb154e3f8d9f04825024dc2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:47.722098 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-94c7c290-20ed-4f96-9005-645f100353e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:47.742684 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:47.798446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1278/2585] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 20 13:45:47.799712 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7317a-109a-4891-be67-fcb4dbe2d007 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:47.810139 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7317a-109a-4891-be67-fcb4dbe2d007 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:47.815051 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c4329-148d-4076-babc-45dc6969440d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:47.815664 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c4329-148d-4076-babc-45dc6969440d admin admin] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:47.815938 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c4329-148d-4076-babc-45dc6969440d admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:47.816210 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c4329-148d-4076-babc-45dc6969440d admin admin] PATH_INFO: `/v3/projects` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:47.816845 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c4329-148d-4076-babc-45dc6969440d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:47.818753 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c4329-148d-4076-babc-45dc6969440d admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:47.850797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1308/2586] 10.222.0.36 () {60 vars in 1153 bytes} [Thu Oct 20 13:45:47 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 20 13:45:47.851872 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7c290-20ed-4f96-9005-645f100353e9 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:47.863261 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7c290-20ed-4f96-9005-645f100353e9 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:47.922992 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da9adc-2f6d-4a2c-94bf-e51a7d0e77d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:47.923669 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da9adc-2f6d-4a2c-94bf-e51a7d0e77d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:47.923946 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da9adc-2f6d-4a2c-94bf-e51a7d0e77d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:47.924211 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da9adc-2f6d-4a2c-94bf-e51a7d0e77d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:47.924850 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da9adc-2f6d-4a2c-94bf-e51a7d0e77d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:47.926759 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da9adc-2f6d-4a2c-94bf-e51a7d0e77d9 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:47.950836 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1279/2587] 10.222.0.36 () {60 vars in 1144 bytes} [Thu Oct 20 13:45:47 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 20 13:45:47.954925 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c4329-148d-4076-babc-45dc6969440d admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:47.966035 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c4329-148d-4076-babc-45dc6969440d admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:47.970821 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b1f59-6747-458a-a81f-f2db285b6629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:47.971524 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1f59-6747-458a-a81f-f2db285b6629 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:47.971791 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1f59-6747-458a-a81f-f2db285b6629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:47.972067 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1f59-6747-458a-a81f-f2db285b6629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:47.972714 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b1f59-6747-458a-a81f-f2db285b6629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:47.974317 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b1f59-6747-458a-a81f-f2db285b6629 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:47.986273 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1309/2588] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:45:47.991603 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da9adc-2f6d-4a2c-94bf-e51a7d0e77d9 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:48.004034 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da9adc-2f6d-4a2c-94bf-e51a7d0e77d9 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:48.010271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685e985-2142-44a2-9d79-63027dcbd23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:48.010271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e985-2142-44a2-9d79-63027dcbd23c admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:48.010271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e985-2142-44a2-9d79-63027dcbd23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:48.010271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685e985-2142-44a2-9d79-63027dcbd23c admin admin] PATH_INFO: `/v3/projects/735ad4eaf9254e459fe5c8a463d50c33/users/c75282b1bb7c439f83a54c66f3e77b3f/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:48.041427 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685e985-2142-44a2-9d79-63027dcbd23c admin admin] RBAC: Authorizing `identity:create_grant(project_id=735ad4eaf9254e459fe5c8a463d50c33, user_id=c75282b1bb7c439f83a54c66f3e77b3f, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:48.044709 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685e985-2142-44a2-9d79-63027dcbd23c admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:48.057391 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1280/2589] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:45:47 2022] PUT /identity/v3/projects/735ad4eaf9254e459fe5c8a463d50c33/users/c75282b1bb7c439f83a54c66f3e77b3f/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:48.062620 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b1f59-6747-458a-a81f-f2db285b6629 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:48.074535 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b1f59-6747-458a-a81f-f2db285b6629 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:48.134060 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e63c5-9311-4ac2-80ad-bfde38ea4018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:48.135187 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e63c5-9311-4ac2-80ad-bfde38ea4018 admin admin] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:48.135521 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e63c5-9311-4ac2-80ad-bfde38ea4018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:48.136255 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e63c5-9311-4ac2-80ad-bfde38ea4018 admin admin] PATH_INFO: `/v3/roles` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:48.136948 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e63c5-9311-4ac2-80ad-bfde38ea4018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:48.138546 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e63c5-9311-4ac2-80ad-bfde38ea4018 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:48.149443 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1310/2590] 10.222.0.36 () {58 vars in 1122 bytes} [Thu Oct 20 13:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 20 13:45:48.153658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685e985-2142-44a2-9d79-63027dcbd23c admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:48.164202 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685e985-2142-44a2-9d79-63027dcbd23c admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:48.169548 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6871a-43bd-4ed1-a22c-3b388d404662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:48.170225 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6871a-43bd-4ed1-a22c-3b388d404662 admin admin] REQUEST_METHOD: `PUT` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:48.170508 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6871a-43bd-4ed1-a22c-3b388d404662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:48.170811 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6871a-43bd-4ed1-a22c-3b388d404662 admin admin] PATH_INFO: `/v3/projects/735ad4eaf9254e459fe5c8a463d50c33/users/c75282b1bb7c439f83a54c66f3e77b3f/roles/9c0f227afc2e4a0aa404780de229488c` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:48.172926 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6871a-43bd-4ed1-a22c-3b388d404662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735ad4eaf9254e459fe5c8a463d50c33, user_id=c75282b1bb7c439f83a54c66f3e77b3f, role_id=9c0f227afc2e4a0aa404780de229488c)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:48.175634 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6871a-43bd-4ed1-a22c-3b388d404662 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:48.187762 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1281/2591] 10.222.0.36 () {60 vars in 1483 bytes} [Thu Oct 20 13:45:48 2022] PUT /identity/v3/projects/735ad4eaf9254e459fe5c8a463d50c33/users/c75282b1bb7c439f83a54c66f3e77b3f/roles/9c0f227afc2e4a0aa404780de229488c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:45:52.574899 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed0dc7-20b3-4ffb-be23-488e6417259b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:52.575414 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed0dc7-20b3-4ffb-be23-488e6417259b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:52.575530 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed0dc7-20b3-4ffb-be23-488e6417259b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:52.607843 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-baed0dc7-20b3-4ffb-be23-488e6417259b None None] MFA Rules not processed for user `c75282b1bb7c439f83a54c66f3e77b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:52.609275 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-baed0dc7-20b3-4ffb-be23-488e6417259b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:52.683794 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1311/2592] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:45:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:52.697224 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6871a-43bd-4ed1-a22c-3b388d404662 admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:52.699944 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-ecb6871a-43bd-4ed1-a22c-3b388d404662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:52.763513 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6871a-43bd-4ed1-a22c-3b388d404662 admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:52.767249 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d2daf-8f1d-4932-af10-799f05915c24 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d026ec6ed344404a5ebe4352792cc1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:52.767868 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d2daf-8f1d-4932-af10-799f05915c24 service glance] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:52.768147 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d2daf-8f1d-4932-af10-799f05915c24 service glance] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:52.768446 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d2daf-8f1d-4932-af10-799f05915c24 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:52.795487 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:52.831766 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d2daf-8f1d-4932-af10-799f05915c24 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:52.833201 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d2daf-8f1d-4932-af10-799f05915c24 service glance] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:52.843198 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1282/2593] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:45:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:45:52.984355 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7baf54-e1ed-460b-8eed-4f6c8875bb4d None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:52.984722 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7baf54-e1ed-460b-8eed-4f6c8875bb4d None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:52.985005 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7baf54-e1ed-460b-8eed-4f6c8875bb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:53.008559 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-ec7baf54-e1ed-460b-8eed-4f6c8875bb4d None None] MFA Rules not processed for user `44342daa668c4516ae131d9f0160261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:45:53.009792 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-ec7baf54-e1ed-460b-8eed-4f6c8875bb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:53.015732 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:45:53.077601 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1312/2594] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Oct 20 13:45:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:45:53.125141 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d2daf-8f1d-4932-af10-799f05915c24 service glance] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:45:53.126562 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-6c7d2daf-8f1d-4932-af10-799f05915c24 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:45:53.198423 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d2daf-8f1d-4932-af10-799f05915c24 service glance] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:45:53.203397 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61796972-eeb9-4e99-997c-6a1a0a201615 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c893e6388ed340eca17da2e279ca34a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:45:53.204005 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61796972-eeb9-4e99-997c-6a1a0a201615 service swift] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:45:53.204283 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61796972-eeb9-4e99-997c-6a1a0a201615 service swift] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:45:53.204553 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61796972-eeb9-4e99-997c-6a1a0a201615 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:45:53.212817 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61796972-eeb9-4e99-997c-6a1a0a201615 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:45:53.215098 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61796972-eeb9-4e99-997c-6a1a0a201615 service swift] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:45:53.223220 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1283/2595] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Oct 20 13:45:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 13:46:01.843299 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb050419-0d73-4f7e-9535-25f0bf34888e None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:46:01.843790 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb050419-0d73-4f7e-9535-25f0bf34888e None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:46:01.843889 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb050419-0d73-4f7e-9535-25f0bf34888e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:46:01.863090 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-eb050419-0d73-4f7e-9535-25f0bf34888e None None] MFA Rules not processed for user `d2d41ebefb154e3f8d9f04825024dc2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:46:01.864294 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-eb050419-0d73-4f7e-9535-25f0bf34888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:46:01.871857 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1313/2596] 10.222.0.36 () {58 vars in 958 bytes} [Thu Oct 20 13:46:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:46:01.912997 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61796972-eeb9-4e99-997c-6a1a0a201615 service swift] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:46:01.923039 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61796972-eeb9-4e99-997c-6a1a0a201615 service swift] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:46:01.926553 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c2933-4c6f-454e-be12-76aeae6c5575 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d026ec6ed344404a5ebe4352792cc1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:46:01.927175 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c2933-4c6f-454e-be12-76aeae6c5575 service glance] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:46:01.927457 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c2933-4c6f-454e-be12-76aeae6c5575 service glance] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:46:01.927744 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c2933-4c6f-454e-be12-76aeae6c5575 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:46:01.929718 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-901c2933-4c6f-454e-be12-76aeae6c5575 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:46:02.010244 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c2933-4c6f-454e-be12-76aeae6c5575 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:46:02.011704 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c2933-4c6f-454e-be12-76aeae6c5575 service glance] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:46:02.032146 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1284/2597] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:46:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:46:02.571701 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb050419-0d73-4f7e-9535-25f0bf34888e None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:46:02.573699 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-eb050419-0d73-4f7e-9535-25f0bf34888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:46:02.631469 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb050419-0d73-4f7e-9535-25f0bf34888e None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:46:02.635879 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdcea4-49df-48eb-a039-609d27a85b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:46:02.636441 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdcea4-49df-48eb-a039-609d27a85b74 service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:46:02.636715 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdcea4-49df-48eb-a039-609d27a85b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:46:02.636983 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdcea4-49df-48eb-a039-609d27a85b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:46:02.638826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-acbdcea4-49df-48eb-a039-609d27a85b74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:46:02.654203 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdcea4-49df-48eb-a039-609d27a85b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:46:02.656011 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdcea4-49df-48eb-a039-609d27a85b74 service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:46:02.670637 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1314/2598] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:46:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:46:03.775161 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f50536-7fc9-46ed-9475-1bfc6ff01978 None None] REQUEST_METHOD: `POST` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:46:03.775671 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f50536-7fc9-46ed-9475-1bfc6ff01978 None None] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:46:03.775842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f50536-7fc9-46ed-9475-1bfc6ff01978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:46:03.808796 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=100 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:46:03.841522 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.auth.core [None req-d2f50536-7fc9-46ed-9475-1bfc6ff01978 None None] MFA Rules not processed for user `44342daa668c4516ae131d9f0160261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81426) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:46:03.842786 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-d2f50536-7fc9-46ed-9475-1bfc6ff01978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:46:03.862403 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1285/2599] 10.222.0.36 () {58 vars in 1009 bytes} [Thu Oct 20 13:46:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:46:03.877291 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdcea4-49df-48eb-a039-609d27a85b74 service neutron] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:46:03.903695 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdcea4-49df-48eb-a039-609d27a85b74 service neutron] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:46:03.908893 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f147a-613a-4016-9c8a-945ea2a07e0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c893e6388ed340eca17da2e279ca34a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:46:03.909523 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f147a-613a-4016-9c8a-945ea2a07e0c service swift] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:46:03.909777 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f147a-613a-4016-9c8a-945ea2a07e0c service swift] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:46:03.910052 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f147a-613a-4016-9c8a-945ea2a07e0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:46:03.919402 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f147a-613a-4016-9c8a-945ea2a07e0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:46:03.920987 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f147a-613a-4016-9c8a-945ea2a07e0c service swift] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:46:03.929591 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1315/2600] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Oct 20 13:46:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 20 13:46:13.859383 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=9 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:46:13.925826 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=59 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:46:22.889722 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f50536-7fc9-46ed-9475-1bfc6ff01978 None None] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:46:22.899033 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f50536-7fc9-46ed-9475-1bfc6ff01978 None None] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:46:22.903159 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868238f-d037-4f8c-86a1-a8382c4a2dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:46:22.903751 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868238f-d037-4f8c-86a1-a8382c4a2dee service neutron] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:46:22.904030 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868238f-d037-4f8c-86a1-a8382c4a2dee service neutron] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:46:22.904302 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868238f-d037-4f8c-86a1-a8382c4a2dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:46:22.912933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868238f-d037-4f8c-86a1-a8382c4a2dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:46:22.914340 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868238f-d037-4f8c-86a1-a8382c4a2dee service neutron] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:46:22.924277 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1286/2601] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:46:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:46:32.920203 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=6 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:46:47.171853 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f147a-613a-4016-9c8a-945ea2a07e0c service swift] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:46:47.182161 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f147a-613a-4016-9c8a-945ea2a07e0c service swift] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:46:47.185840 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b179ff0-1353-40ea-8258-c1bbb934d25c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5852ff82962e4cea85b8aa8593f09d37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:46:47.186443 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b179ff0-1353-40ea-8258-c1bbb934d25c service neutron] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:46:47.186709 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b179ff0-1353-40ea-8258-c1bbb934d25c service neutron] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:46:47.187003 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b179ff0-1353-40ea-8258-c1bbb934d25c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:46:47.188696 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-2b179ff0-1353-40ea-8258-c1bbb934d25c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:46:47.198255 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b179ff0-1353-40ea-8258-c1bbb934d25c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:46:47.199688 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b179ff0-1353-40ea-8258-c1bbb934d25c service neutron] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:46:47.207558 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1316/2602] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:46:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:46:57.203929 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=6 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:47:42.525866 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868238f-d037-4f8c-86a1-a8382c4a2dee service neutron] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:47:42.528113 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-5868238f-d037-4f8c-86a1-a8382c4a2dee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:47:42.557073 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868238f-d037-4f8c-86a1-a8382c4a2dee service neutron] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:47:42.564606 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c2b25-b205-455a-bb3d-1191269f502b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '674c5b25932a41309428ba6c6c72ed02', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:47:42.565762 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c2b25-b205-455a-bb3d-1191269f502b service nova] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:47:42.566047 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c2b25-b205-455a-bb3d-1191269f502b service nova] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:47:42.566322 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c2b25-b205-455a-bb3d-1191269f502b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:47:42.568199 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-161c2b25-b205-455a-bb3d-1191269f502b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:47:42.584470 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c2b25-b205-455a-bb3d-1191269f502b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:47:42.586313 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c2b25-b205-455a-bb3d-1191269f502b service nova] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:47:42.601713 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1287/2603] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:47:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:47:49.856241 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09232f-b147-4d03-bd72-cf519ec64b4b None None] REQUEST_METHOD: `POST` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:47:49.856705 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09232f-b147-4d03-bd72-cf519ec64b4b None None] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:47:49.856812 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09232f-b147-4d03-bd72-cf519ec64b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:47:49.875953 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.auth.core [None req-4d09232f-b147-4d03-bd72-cf519ec64b4b None None] MFA Rules not processed for user `44342daa668c4516ae131d9f0160261f`. Rule list: `[]` (Enabled: `True`). {{(pid=81427) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 20 13:47:49.877146 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-4d09232f-b147-4d03-bd72-cf519ec64b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:47:49.886264 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1317/2604] 10.222.0.36 () {58 vars in 967 bytes} [Thu Oct 20 13:47:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 20 13:47:49.928326 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c2b25-b205-455a-bb3d-1191269f502b service nova] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:47:49.940174 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c2b25-b205-455a-bb3d-1191269f502b service nova] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:47:49.945031 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e17f6-8e2f-4336-b93a-4681c4799e94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c893e6388ed340eca17da2e279ca34a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:47:49.945618 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e17f6-8e2f-4336-b93a-4681c4799e94 service swift] REQUEST_METHOD: `GET` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:47:49.945894 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e17f6-8e2f-4336-b93a-4681c4799e94 service swift] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:47:49.946167 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e17f6-8e2f-4336-b93a-4681c4799e94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:47:49.954443 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e17f6-8e2f-4336-b93a-4681c4799e94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:47:49.956034 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e17f6-8e2f-4336-b93a-4681c4799e94 service swift] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:47:49.963971 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1288/2605] 10.222.0.36 () {60 vars in 1384 bytes} [Thu Oct 20 13:47:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 20 13:47:56.543797 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09232f-b147-4d03-bd72-cf519ec64b4b None None] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:47:56.613752 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09232f-b147-4d03-bd72-cf519ec64b4b None None] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:47:56.618278 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c236de-50d8-4c17-86ae-804e33b05061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:47:56.618910 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c236de-50d8-4c17-86ae-804e33b05061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:47:56.619222 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c236de-50d8-4c17-86ae-804e33b05061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:47:56.619497 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c236de-50d8-4c17-86ae-804e33b05061 admin admin] PATH_INFO: `/v3/users/d2d41ebefb154e3f8d9f04825024dc2a` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:47:56.620634 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c236de-50d8-4c17-86ae-804e33b05061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2d41ebefb154e3f8d9f04825024dc2a)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:47:56.623653 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c236de-50d8-4c17-86ae-804e33b05061 admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:47:56.672027 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-56c236de-50d8-4c17-86ae-804e33b05061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2d41ebefb154e3f8d9f04825024dc2a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:56.672740 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-56c236de-50d8-4c17-86ae-804e33b05061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2d41ebefb154e3f8d9f04825024dc2a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:56.679888 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-56c236de-50d8-4c17-86ae-804e33b05061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2d41ebefb154e3f8d9f04825024dc2a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:56.693604 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-56c236de-50d8-4c17-86ae-804e33b05061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2d41ebefb154e3f8d9f04825024dc2a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:56.694362 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-56c236de-50d8-4c17-86ae-804e33b05061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2d41ebefb154e3f8d9f04825024dc2a'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:56.707986 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1318/2606] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:47:56 2022] DELETE /identity/v3/users/d2d41ebefb154e3f8d9f04825024dc2a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 20 13:47:56.881495 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e17f6-8e2f-4336-b93a-4681c4799e94 service swift] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:47:56.893442 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e17f6-8e2f-4336-b93a-4681c4799e94 service swift] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:47:56.956410 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:47:56.957045 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:47:56.957346 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:47:56.957607 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af admin admin] PATH_INFO: `/v3/projects/c4b9c62edbf64a5da9318715156dc348` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:47:56.958721 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4b9c62edbf64a5da9318715156dc348)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:47:56.960658 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:47:57.006319 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4b9c62edbf64a5da9318715156dc348', 'request_id': 'req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:57.012335 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4b9c62edbf64a5da9318715156dc348', 'request_id': 'req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:57.017966 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4b9c62edbf64a5da9318715156dc348', 'request_id': 'req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:57.030619 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af admin admin] The token cache is being invalidate because project c4b9c62edbf64a5da9318715156dc348 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:47:57.030905 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:57.031540 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:57.033023 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1289/2607] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:47:56 2022] DELETE /identity/v3/projects/c4b9c62edbf64a5da9318715156dc348 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:47:57.036982 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c236de-50d8-4c17-86ae-804e33b05061 admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:47:57.038374 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-56c236de-50d8-4c17-86ae-804e33b05061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:47:57.052195 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c236de-50d8-4c17-86ae-804e33b05061 admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:47:57.109928 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175ade2-fa77-4cf3-8c29-2a56b56fed2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:47:57.110566 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175ade2-fa77-4cf3-8c29-2a56b56fed2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:47:57.110876 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175ade2-fa77-4cf3-8c29-2a56b56fed2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:47:57.111183 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175ade2-fa77-4cf3-8c29-2a56b56fed2f admin admin] PATH_INFO: `/v3/users/c75282b1bb7c439f83a54c66f3e77b3f` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:47:57.112336 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175ade2-fa77-4cf3-8c29-2a56b56fed2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c75282b1bb7c439f83a54c66f3e77b3f)` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:47:57.114259 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c175ade2-fa77-4cf3-8c29-2a56b56fed2f admin admin] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:47:57.129384 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:47:57.165126 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-c175ade2-fa77-4cf3-8c29-2a56b56fed2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c75282b1bb7c439f83a54c66f3e77b3f'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:57.165800 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-c175ade2-fa77-4cf3-8c29-2a56b56fed2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c75282b1bb7c439f83a54c66f3e77b3f'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:57.173375 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-c175ade2-fa77-4cf3-8c29-2a56b56fed2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c75282b1bb7c439f83a54c66f3e77b3f'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:57.186339 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-c175ade2-fa77-4cf3-8c29-2a56b56fed2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c75282b1bb7c439f83a54c66f3e77b3f'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:57.187041 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.notifications [None req-c175ade2-fa77-4cf3-8c29-2a56b56fed2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c75282b1bb7c439f83a54c66f3e77b3f'} {{(pid=81427) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:57.200217 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1319/2608] 10.222.0.36 () {58 vars in 1224 bytes} [Thu Oct 20 13:47:57 2022] DELETE /identity/v3/users/c75282b1bb7c439f83a54c66f3e77b3f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:47:57.375790 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af admin admin] Authenticating user token {{(pid=81426) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:47:57.377232 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.fernet_utils [None req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81426) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:47:57.395271 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12e90a-60ff-41cd-a0b1-91b0e6fec7af admin admin] Validating token access rules against request {{(pid=81426) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:47:57.454177 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cb67e-2afb-4af2-8a2c-98227c5b5c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f166e0661794d2b8c2ad033390437ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fb60201a6517430aaa26188ed8565651', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81426) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:47:57.454842 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cb67e-2afb-4af2-8a2c-98227c5b5c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:47:57.455161 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cb67e-2afb-4af2-8a2c-98227c5b5c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:47:57.455435 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cb67e-2afb-4af2-8a2c-98227c5b5c36 admin admin] PATH_INFO: `/v3/projects/735ad4eaf9254e459fe5c8a463d50c33` {{(pid=81426) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:47:57.456933 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cb67e-2afb-4af2-8a2c-98227c5b5c36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=735ad4eaf9254e459fe5c8a463d50c33)` {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:47:57.458881 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cb67e-2afb-4af2-8a2c-98227c5b5c36 admin admin] RBAC: Authorization granted {{(pid=81426) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:47:57.465767 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:47:57.507596 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-013cb67e-2afb-4af2-8a2c-98227c5b5c36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735ad4eaf9254e459fe5c8a463d50c33', 'request_id': 'req-013cb67e-2afb-4af2-8a2c-98227c5b5c36'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:57.515923 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-013cb67e-2afb-4af2-8a2c-98227c5b5c36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735ad4eaf9254e459fe5c8a463d50c33', 'request_id': 'req-013cb67e-2afb-4af2-8a2c-98227c5b5c36'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:57.521681 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-013cb67e-2afb-4af2-8a2c-98227c5b5c36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735ad4eaf9254e459fe5c8a463d50c33', 'request_id': 'req-013cb67e-2afb-4af2-8a2c-98227c5b5c36'} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:57.534222 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-013cb67e-2afb-4af2-8a2c-98227c5b5c36 admin admin] The token cache is being invalidate because project 735ad4eaf9254e459fe5c8a463d50c33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81426) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 20 13:47:57.534502 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-013cb67e-2afb-4af2-8a2c-98227c5b5c36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:57.535140 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG keystone.notifications [None req-013cb67e-2afb-4af2-8a2c-98227c5b5c36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81426) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 20 13:47:57.536607 dv-cinder-862136-1-smb devstack@keystone.service[81426]: [pid: 81426|app: 0|req: 1290/2609] 10.222.0.36 () {58 vars in 1233 bytes} [Thu Oct 20 13:47:57 2022] DELETE /identity/v3/projects/735ad4eaf9254e459fe5c8a463d50c33 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 20 13:48:07.196208 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:48:07.531294 dv-cinder-862136-1-smb devstack@keystone.service[81426]: DEBUG dbcounter [-] [81426] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 13:49:50.813055 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175ade2-fa77-4cf3-8c29-2a56b56fed2f admin admin] Authenticating user token {{(pid=81427) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 20 13:49:50.814471 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-c175ade2-fa77-4cf3-8c29-2a56b56fed2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:49:50.883615 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175ade2-fa77-4cf3-8c29-2a56b56fed2f admin admin] Validating token access rules against request {{(pid=81427) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 20 13:49:50.941801 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb74983-0c19-4e23-8d20-d7f3de5c520d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a00f0b4cee8d49a48a95317aec9f647c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c25f337a79704728adaa03f4103eef1c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81427) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 20 13:49:50.942406 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb74983-0c19-4e23-8d20-d7f3de5c520d service placement] REQUEST_METHOD: `GET` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 20 13:49:50.942680 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb74983-0c19-4e23-8d20-d7f3de5c520d service placement] SCRIPT_NAME: `/identity` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 20 13:49:50.942974 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb74983-0c19-4e23-8d20-d7f3de5c520d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81427) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 20 13:49:50.944692 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.fernet_utils [None req-5bb74983-0c19-4e23-8d20-d7f3de5c520d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81427) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 20 13:49:50.955608 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb74983-0c19-4e23-8d20-d7f3de5c520d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 20 13:49:50.957158 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb74983-0c19-4e23-8d20-d7f3de5c520d service placement] RBAC: Authorization granted {{(pid=81427) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 20 13:49:50.966724 dv-cinder-862136-1-smb devstack@keystone.service[81427]: [pid: 81427|app: 0|req: 1320/2610] 10.222.0.36 () {60 vars in 1365 bytes} [Thu Oct 20 13:49:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 20 13:50:00.962652 dv-cinder-862136-1-smb devstack@keystone.service[81427]: DEBUG dbcounter [-] [81427] Writing DB stats keystone:SELECT=58 {{(pid=81427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}